English
Related papers

Related papers: CNS-Bench: Benchmarking Image Classifier Robustnes…

200 papers

Improving the accuracy of deep neural networks (DNNs) on out-of-distribution (OOD) data is critical to an acceptance of deep learning (DL) in real world applications. It has been observed that accuracies on in-distribution (ID) versus OOD…

Machine Learning · Computer Science 2022-07-12 Sara Fridovich-Keil , Brian R. Bartoldson , James Diffenderfer , Bhavya Kailkhura , Peer-Timo Bremer

Safety goes first. Meeting and maintaining industry safety standards for robustness of artificial intelligence (AI) and machine learning (ML) models require continuous monitoring for faults and performance drops. Deep learning models are…

Machine Learning · Computer Science 2023-02-03 Aria Khademi , Michael Hopka , Devesh Upadhyay

The prediction accuracy has been the long-lasting and sole standard for comparing the performance of different image classification models, including the ImageNet competition. However, recent studies have highlighted the lack of robustness…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Dong Su , Huan Zhang , Hongge Chen , Jinfeng Yi , Pin-Yu Chen , Yupeng Gao

Diffusion models have been applied to improve adversarial robustness of image classifiers by purifying the adversarial noises or generating realistic data for adversarial training. However, diffusion-based purification can be evaded by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Huanran Chen , Yinpeng Dong , Zhengyi Wang , Xiao Yang , Chengqi Duan , Hang Su , Jun Zhu

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jie Wang , Jun Ai , Minyan Lu , Haoran Su , Dan Yu , Yutao Zhang , Junda Zhu , Jingyu Liu

A few years ago, the first CNN surpassed human performance on ImageNet. However, it soon became clear that machines lack robustness on more challenging test cases, a major obstacle towards deploying machines "in the wild" and towards…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Robert Geirhos , Kantharaju Narayanappa , Benjamin Mitzkus , Tizian Thieringer , Matthias Bethge , Felix A. Wichmann , Wieland Brendel

Diffusion models learn to denoise data and the trained denoiser is then used to generate new samples from the data distribution. In this paper, we revisit the diffusion sampling process and identify a fundamental cause of sample quality…

Machine Learning · Computer Science 2024-11-05 Yunshu Wu , Yingtao Luo , Xianghao Kong , Evangelos E. Papalexakis , Greg Ver Steeg

We explore contemporary robust classification algorithms for overcoming class-dependant labelling noise: Forward, Importance Re-weighting and T-revision. The classifiers are trained and evaluated on class-conditional random label noise data…

Machine Learning · Computer Science 2021-06-02 Alex Díaz , Damian Steele

Image classification models deployed in the real world may receive inputs outside the intended data distribution. For critical applications such as clinical decision making, it is important that a model can detect such out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Christoph Berger , Magdalini Paschali , Ben Glocker , Konstantinos Kamnitsas

This paper presents a comprehensive evaluation of instance segmentation models with respect to real-world image corruptions as well as out-of-domain image collections, e.g. images captured by a different set-up than the training dataset.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yusuf Dalva , Hamza Pehlivan , Said Fahri Altindis , Aysegul Dundar

The performance of computer vision models are susceptible to unexpected changes in input images caused by sensor errors or extreme imaging environments, known as common corruptions (e.g. noise, blur, illumination changes). These corruptions…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Shunxin Wang , Raymond Veldhuis , Christoph Brune , Nicola Strisciuglio

The convolution neural nets (conv nets) have achieved a state-of-the-art performance in many applications of image and video processing. The most recent studies illustrate that the conv nets are fragile in terms of recognition accuracy to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Sergey Tarasenko , Fumihiko Takahashi

The rise of advanced AI models like Generative Adversarial Networks (GANs) and diffusion models such as Stable Diffusion has made the creation of highly realistic images accessible, posing risks of misuse in misinformation and manipulation.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Justin Jiang

In real-world applications, node features in graphs often contain noise from various sources, leading to significant performance degradation in GNNs. Although several methods have been developed to enhance robustness, they rely on the…

Machine Learning · Computer Science 2025-10-24 Yeonjun In , Kanghoon Yoon , Sukwon Yun , Kibum Kim , Sungchul Kim , Chanyoung Park

We present a systematic benchmark of out-of-distribution (OOD) detection CSFs through a representation-centric lens. Our study spans CNN and ViT backbones, multiple training paradigms, four image-classification source datasets (CIFAR-10,…

Machine Learning · Computer Science 2026-05-19 Claudio César Claros Olivares , Austin J. Brockmeier

Robust training with noisy labels is a critical challenge in image classification, offering the potential to reduce reliance on costly clean-label datasets. Real-world datasets often contain a mix of in-distribution (ID) and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Arpit Garg , Cuong Nguyen , Rafael Felix , Yuyuan Liu , Thanh-Toan Do , Gustavo Carneiro

Convolutional neural networks (CNNs) have demonstrated remarkable success in vision-related tasks. However, their susceptibility to failing when inputs deviate from the training distribution is well-documented. Recent studies suggest that…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Pradyumna Elavarthi , James Lee , Anca Ralescu

Generative adversarial networks (GANs) are neural networks that learn data distributions through adversarial training. In intensive studies, recent GANs have shown promising results for reproducing training images. However, in spite of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Takuhiro Kaneko , Tatsuya Harada

Deep neural networks give state-of-the-art accuracy for reconstructing images from few and noisy measurements, a problem arising for example in accelerated magnetic resonance imaging (MRI). However, recent works have raised concerns that…

Image and Video Processing · Electrical Eng. & Systems 2021-06-14 Mohammad Zalbagi Darestani , Akshay S. Chaudhari , Reinhard Heckel