English
Related papers

Related papers: Are Deep Neural Networks "Robust"?

200 papers

We consider the problem of learning from noisy data in practical settings where the size of data is too large to store on a single machine. More challenging, the data coming from the wild may contain malicious outliers. To address the…

Machine Learning · Computer Science 2017-01-03 Jiashi Feng , Huan Xu , Shie Mannor

Recently, deep feedforward neural networks have achieved considerable success in modeling biological sensory processing, in terms of reproducing the input-output map of sensory neurons. However, such models raise profound questions about…

Neurons and Cognition · Quantitative Biology 2019-12-16 Hidenori Tanaka , Aran Nayebi , Niru Maheswaranathan , Lane McIntosh , Stephen A. Baccus , Surya Ganguli

Neural networks are an indispensable model class for many complex learning tasks. Despite the popularity and importance of neural networks and many different established techniques from literature for stabilization and robustification of…

Machine Learning · Statistics 2022-11-21 Tino Werner

The insideness problem is an aspect of image segmentation that consists of determining which pixels are inside and outside a region. Deep Neural Networks (DNNs) excel in segmentation benchmarks, but it is unclear if they have the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Kimberly Villalobos , Vilim Štih , Amineh Ahmadinejad , Shobhita Sundaram , Jamell Dozier , Andrew Francl , Frederico Azevedo , Tomotake Sasaki , Xavier Boix

The design of deep neural networks remains somewhat of an art rather than precise science. By tentatively adopting ergodic theory considerations on top of viewing the network as the time evolution of a dynamical system, with each layer…

Machine Learning · Computer Science 2025-02-18 Fan Zhang

Deep networks have recently been shown to be vulnerable to universal perturbations: there exist very small image-agnostic perturbations that cause most natural images to be misclassified by such classifiers. In this paper, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Omar Fawzi , Pascal Frossard , Stefano Soatto

With the great capabilities of deep classifiers for radar data processing come the risks of learning dataset-specific features that do not generalize well. In this work, the robustness of two deep convolutional architectures, trained and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Mikolaj Czerkawski , Carmine Clemente , Craig Michie , Christos Tachtatzis

This paper studies the robustness of feature attribution methods for deep neural networks. It challenges the current notion of attributional robustness that largely ignores the difference in the model's outputs and introduces a new way of…

Machine Learning · Computer Science 2025-12-09 Panagiota Kiourti , Anu Singh , Preeti Duraipandian , Weichao Zhou , Wenchao Li

When designing controllers for safety-critical systems, practitioners often face a challenging tradeoff between robustness and performance. While robust control methods provide rigorous guarantees on system stability under certain…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , Melrose Roderick , Mahyar Fazlyab , J. Zico Kolter

Deep neural networks have been widely adopted in many vision and robotics applications with visual inputs. It is essential to verify its robustness against semantic transformation perturbations, such as brightness and contrast. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hanjiang Hu , Bowei Li , Ziwei Wang , Tianhao Wei , Casidhe Hutchison , Eric Sample , Changliu Liu

In this paper we provide an approach for deep learning that protects against adversarial examples in image classification-type networks. The approach relies on two mechanisms:1) a mechanism that increases robustness at the expense of…

Machine Learning · Computer Science 2021-01-07 Yuting Liang , Reza Samavi

Human visual object recognition is typically rapid and seemingly effortless, as well as largely independent of viewpoint and object orientation. Until very recently, animate visual systems were the only ones capable of this remarkable…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Robert Geirhos , David H. J. Janssen , Heiko H. Schütt , Jonas Rauber , Matthias Bethge , Felix A. Wichmann

Deep neural networks use multiple layers of functions to map an object represented by an input vector progressively to different representations, and with sufficient training, eventually to a single score for each class that is the output…

Machine Learning · Computer Science 2022-09-02 Tin Kam Ho

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution (OOD) inputs. This limitation is one of the key challenges in the adoption of deep learning models in high-assurance…

Machine Learning · Computer Science 2021-03-24 Ramneet Kaur , Susmit Jha , Anirban Roy , Oleg Sokolsky , Insup Lee

In this work, we assess the theoretical limitations of determining guaranteed stability and accuracy of neural networks in classification tasks. We consider classical distribution-agnostic framework and algorithms minimising empirical risks…

This work investigates the detection of instabilities that may occur when utilizing deep learning models for image reconstruction tasks. Although neural networks often empirically outperform traditional reconstruction methods, their usage…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Jan Macdonald , Maximilian März , Luis Oala , Wojciech Samek

Convolutional Neural Networks (ConvNets) have successfully contributed to improve the accuracy of regression-based methods for computer vision tasks such as human pose estimation, landmark localization, and object detection. The network…

Computer Vision and Pattern Recognition · Computer Science 2015-09-23 Vasileios Belagiannis , Christian Rupprecht , Gustavo Carneiro , Nassir Navab

Networks are useful descriptions of the structure of many complex systems. Unsurprisingly, it is thus important to analyze the robustness of networks in many scientific disciplines. In applications in communication, logistics, finance,…

Physics and Society · Physics 2024-09-16 Alice C. Schwarze , Jessica Jiang , Jonny Wray , Mason A. Porter

The prediction accuracy has been the long-lasting and sole standard for comparing the performance of different image classification models, including the ImageNet competition. However, recent studies have highlighted the lack of robustness…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Dong Su , Huan Zhang , Hongge Chen , Jinfeng Yi , Pin-Yu Chen , Yupeng Gao

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato