Are Deep Neural Networks "Robust"?
Machine Learning
2020-08-31 v1 Computer Vision and Pattern Recognition
Authors:
Peter Meer
Abstract
Separating outliers from inliers is the definition of robustness in computer vision. This essay delineates how deep neural networks are different than typical robust estimators. Deep neural networks not robust by this traditional definition.
Keywords
Cite
@article{arxiv.2008.12650,
title = {Are Deep Neural Networks "Robust"?},
author = {Peter Meer},
journal= {arXiv preprint arXiv:2008.12650},
year = {2020}
}
Related papers
View all related →
Neural and Evolutionary Computing · Computer Science
How Robust are Deep Neural Networks?
Biswa Sengupta, Karl J. Friston
2018-05-01
Machine Learning · Computer Science
A Formalization of Robustness for Deep Neural Networks
Tommaso Dreossi, Shromona Ghosh, Alberto Sangiovanni-Vincentelli, Sanjit A. Seshia
2019-03-26
Computer Vision and Pattern Recognition · Computer Science
Learning how to be robust: Deep polynomial regression
Juan-Manuel Perez-Rua, Tomas Crivelli, Patrick Bouthemy, Patrick Perez
2018-05-24
Machine Learning · Computer Science
On the Robustness of Convolutional Neural Networks to Internal Architecture and Weight Perturbations
Nicholas Cheney, Martin Schrimpf, Gabriel Kreiman
2017-03-27
Machine Learning · Computer Science
Towards Proving the Adversarial Robustness of Deep Neural Networks
Guy Katz, Clark Barrett, David L. Dill, Kyle Julian +1
2017-09-12
Computation and Language · Computer Science
Why Robust Natural Language Understanding is a Challenge
Marco Casadio, Ekaterina Komendantskaya, Verena Rieser, Matthew L. Daggitt +3
2022-07-14
Machine Learning · Computer Science
Interpreting Robustness Proofs of Deep Neural Networks
Debangshu Banerjee, Avaljot Singh, Gagandeep Singh
2023-02-01
Machine Learning · Computer Science
Understanding Robust Learning through the Lens of Representation Similarities
Christian Cianfarani, Arjun Nitin Bhagoji, Vikash Sehwag, Ben Y. Zhao +2
2022-09-16
Machine Learning · Computer Science
Robust Explainability: A Tutorial on Gradient-Based Attribution Methods for Deep Neural Networks
Ian E. Nielsen, Dimah Dera, Ghulam Rasool, Nidhal Bouaynaya +1
2022-07-13
Machine Learning · Computer Science
Interpreting and Evaluating Neural Network Robustness
Fuxun Yu, Zhuwei Qin, Chenchen Liu, Liang Zhao +2
2019-05-13
Computer Vision and Pattern Recognition · Computer Science
A Systematic Review of Robustness in Deep Learning for Computer Vision: Mind the gap?
Nathan Drenkow, Numair Sani, Ilya Shpitser, Mathias Unberath
2022-11-29
Machine Learning · Computer Science
A general framework for defining and optimizing robustness
Alessandro Tibo, Manfred Jaeger, Kim G. Larsen
2021-06-01
Computer Vision and Pattern Recognition · Computer Science
Understanding Robustness of Transformers for Image Classification
Srinadh Bhojanapalli, Ayan Chakrabarti, Daniel Glasner, Daliang Li +2
2021-10-11
Computer Vision and Pattern Recognition · Computer Science
Robustness and invariance properties of image classifiers
Apostolos Modas
2022-09-07
Machine Learning · Computer Science
Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications
Chengyu Dong
2023-02-06
Computer Vision and Pattern Recognition · Computer Science
Intriguing properties of neural networks
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna +3
2014-02-20
Computer Vision and Pattern Recognition · Computer Science
Towards Analyzing Semantic Robustness of Deep Neural Networks
Abdullah Hamdi, Bernard Ghanem
2021-01-19
Machine Learning · Computer Science
Not So Robust After All: Evaluating the Robustness of Deep Neural Networks to Unseen Adversarial Attacks
Roman Garaev, Bader Rasheed, Adil Khan
2023-08-15
Machine Learning · Computer Science
Analysis of Invariance and Robustness via Invertibility of ReLU-Networks
Jens Behrmann, Sören Dittmer, Pascal Fernsel, Peter Maaß
2018-06-28
Machine Learning · Computer Science
Non-adversarial Robustness of Deep Learning Methods for Computer Vision
Gorana Gojić, Vladimir Vincan, Ognjen Kundačina, Dragiša Mišković +1
2023-05-25
Machine Learning · Computer Science
A Tale of Two Cities: Data and Configuration Variances in Robust Deep Learning
Guanqin Zhang, Jiankun Sun, Feng Xu, H. M. N. Dilum Bandara +3
2022-11-28
Machine Learning · Computer Science
Structural Robustness for Deep Learning Architectures
Carlos Lassance, Vincent Gripon, Jian Tang, Antonio Ortega
2019-09-12
Machine Learning · Computer Science
Reachable Sets of Classifiers and Regression Models: (Non-)Robustness Analysis and Robust Training
Anna-Kathrin Kopetzki, Stephan Günnemann
2021-05-13
Machine Learning · Computer Science
Adversarial Robustness in Multi-Task Learning: Promises and Illusions
Salah Ghamizi, Maxime Cordy, Mike Papadakis, Yves Le Traon
2021-10-29
Machine Learning · Computer Science
Recent Advances in Understanding Adversarial Robustness of Deep Neural Networks
Tao Bai, Jinqi Luo, Jun Zhao
2020-11-04