English
Related papers

Related papers: Robustness of classifiers to universal perturbatio…

200 papers

In this paper we address the issue of output instability of deep neural networks: small perturbations in the visual input can significantly distort the feature embeddings and output of a neural network. Such instability affects many deep…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Stephan Zheng , Yang Song , Thomas Leung , Ian Goodfellow

Deep neural networks are highly expressive models that have recently achieved state of the art performance on speech and visual recognition tasks. While their expressiveness is the reason they succeed, it also causes them to learn…

Computer Vision and Pattern Recognition · Computer Science 2014-02-20 Christian Szegedy , Wojciech Zaremba , Ilya Sutskever , Joan Bruna , Dumitru Erhan , Ian Goodfellow , Rob Fergus

Aimed at explaining the surprisingly good generalization behavior of overparameterized deep networks, recent works have developed a variety of generalization bounds for deep learning, all based on the fundamental learning-theoretic…

Machine Learning · Computer Science 2021-10-19 Vaishnavh Nagarajan , J. Zico Kolter

In this paper, we aim to understand and explain the decisions of deep neural networks by studying the behavior of predicted attributes when adversarial examples are introduced. We study the changes in attributes for clean as well as…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Sadaf Gulshad , Zeynep Akata , Jan Hendrik Metzen , Arnold Smeulders

Neural Networks have been shown to be sensitive to common perturbations such as blur, Gaussian noise, rotations, etc. They are also vulnerable to some artificial malicious corruptions called adversarial examples. The adversarial examples…

Machine Learning · Computer Science 2019-10-10 Alfred Laugros , Alice Caplier , Matthieu Ospici

Machine learning models, including state-of-the-art deep neural networks, are vulnerable to small perturbations that cause unexpected classification errors. This unexpected lack of robustness raises fundamental questions about their…

Computer Vision and Pattern Recognition · Computer Science 2018-02-01 Andras Rozsa , Manuel Gunther , Terrance E. Boult

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

Machine Learning · Statistics 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

Recent studies have shown that modern deep neural network classifiers are easy to fool, assuming that an adversary is able to slightly modify their inputs. Many papers have proposed adversarial attacks, defenses and methods to measure…

Machine Learning · Computer Science 2020-03-17 Igor Buzhinsky , Arseny Nerinovsky , Stavros Tripakis

Neural networks have been successfully used for classification tasks in a rapidly growing number of practical applications. Despite their popularity and widespread use, there are still many aspects of training and classification that are…

Machine Learning · Computer Science 2016-05-03 Ewout van den Berg

A globally robust deep neural network resists perturbations on all meaningful inputs. Current robustness certification methods emphasize local robustness, struggling to scale and generalize. This paper presents a systematic and efficient…

Machine Learning · Computer Science 2024-06-03 You Li , Guannan Zhao , Shuyu Kong , Yunqi He , Hai Zhou

We consider a classifier whose test set is exposed to various perturbations that are not present in the training set. These test samples still contain enough features to map them to the same class as their unperturbed counterpart. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Yuchen Li , Safwan Hossain , Kiarash Jamali , Frank Rudzicz

Neural networks are successful in various applications but are also susceptible to adversarial attacks. To show the safety of network classifiers, many verifiers have been introduced to reason about the local robustness of a given input to…

Machine Learning · Computer Science 2024-03-07 Anan Kabaha , Dana Drachsler-Cohen

We cannot guarantee that training datasets are representative of the distribution of inputs that will be encountered during deployment. So we must have confidence that our models do not over-rely on this assumption. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Isaac Dunn , Laura Hanu , Hadrien Pouget , Daniel Kroening , Tom Melham

We introduce DeepCert, a tool-supported method for verifying the robustness of deep neural network (DNN) image classifiers to contextually relevant perturbations such as blur, haze, and changes in image contrast. While the robustness of DNN…

Machine Learning · Computer Science 2021-03-03 Colin Paterson , Haoze Wu , John Grese , Radu Calinescu , Corina S. Pasareanu , Clark Barrett

Deep Neural networks have gained lots of attention in recent years thanks to the breakthroughs obtained in the field of Computer Vision. However, despite their popularity, it has been shown that they provide limited robustness in their…

Machine Learning · Computer Science 2020-08-21 Marco Maggipinto , Matteo Terzi , Gian Antonio Susto

Why are classifiers in high dimension vulnerable to "adversarial" perturbations? We show that it is likely not due to information theoretic limitations, but rather it could be due to computational constraints. First we prove that, for a…

Machine Learning · Statistics 2018-05-28 Sébastien Bubeck , Eric Price , Ilya Razenshteyn

Deep neural networks bring in impressive accuracy in various applications, but the success often relies on the heavy network architecture. Taking well-trained heavy networks as teachers, classical teacher-student learning paradigm aims to…

Machine Learning · Computer Science 2018-08-01 Tianyu Guo , Chang Xu , Shiyi He , Boxin Shi , Chao Xu , Dacheng Tao

Autonomous vehicles are highly complex systems, required to function reliably in a wide variety of situations. Manually crafting software controllers for these vehicles is difficult, but there has been some success in using deep neural…

Machine Learning · Computer Science 2017-09-12 Guy Katz , Clark Barrett , David L. Dill , Kyle Julian , Mykel J. Kochenderfer

In practice it is often found that large over-parameterized neural networks generalize better than their smaller counterparts, an observation that appears to conflict with classical notions of function complexity, which typically favor…

Machine Learning · Statistics 2018-06-20 Roman Novak , Yasaman Bahri , Daniel A. Abolafia , Jeffrey Pennington , Jascha Sohl-Dickstein