English
Related papers

Related papers: First-order Adversarial Vulnerability of Neural Ne…

200 papers

The vulnerability of deep neural networks against adversarial examples - inputs with small imperceptible perturbations - has gained a lot of attention in the research community recently. Simultaneously, the number of parameters of…

Machine Learning · Computer Science 2021-08-20 Florian Merkle , Maximilian Samsinger , Pascal Schöttle

Adversarial attacks - input perturbations imperceptible to humans that fool neural networks - remain both a persistent failure mode in machine learning, and a phenomenon with mysterious origins. To shed light, we define and analyze a…

Machine Learning · Computer Science 2026-03-12 Alessandro Salvatore , Stanislav Fort , Surya Ganguli

Despite their impressive performance, deep neural networks exhibit striking failures on out-of-distribution inputs. One core idea of adversarial example research is to reveal neural network errors under such distribution shifts. We…

Machine Learning · Computer Science 2020-07-14 Jörn-Henrik Jacobsen , Jens Behrmann , Richard Zemel , Matthias Bethge

Neural networks are prone to misclassify slightly modified input images. Recently, many defences have been proposed, but none have improved the robustness of neural networks consistently. Here, we propose to use adversarial attacks as a…

Neural and Evolutionary Computing · Computer Science 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

While generalizing well over natural inputs, neural networks are vulnerable to adversarial inputs. Existing defenses against adversarial inputs have largely been detached from the real world. These defenses also come at a cost to accuracy.…

Machine Learning · Computer Science 2019-12-05 Varun Chandrasekaran , Brian Tang , Nicolas Papernot , Kassem Fawaz , Somesh Jha , Xi Wu

The existence of adversarial attacks on machine learning models imperceptible to a human is still quite a mystery from a theoretical perspective. In this work, we introduce two notions of adversarial attacks: natural or on-manifold attacks,…

Machine Learning · Computer Science 2024-03-26 Rajdeep Haldar , Yue Xing , Qifan Song

Adversarial perturbations are imperceptible changes to input pixels that can change the prediction of deep learning models. Learned weights of models robust to such perturbations are previously found to be transferable across different…

Machine Learning · Computer Science 2020-10-30 Alvin Chan , Yi Tay , Yew-Soon Ong

Neural networks are vulnerable to adversarially-constructed perturbations of their inputs. Most research so far has considered perturbations of a fixed magnitude under some $l_p$ norm. Although studying these attacks is valuable, there has…

Machine Learning · Computer Science 2019-10-02 Isaac Dunn , Hadrien Pouget , Tom Melham , Daniel Kroening

Deep neural networks are learning models having achieved state of the art performance in many fields like prediction, computer vision, language processing and so on. However, it has been shown that certain inputs exist which would not trick…

Machine Learning · Computer Science 2020-06-03 Jay N. Paranjape , Rahul Kumar Dubey , Vijendran V Gopalan

Neural Networks (NNs) are vulnerable to adversarial examples. Such inputs differ only slightly from their benign counterparts yet provoke misclassifications of the attacked NNs. The required perturbations to craft the examples are often…

Cryptography and Security · Computer Science 2020-09-30 Philip Sperl , Konstantin Böttinger

The vulnerability of deep image classification networks to adversarial attack is now well known, but less well understood. Via a novel experimental analysis, we illustrate some facts about deep convolutional networks for image…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Saumya Jetley , Nicholas A. Lord , Philip H. S. Torr

The results of training a neural network are heavily dependent on the architecture chosen; and even a modification of only its size, however small, typically involves restarting the training process. In contrast to this, we begin training…

Machine Learning · Computer Science 2024-02-12 Rupert Mitchell , Robin Menzenbach , Kristian Kersting , Martin Mundt

Machine learning methods in general and Deep Neural Networks in particular have shown to be vulnerable to adversarial perturbations. So far this phenomenon has mainly been studied in the context of whole-image classification. In this…

Machine Learning · Statistics 2017-03-06 Volker Fischer , Mummadi Chaithanya Kumar , Jan Hendrik Metzen , Thomas Brox

In this paper, we aim to understand and explain the decisions of deep neural networks by studying the behavior of predicted attributes when adversarial examples are introduced. We study the changes in attributes for clean as well as…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Sadaf Gulshad , Zeynep Akata , Jan Hendrik Metzen , Arnold Smeulders

Adversarial attacks in the form of imperceptible perturbations of normal images have been extensively studied, and for every new defense methodology created, multiple adversarial attacks are found to counteract it. In particular, a popular…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Carl Cheng , Evan Hu

Recent works have shown theoretically and empirically that redundant data dimensions are a source of adversarial vulnerability. However, the inverse doesn't seem to hold in practice; employing dimension-reduction techniques doesn't exhibit…

Machine Learning · Statistics 2024-10-10 Rajdeep Haldar , Yue Xing , Qifan Song , Guang Lin

Neural networks, being susceptible to adversarial attacks, should face a strict level of scrutiny before being deployed in critical or adversarial applications. This paper uses ideas from Chaos Theory to explain, analyze, and quantify the…

Machine Learning · Computer Science 2023-07-07 Jonathan S. Kent

For sensitive problems, such as medical imaging or fraud detection, Neural Network (NN) adoption has been slow due to concerns about their reliability, leading to a number of algorithms for explaining their decisions. NNs have also been…

Machine Learning · Computer Science 2019-11-06 Walt Woods , Jack Chen , Christof Teuscher

Although neural networks perform very well on the image classification task, they are still vulnerable to adversarial perturbations that can fool a neural network without visibly changing an input image. A paper has shown the existence of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Waris Radji

In this work we study input gradient regularization of deep neural networks, and demonstrate that such regularization leads to generalization proofs and improved adversarial robustness. The proof of generalization does not overcome the…

Machine Learning · Computer Science 2019-09-13 Chris Finlay , Jeff Calder , Bilal Abbasi , Adam Oberman