English
Related papers

Related papers: Adversarial Examples Exist in Two-Layer ReLU Netwo…

200 papers

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

Machine Learning · Computer Science 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

A counter-intuitive property of convolutional neural networks (CNNs) is their inherent susceptibility to adversarial examples, which severely hinders the application of CNNs in security-critical fields. Adversarial examples are similar to…

Machine Learning · Computer Science 2022-07-27 Jiebao Zhang , Wenhua Qian , Rencan Nie , Jinde Cao , Dan Xu

It is not fully understood why adversarial examples can deceive neural networks and transfer between different networks. To elucidate this, several studies have hypothesized that adversarial perturbations, while appearing as noises, contain…

Machine Learning · Computer Science 2024-02-19 Soichiro Kumano , Hiroshi Kera , Toshihiko Yamasaki

Recent studies on the adversarial vulnerability of neural networks have shown that models trained to be more robust to adversarial attacks exhibit more interpretable saliency maps than their non-robust counterparts. We aim to quantify this…

Machine Learning · Statistics 2019-05-13 Christian Etmann , Sebastian Lunz , Peter Maass , Carola-Bibiane Schönlieb

Many existing deep learning models are vulnerable to adversarial examples that are imperceptible to humans. To address this issue, various methods have been proposed to design network architectures that are robust to one particular type of…

Machine Learning · Computer Science 2021-01-19 Jia Liu , Yaochu Jin

In this paper, we analyze deep learning from a mathematical point of view and derive several novel results. The results are based on intriguing mathematical properties of high dimensional spaces. We first look at perturbation based…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Simant Dube

Adversarial examples are maliciously tweaked images that can easily fool machine learning techniques, such as neural networks, but they are normally not visually distinguishable for human beings. One of the main approaches to solve this…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Zukang Liao

We prove that two-layer (Leaky)ReLU networks initialized by e.g. the widely used method proposed by He et al. (2015) and trained using gradient descent on a least-squares loss are not universally consistent. Specifically, we describe a…

Machine Learning · Statistics 2022-06-10 David Holzmüller , Ingo Steinwart

In this paper, we investigate the dynamics-aware adversarial attack problem of adaptive neural networks. Most existing adversarial attack algorithms are designed under a basic assumption -- the network architecture is fixed throughout the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 An Tao , Yueqi Duan , Yingqi Wang , Jiwen Lu , Jie Zhou

Although deep networks achieve strong accuracy on a range of computer vision benchmarks, they remain vulnerable to adversarial attacks, where imperceptible input perturbations fool the network. We present both theoretical and empirical…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Chengzhi Mao , Amogh Gupta , Vikram Nitin , Baishakhi Ray , Shuran Song , Junfeng Yang , Carl Vondrick

Deep neural networks (DNNs) are vulnerable to subtle adversarial perturbations applied to the input. These adversarial perturbations, though imperceptible, can easily mislead the DNN. In this work, we take a control theoretic approach to…

Machine Learning · Computer Science 2019-11-13 Arash Rahnama , Andre T. Nguyen , Edward Raff

Convolutional Neural Networks have been shown to be vulnerable to adversarial examples, which are known to locate in subspaces close to where normal data lies but are not naturally occurring and of low probability. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Fu Lin , Rohit Mittapalli , Prithvijit Chattopadhyay , Daniel Bolya , Judy Hoffman

Recently, Neural networks have seen a huge surge in its adoption due to their ability to provide high accuracy on various tasks. On the other hand, the existence of adversarial examples have raised suspicions regarding the generalization…

Machine Learning · Computer Science 2018-01-04 Mayank Singh , Abhishek Sinha , Balaji Krishnamurthy

Deep neural networks are vulnerable to small input perturbations known as adversarial attacks. Inspired by the fact that these adversaries are constructed by iteratively minimizing the confidence of a network for the true class label, we…

Machine Learning · Computer Science 2021-12-17 Motasem Alfarra , Juan C. Pérez , Ali Thabet , Adel Bibi , Philip H. S. Torr , Bernard Ghanem

In adversarial attacks to machine-learning classifiers, small perturbations are added to input that is correctly classified. The perturbations yield adversarial examples, which are virtually indistinguishable from the unperturbed input, and…

Machine Learning · Statistics 2018-09-26 Luca de Alfaro

The existing work shows that the neural network trained by naive gradient-based optimization method is prone to adversarial attacks, adds small malicious on the ordinary input is enough to make the neural network wrong. At the same time,…

Machine Learning · Computer Science 2024-01-23 Linfeng Ye , Shayan Mohajer Hamidi

Thanks to their extensive capacity, over-parameterized neural networks exhibit superior predictive capabilities and generalization. However, having a large parameter space is considered one of the main suspects of the neural networks'…

Adversarial neural networks solve many important problems in data science, but are notoriously difficult to train. These difficulties come from the fact that optimal weights for adversarial nets correspond to saddle points, and not…

Machine Learning · Computer Science 2018-02-12 Abhay Yadav , Sohil Shah , Zheng Xu , David Jacobs , Tom Goldstein

Adversarial machine learning concerns situations in which learners face attacks from active adversaries. Such scenarios arise in applications such as spam email filtering, malware detection and fake image generation, where security methods…

Machine Learning · Computer Science 2025-10-07 David Benfield , Stefano Coniglio , Phan Tu Vuong , Alain Zemkoho

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret