English
Related papers

Related papers: A New Kind of Adversarial Example

200 papers

Adversarial examples are some special input that can perturb the output of a deep neural network, in order to make produce intentional errors in the learning algorithms in the production environment. Most of the present methods for…

Machine Learning · Computer Science 2021-12-28 Chengjun Tang , Kun Zhang , Chunfang Xing , Yong Ding , Zengmin Xu

Thanks to recent advances in deep neural networks (DNNs), face recognition systems have become highly accurate in classifying a large number of face images. However, recent studies have found that DNNs could be vulnerable to adversarial…

Machine Learning · Computer Science 2020-01-29 Kazuya Kakizaki , Kosuke Yoshida

Adversarial examples have attracted significant attention in machine learning, but the reasons for their existence and pervasiveness remain unclear. We demonstrate that adversarial examples can be directly attributed to the presence of…

Machine Learning · Statistics 2019-08-13 Andrew Ilyas , Shibani Santurkar , Dimitris Tsipras , Logan Engstrom , Brandon Tran , Aleksander Madry

Adversarial attacks are usually expressed in terms of a gradient-based operation on the input data and model, this results in heavy computations every time an attack is generated. In this work, we solidify the idea of representing…

Machine Learning · Computer Science 2023-08-01 Rajdeep Haldar , Qifan Song

We propose a new adversarial attack to Deep Neural Networks for image classification. Different from most existing attacks that directly perturb input pixels, our attack focuses on perturbing abstract features, more specifically, features…

Machine Learning · Computer Science 2020-12-17 Qiuling Xu , Guanhong Tao , Siyuan Cheng , Xiangyu Zhang

Adversarial attacks on explainability models have drastic consequences when explanations are used to understand the reasoning of neural networks in safety critical systems. Path methods are one such class of attribution methods susceptible…

Machine Learning · Computer Science 2025-02-28 Lachlan Simpson , Federico Costanza , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

We propose a probabilistic perspective on adversarial examples, allowing us to embed subjective understanding of semantics as a distribution into the process of generating adversarial examples, in a principled manner. Despite significant…

Machine Learning · Statistics 2024-11-26 Andi Zhang , Mingtian Zhang , Damon Wischik

We investigate the problem of identifying adversarial attacks on image-based neural networks. We present intriguing experimental results showing significant discrepancies between the explanations generated for the predictions of a model on…

Machine Learning · Computer Science 2020-03-13 Sean Saito , Jin Wang

Deep learning models, while achieving state-of-the-art performance on many tasks, are susceptible to adversarial attacks that exploit inherent vulnerabilities in their architectures. Adversarial attacks manipulate the input data with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shreyasi Mandal

Adversarial examples are data points misclassified by neural networks. Originally, adversarial examples were limited to adding small perturbations to a given image. Recent work introduced the generalized concept of unrestricted adversarial…

Machine Learning · Computer Science 2020-05-20 Martin Kotuliak , Sandro E. Schoenborn , Andrei Dan

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturbations are crafted…

Machine Learning · Statistics 2020-04-28 Florian Tramèr , Alexey Kurakin , Nicolas Papernot , Ian Goodfellow , Dan Boneh , Patrick McDaniel

Neural machine translation systems tend to fail on less decent inputs despite its significant efficacy, which may significantly harm the credibility of this systems-fathoming how and when neural-based systems fail in such cases is critical…

Computation and Language · Computer Science 2020-05-27 Wei Zou , Shujian Huang , Jun Xie , Xinyu Dai , Jiajun Chen

Classifiers such as deep neural networks have been shown to be vulnerable against adversarial perturbations on problems with high-dimensional input space. While adversarial training improves the robustness of image classifiers against such…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Chaithanya Kumar Mummadi , Thomas Brox , Jan Hendrik Metzen

There has been an ongoing cycle where stronger defenses against adversarial attacks are subsequently broken by a more advanced defense-aware attack. We present a new approach towards ending this cycle where we "deflect'' adversarial attacks…

Machine Learning · Computer Science 2020-02-19 Yao Qin , Nicholas Frosst , Colin Raffel , Garrison Cottrell , Geoffrey Hinton

Despite the impressive performances reported by deep neural networks in different application domains, they remain largely vulnerable to adversarial examples, i.e., input samples that are carefully perturbed to cause misclassification at…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Angelo Sotgiu , Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Xiaoyi Feng , Fabio Roli

Adversarial images are samples that are intentionally modified to deceive machine learning systems. They are widely used in applications such as CAPTHAs to help distinguish legitimate human users from bots. However, the noise introduced…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Bilgin Aksoy , Alptekin Temizel

A human does not have to see all elephants to recognize an animal as an elephant. On contrast, current state-of-the-art deep learning approaches heavily depend on the variety of training samples and the capacity of the network. In practice,…

Machine Learning · Computer Science 2019-05-30 Shaokai Ye , Sia Huat Tan , Kaidi Xu , Yanzhi Wang , Chenglong Bao , Kaisheng Ma

Adversarial training, in which a network is trained on both adversarial and clean examples, is one of the most trusted defense methods against adversarial attacks. However, there are three major practical difficulties in implementing and…

Machine Learning · Computer Science 2019-10-11 Shixian Wen , Laurent Itti

Although current deep learning techniques have yielded superior performance on various computer vision tasks, yet they are still vulnerable to adversarial examples. Adversarial training and its variants have been shown to be the most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Junhao Dong , Seyed-Mohsen Moosavi-Dezfooli , Jianhuang Lai , Xiaohua Xie

Research of adversarial attacks is important for AI security because it shows the vulnerability of deep learning models and helps to build more robust models. Adversarial attacks on images are most widely studied, which include noise-based…

Cryptography and Security · Computer Science 2024-10-14 Xiaopei Zhu , Peiyang Xu , Guanning Zeng , Yingpeng Dong , Xiaolin Hu