English
Related papers

Related papers: Explaining and Harnessing Adversarial Examples

200 papers

We analyze the adversarial examples problem in terms of a model's fault tolerance with respect to its input. Whereas previous work focuses on arbitrarily strict threat models, i.e., $\epsilon$-perturbations, we consider arbitrary valid…

Machine Learning · Computer Science 2018-12-03 Angus Galloway , Anna Golubeva , Graham W. Taylor

Adversarial examples are malicious inputs crafted to induce misclassification. Commonly studied sensitivity-based adversarial examples introduce semantically-small changes to an input that result in a different model prediction. This paper…

Machine Learning · Computer Science 2020-08-05 Florian Tramèr , Jens Behrmann , Nicholas Carlini , Nicolas Papernot , Jörn-Henrik Jacobsen

Adversarial examples can be defined as inputs to a model which induce a mistake - where the model output is different than that of an oracle, perhaps in surprising or malicious ways. Original models of adversarial attacks are primarily…

Machine Learning · Computer Science 2018-11-06 Peter Henderson , Koustuv Sinha , Rosemary Nan Ke , Joelle Pineau

In our recent work (Bubeck, Price, Razenshteyn, arXiv:1805.10204) we argued that adversarial examples in machine learning might be due to an inherent computational hardness of the problem. More precisely, we constructed a binary…

Machine Learning · Computer Science 2018-11-16 Sébastien Bubeck , Yin Tat Lee , Eric Price , Ilya Razenshteyn

Deep neural networks have been successfully applied in various machine learning tasks. However, studies show that neural networks are susceptible to adversarial attacks. This exposes a potential threat to neural network-based intelligent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Haimin Zhang , Min Xu

In this paper, we analyze deep learning from a mathematical point of view and derive several novel results. The results are based on intriguing mathematical properties of high dimensional spaces. We first look at perturbation based…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Simant Dube

Most previous works usually explained adversarial examples from several specific perspectives, lacking relatively integral comprehension about this problem. In this paper, we present a systematic study on adversarial examples from three…

Machine Learning · Computer Science 2019-03-01 Ke Sun , Zhanxing Zhu , Zhouchen Lin

Deep Neural Networks (DNNs) are everywhere, frequently performing a fairly complex task that used to be unimaginable for machines to carry out. In doing so, they do a lot of decision making which, depending on the application, may be…

Machine Learning · Computer Science 2022-11-17 Avriti Chauhan , Mohammad Afzal , Hrishikesh Karmarkar , Yizhak Elboher , Kumar Madhukar , Guy Katz

Although current deep learning techniques have yielded superior performance on various computer vision tasks, yet they are still vulnerable to adversarial examples. Adversarial training and its variants have been shown to be the most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Junhao Dong , Seyed-Mohsen Moosavi-Dezfooli , Jianhuang Lai , Xiaohua Xie

The renaissance of deep learning has led to the massive development of automated driving. However, deep neural networks are vulnerable to adversarial examples. The perturbations of adversarial examples are imperceptible to human eyes but…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Jun Yan , Huilin Yin

An adversarial example is an input transformed by small perturbations that machine learning models consistently misclassify. While there are a number of methods proposed to generate adversarial examples for text data, it is not trivial to…

Computation and Language · Computer Science 2020-06-02 Ying Xu , Xu Zhong , Antonio Jose Jimeno Yepes , Jey Han Lau

Deep neural networks have been proved that they are vulnerable to adversarial examples, which are generated by adding human-imperceptible perturbations to images. To defend these adversarial examples, various detection based methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Kejiang Chen , Yuefeng Chen , Hang Zhou , Chuan Qin , Xiaofeng Mao , Weiming Zhang , Nenghai Yu

Adversarial examples (AEs) are images that can mislead deep neural network (DNN) classifiers via introducing slight perturbations into original images. This security vulnerability has led to vast research in recent years because it can…

Machine Learning · Computer Science 2020-12-25 Ruqi Bai , Saurabh Bagchi , David I. Inouye

The reliability of deep learning algorithms is fundamentally challenged by the existence of adversarial examples, which are incorrectly classified inputs that are extremely close to a correctly classified input. We explore the properties of…

Machine Learning · Statistics 2021-07-23 Giacomo De Palma , Bobak T. Kiani , Seth Lloyd

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

Machine Learning · Computer Science 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted great attention in the machine learning community. The problem is related to non-flatness and non-smoothness of normally obtained loss landscapes.…

Machine Learning · Computer Science 2023-02-13 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Adversarial examples causing evasive predictions are widely used to evaluate and improve the robustness of machine learning models. However, current studies focus on supervised learning tasks, relying on the ground-truth data label, a…

Machine Learning · Computer Science 2021-12-09 Chia-Yi Hsu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Chia-Mu Yu

It is well known that adversarial attacks can fool deep neural networks with imperceptible perturbations. Although adversarial training significantly improves model robustness, failure cases of defense still broadly exist. In this work, we…

Machine Learning · Computer Science 2021-06-10 Boxi Wu , Heng Pan , Li Shen , Jindong Gu , Shuai Zhao , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Due to their complex nature, it is hard to characterize the ways in which machine learning models can misbehave or be exploited when deployed. Recent work on adversarial examples, i.e. inputs with minor perturbations that result in…

Machine Learning · Computer Science 2018-02-27 Zhengli Zhao , Dheeru Dua , Sameer Singh

Ideally, what confuses neural network should be confusing to humans. However, recent experiments have shown that small, imperceptible perturbations can change the network prediction. To address this gap in perception, we propose a novel…

Machine Learning · Computer Science 2018-10-31 Alexander Matyasko , Lap-Pui Chau