English
Related papers

Related papers: Adversarial examples in the physical world

200 papers

Machine learning algorithms have been shown to be vulnerable to adversarial manipulation through systematic modification of inputs (e.g., adversarial examples) in domains such as image recognition. Under the default threat model, the…

Cryptography and Security · Computer Science 2022-09-12 Ryan Sheatsley , Nicolas Papernot , Michael Weisman , Gunjan Verma , Patrick McDaniel

State-of-the-art deep learning classifiers are heavily overparameterized with respect to the amount of training examples and observed to generalize well on "clean" data, but be highly susceptible to infinitesmal adversarial perturbations.…

Machine Learning · Computer Science 2021-09-28 Adhyyan Narang , Vidya Muthukumar , Anant Sahai

Physical adversarial examples for camera-based computer vision have so far been achieved through visible artifacts -- a sticker on a Stop sign, colorful borders around eyeglasses or a 3D printed object with a colorful texture. An implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Athena Sayles , Ashish Hooda , Mohit Gupta , Rahul Chatterjee , Earlence Fernandes

Machine learning models are usually evaluated according to the average case performance on the test set. However, this is not always ideal, because in some sensitive domains (e.g. autonomous driving), it is the worst case performance that…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Michelle Shu , Chenxi Liu , Weichao Qiu , Alan Yuille

Deep neural networks obtain state-of-the-art performance on a series of tasks. However, they are easily fooled by adding a small adversarial perturbation to input. The perturbation is often human imperceptible on image data. We observe a…

Machine Learning · Computer Science 2019-06-11 Puyudi Yang , Jianbo Chen , Cho-Jui Hsieh , Jane-Ling Wang , Michael I. Jordan

Image classification currently faces significant security challenges due to adversarial attacks, which consist of intentional alterations designed to deceive classification models based on artificial intelligence. This article explores an…

Neural and Evolutionary Computing · Computer Science 2025-07-18 Sergio Nesmachnow , Jamal Toutouh

Machine learning (ML) classifiers are vulnerable to adversarial examples. An adversarial example is an input sample which is slightly modified to induce misclassification in an ML classifier. In this work, we investigate white-box and…

Cryptography and Security · Computer Science 2019-04-17 Yonghong Huang , Utkarsh Verma , Celeste Fralick , Gabriel Infante-Lopez , Brajesh Kumarz , Carl Woodward

Adversarial examples are a major problem for machine learning models, leading to a continuous search for effective defenses. One promising direction is to leverage model explanations to better understand and defend against these attacks. We…

Cryptography and Security · Computer Science 2025-03-14 Qian Ma , Ziping Ye

There has been an increased interest in the application of convolutional neural networks for image based malware classification, but the susceptibility of neural networks to adversarial examples allows malicious actors to evade classifiers.…

Cryptography and Security · Computer Science 2020-06-24 Daniel Park , Haidar Khan , Bülent Yener

Operating in a dynamic real world environment requires a forward thinking and adversarial aware design for classifiers, beyond fitting the model to the training data. In such scenarios, it is necessary to make classifiers - a) harder to…

Machine Learning · Computer Science 2018-03-28 Tegjyot Singh Sethi , Mehmed Kantardzic , Lingyu Lyua , Jiashun Chen

In spite of the enormous success of neural networks, adversarial examples remain a relatively weakly understood feature of deep learning systems. There is a considerable effort in both building more powerful adversarial attacks and…

Machine Learning · Computer Science 2022-08-16 Maciej Żelaszczyk , Jacek Mańdziuk

With further development in the fields of computer vision, network security, natural language processing and so on so forth, deep learning technology gradually exposed certain security risks. The existing deep learning algorithms cannot…

Cryptography and Security · Computer Science 2020-11-18 Rui Zhao

Machine learning classifiers with high test accuracy often perform poorly under adversarial attacks. It is commonly believed that adversarial training alleviates this issue. In this paper, we demonstrate that, surprisingly, the opposite may…

Machine Learning · Computer Science 2022-03-30 Jacob Clarysse , Julia Hörrmann , Fanny Yang

The increasing use of deep neural networks (DNNs) has motivated a parallel endeavor: the design of adversaries that profit from successful misclassifications. However, not all adversarial examples are crafted for malicious purposes. For…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Pk Douglas , Farzad Vasheghani Farahani

Deep learning has come a long way and has enjoyed an unprecedented success. Despite high accuracy, however, deep models are brittle and are easily fooled by imperceptible adversarial perturbations. In contrast to common inference-time…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Ali Borji

The emergence of Deep Neural Networks (DNNs) has revolutionized various domains by enabling the resolution of complex tasks spanning image recognition, natural language processing, and scientific problem-solving. However, this progress has…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jindong Gu , Xiaojun Jia , Pau de Jorge , Wenqain Yu , Xinwei Liu , Avery Ma , Yuan Xun , Anjun Hu , Ashkan Khakzar , Zhijiang Li , Xiaochun Cao , Philip Torr

An adversarial example is an input transformed by small perturbations that machine learning models consistently misclassify. While there are a number of methods proposed to generate adversarial examples for text data, it is not trivial to…

Computation and Language · Computer Science 2020-06-02 Ying Xu , Xu Zhong , Antonio Jose Jimeno Yepes , Jey Han Lau

Recently, many studies have demonstrated deep neural network (DNN) classifiers can be fooled by the adversarial example, which is crafted via introducing some perturbations into an original sample. Accordingly, some powerful defense…

Cryptography and Security · Computer Science 2019-01-10 Bin Liang , Hongcheng Li , Miaoqiang Su , Xirong Li , Wenchang Shi , Xiaofeng Wang

Note that this paper is superceded by "Black-Box Adversarial Attacks with Limited Queries and Information." Current neural network-based image classifiers are susceptible to adversarial examples, even in the black-box setting, where the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Andrew Ilyas , Logan Engstrom , Anish Athalye , Jessy Lin

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

Machine Learning · Statistics 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu