English
Related papers

Related papers: Detecting adversarial attacks on random samples

200 papers

Deep neural networks are vulnerable to adversarial examples, i.e., carefully-perturbed inputs aimed to mislead classification. This work proposes a detection method based on combining non-linear dimensionality reduction and density…

Machine Learning · Computer Science 2019-05-02 Francesco Crecchi , Davide Bacciu , Battista Biggio

Despite the wide empirical success of modern machine learning algorithms and models in a multitude of applications, they are known to be highly susceptible to seemingly small indiscernible perturbations to the input data known as…

Machine Learning · Statistics 2022-04-05 Adel Javanmard , Mahdi Soltanolkotabi

State-of-the-art deep neural networks have proven to be highly powerful in a broad range of tasks, including semantic image segmentation. However, these networks are vulnerable against adversarial attacks, i.e., non-perceptible…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Kira Maag , Asja Fischer

In this work, we point out the problem of observed adversaries for deep policies. Specifically, recent work has shown that deep reinforcement learning is susceptible to adversarial attacks where an observed adversary acts under…

Machine Learning · Computer Science 2022-10-14 Eugene Lim , Harold Soh

Convolutional neural networks have been used to achieve a string of successes during recent years, but their lack of interpretability remains a serious issue. Adversarial examples are designed to deliberately fool neural networks into…

Machine Learning · Computer Science 2020-04-28 Jan Philip Göpfert , André Artelt , Heiko Wersing , Barbara Hammer

Fundamental questions remain about when and why adversarial examples arise in neural networks, with competing views characterising them either as artifacts of the irregularities in the decision landscape or as products of sensitivity to…

Machine Learning · Computer Science 2025-10-14 Edward Stevinson , Lucas Prieto , Melih Barsbey , Tolga Birdal

We provide a complete characterisation of the phenomenon of adversarial examples - inputs intentionally crafted to fool machine learning models. We aim to cover all the important concerns in this field of study: (1) the conjectures on the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Alexandru Constantin Serban , Erik Poll , Joost Visser

Machine learning models are often susceptible to adversarial perturbations of their inputs. Even small perturbations can cause state-of-the-art classifiers with high "standard" accuracy to produce an incorrect prediction with high…

Machine Learning · Computer Science 2018-05-03 Ludwig Schmidt , Shibani Santurkar , Dimitris Tsipras , Kunal Talwar , Aleksander Mądry

Attack detection is usually approached as a classification problem. However, standard classification tools often perform poorly because an adaptive attacker can shape his attacks in response to the algorithm. This has led to the recent…

Computer Science and Game Theory · Computer Science 2017-06-26 Lemonia Dritsoula , Patrick Loiseau , John Musacchio

We investigate conditions under which test statistics exist that can reliably detect examples, which have been adversarially manipulated in a white-box attack. These statistics can be easily computed and calibrated by randomly corrupting…

Machine Learning · Computer Science 2019-05-10 Kevin Roth , Yannic Kilcher , Thomas Hofmann

Many machine learning classifiers are vulnerable to adversarial perturbations. An adversarial perturbation modifies an input to change a classifier's prediction without causing the input to seem substantially different to human perception.…

Machine Learning · Computer Science 2017-03-27 Dan Hendrycks , Kevin Gimpel

Natural images are virtually surrounded by low-density misclassified regions that can be efficiently discovered by gradient-guided search --- enabling the generation of adversarial images. While many techniques for detecting these attacks…

Machine Learning · Computer Science 2019-12-05 Tao Yu , Shengyuan Hu , Chuan Guo , Wei-Lun Chao , Kilian Q. Weinberger

This paper aims to explain adversarial attacks in terms of how adversarial perturbations contribute to the attacking task. We estimate attributions of different image regions to the decrease of the attacking cost based on the Shapley value.…

Machine Learning · Computer Science 2021-08-17 Xin Wang , Shuyun Lin , Hao Zhang , Yufei Zhu , Quanshi Zhang

Robustness is a key requirement for widespread deployment of machine learning algorithms, and has received much attention in both statistics and computer science. We study a natural model of robustness for high-dimensional statistical…

Machine Learning · Computer Science 2020-06-03 Pranjal Awasthi , Xue Chen , Aravindan Vijayaraghavan

Machine Learning (ML) models are applied in a variety of tasks such as network intrusion detection or Malware classification. Yet, these models are vulnerable to a class of malicious inputs known as adversarial examples. These are slightly…

Cryptography and Security · Computer Science 2017-10-18 Kathrin Grosse , Praveen Manoharan , Nicolas Papernot , Michael Backes , Patrick McDaniel

Modern classification algorithms are susceptible to adversarial examples--perturbations to inputs that cause the algorithm to produce undesirable behavior. In this work, we seek to understand and extend adversarial examples across domains…

Machine Learning · Computer Science 2021-12-14 Volodymyr Kuleshov , Evgenii Nikishin , Shantanu Thakoor , Tingfung Lau , Stefano Ermon

Deep neural networks (DNNs) are notoriously vulnerable to adversarial attacks that place carefully crafted perturbations on normal examples to fool DNNs. To better understand such attacks, a characterization of the features carried by…

Machine Learning · Computer Science 2024-03-26 Rui Zheng , Yuhao Zhou , Zhiheng Xi , Tao Gui , Qi Zhang , Xuanjing Huang

The robustness of neural networks is challenged by adversarial examples that contain almost imperceptible perturbations to inputs, which mislead a classifier to incorrect outputs in high confidence. Limited by the extreme difficulty in…

Machine Learning · Computer Science 2020-10-20 Honglin Li , Yifei Fan , Frieder Ganz , Anthony Yezzi , Payam Barnaghi

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Machine Learning · Computer Science 2025-09-15 Prathyusha Devabhakthini , Sasmita Parida , Raj Mani Shukla , Suvendu Chandan Nayak , Tapadhir Das

Adversarial attacks present a significant threat to modern machine learning systems. Yet, existing detection methods often lack the ability to detect unseen attacks or detect different attack types with a high level of accuracy. In this…

Cryptography and Security · Computer Science 2025-10-06 Chinthana Wimalasuriya , Spyros Tragoudas