English
Related papers

Related papers: Revisiting Adversarial Risk

200 papers

In adversarial machine learning, there was a common belief that robustness and accuracy hurt each other. The belief was challenged by recent studies where we can maintain the robustness and improve the accuracy. However, the other…

Machine Learning · Computer Science 2021-06-01 Jingfeng Zhang , Jianing Zhu , Gang Niu , Bo Han , Masashi Sugiyama , Mohan Kankanhalli

The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the…

Machine Learning · Computer Science 2023-10-05 Matan Levi , Aryeh Kontorovich

State of the art computer vision models have been shown to be vulnerable to small adversarial perturbations of the input. In other words, most images in the data distribution are both correctly classified by the model and are very close to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Justin Gilmer , Luke Metz , Fartash Faghri , Samuel S. Schoenholz , Maithra Raghu , Martin Wattenberg , Ian Goodfellow

Many machine learning (ML) classifiers are claimed to outperform humans, but they still make mistakes that humans do not. The most notorious examples of such mistakes are adversarial visual metamers. This paper aims to define and…

Machine Learning · Computer Science 2024-10-21 George I. Kamberov

Many machine learning classifiers are vulnerable to adversarial perturbations. An adversarial perturbation modifies an input to change a classifier's prediction without causing the input to seem substantially different to human perception.…

Machine Learning · Computer Science 2017-03-27 Dan Hendrycks , Kevin Gimpel

Neural networks have revolutionized various domains, exhibiting remarkable accuracy in tasks like natural language processing and computer vision. However, their vulnerability to slight alterations in input samples poses challenges,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Shashank Kotyan , Danilo Vasconcellos Vargas

It has been shown that most machine learning algorithms are susceptible to adversarial perturbations. Slightly perturbing an image in a carefully chosen direction in the image space may cause a trained neural network model to misclassify…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Jiajun Lu , Hussein Sibai , Evan Fabry , David Forsyth

Convolutional neural networks (CNNs) have made significant advancement, however, they are widely known to be vulnerable to adversarial attacks. Adversarial training is the most widely used technique for improving adversarial robustness to…

Machine Learning · Computer Science 2021-10-12 Philipp Benz , Chaoning Zhang , Adil Karjauv , In So Kweon

A necessary characteristic for the deployment of deep learning models in real world applications is resistance to small adversarial perturbations while maintaining accuracy on non-malicious inputs. While robust training provides models that…

Machine Learning · Statistics 2020-02-27 Aditya Saligrama , Guillaume Leclerc

Systematic error, which is not determined by chance, often refers to the inaccuracy (involving either the observation or measurement process) inherent to a system. In this paper, we exhibit some long-neglected but frequent-happening…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yan Wang , Yuhang Li , Ruihao Gong

Multiple intriguing problems are hovering in adversarial training, including robust overfitting, robustness overestimation, and robustness-accuracy trade-off. These problems pose great challenges to both reliable evaluation and practical…

Machine Learning · Computer Science 2021-10-08 Chengyu Dong , Liyuan Liu , Jingbo Shang

The study of adversarial robustness has so far largely focused on perturbations bound in p-norms. However, state-of-the-art models turn out to be also vulnerable to other, more natural classes of perturbations such as translations and…

Machine Learning · Computer Science 2019-09-17 Logan Engstrom , Brandon Tran , Dimitris Tsipras , Ludwig Schmidt , Aleksander Madry

What fundamentally distinguishes an adversarial attack from a misclassification due to limited model expressivity or finite data? In this work, we investigate this question in the setting of high-dimensional binary classification, where…

Machine Learning · Statistics 2025-06-17 Matteo Vilucchio , Lenka Zdeborová , Bruno Loureiro

We study the transfer of adversarial robustness of deep neural networks between different perturbation types. While most work on adversarial examples has focused on $L_\infty$ and $L_2$-bounded perturbations, these do not capture all types…

Machine Learning · Computer Science 2019-05-06 Daniel Kang , Yi Sun , Tom Brown , Dan Hendrycks , Jacob Steinhardt

Adversarial Training (AT) is one of the most effective methods to train robust Deep Neural Networks (DNNs). However, AT creates an inherent trade-off between clean accuracy and adversarial robustness, which is commonly attributed to the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yanyun Wang , Li Liu

Convolutional neural networks have been used to achieve a string of successes during recent years, but their lack of interpretability remains a serious issue. Adversarial examples are designed to deliberately fool neural networks into…

Machine Learning · Computer Science 2020-04-28 Jan Philip Göpfert , André Artelt , Heiko Wersing , Barbara Hammer

In this paper, a new parameter perturbation attack on DNNs, called adversarial parameter attack, is proposed, in which small perturbations to the parameters of the DNN are made such that the accuracy of the attacked DNN does not decrease…

Machine Learning · Computer Science 2022-03-22 Lijia Yu , Yihan Wang , Xiao-Shan Gao

We present a more general analysis of $H$-calibration for adversarially robust classification. By adopting a finer definition of calibration, we can cover settings beyond the restricted hypothesis sets studied in previous work. In…

Machine Learning · Computer Science 2021-05-07 Pranjal Awasthi , Anqi Mao , Mehryar Mohri , Yutao Zhong

The idea of robustness is central and critical to modern statistical analysis. However, despite the recent advances of deep neural networks (DNNs), many studies have shown that DNNs are vulnerable to adversarial attacks. Making…

Cryptography and Security · Computer Science 2023-06-02 Jungeum Kim , Xiao Wang

Many works show that node-level predictions of Graph Neural Networks (GNNs) are unrobust to small, often termed adversarial, changes to the graph structure. However, because manual inspection of a graph is difficult, it is unclear if the…

Machine Learning · Computer Science 2023-05-03 Lukas Gosch , Daniel Sturm , Simon Geisler , Stephan Günnemann