English
Related papers

Related papers: Interpreting Adversarial Robustness: A View from D…

200 papers

While adversarial training can improve robust accuracy (against an adversary), it sometimes hurts standard accuracy (when there is no adversary). Previous work has studied this tradeoff between standard and robust accuracy, but only in the…

Machine Learning · Computer Science 2019-08-28 Aditi Raghunathan , Sang Michael Xie , Fanny Yang , John C. Duchi , Percy Liang

Adversarial robustness has received increasing attention along with the study of adversarial examples. So far, existing works show that robust models not only obtain robustness against various adversarial attacks but also boost the…

Machine Learning · Computer Science 2021-11-29 Yang Bai , Xin Yan , Yong Jiang , Shu-Tao Xia , Yisen Wang

We study the model robustness against adversarial examples, referred to as small perturbed input data that may however fool many state-of-the-art deep learning models. Unlike previous research, we establish a novel theory addressing the…

Machine Learning · Computer Science 2020-06-11 Shufei Zhang , Kaizhu Huang , Zenglin Xu

There has been emerging interest to use transductive learning for adversarial robustness (Goldwasser et al., NeurIPS 2020; Wu et al., ICML 2020). Compared to traditional "test-time" defenses, these defense mechanisms "dynamically retrain"…

Machine Learning · Computer Science 2021-06-17 Jiefeng Chen , Yang Guo , Xi Wu , Tianqi Li , Qicheng Lao , Yingyu Liang , Somesh Jha

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Neural networks trained on visual data are well-known to be vulnerable to often imperceptible adversarial perturbations. The reasons for this vulnerability are still being debated in the literature. Recently Ilyas et al. (2019) showed that…

Machine Learning · Computer Science 2021-02-11 Jacob M. Springer , Melanie Mitchell , Garrett T. Kenyon

Despite the remarkable success of deep neural networks, significant concerns have emerged about their robustness to adversarial perturbations to inputs. While most attacks aim to ensure that these are imperceptible, physical perturbation…

Machine Learning · Computer Science 2020-10-09 Liang Tong , Minzhe Guo , Atul Prakash , Yevgeniy Vorobeychik

In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jie Wang , Jun Ai , Minyan Lu , Haoran Su , Dan Yu , Yutao Zhang , Junda Zhu , Jingyu Liu

Deep neural networks (DNNs) have gained prominence in various applications, such as classification, recognition, and prediction, prompting increased scrutiny of their properties. A fundamental attribute of traditional DNNs is their…

Machine Learning · Computer Science 2023-08-15 Roman Garaev , Bader Rasheed , Adil Khan

How to balance training accuracy and adversarial robustness has become a challenge since the birth of deep learning. Here, we introduce a geometry-aware deep learning framework that leverages layer-wise local training to sculpt the internal…

Machine Learning · Computer Science 2025-09-05 Yixiong Ren , Wenkang Du , Jianhui Zhou , Haiping Huang

In this paper, we investigate the use of pretraining with adversarial networks, with the objective of discovering the relationship between network depth and robustness. For this purpose, we selectively retrain different portions of VGG and…

Machine Learning · Computer Science 2021-11-01 Shoaib Ahmed Siddiqui , Thomas Breuel

Flatness of the loss surface not only correlates positively with generalization, but is also related to adversarial robustness since perturbations of inputs relate non-linearly to perturbations of weights. In this paper, we empirically…

Machine Learning · Computer Science 2025-03-11 Nils Philipp Walter , Linara Adilova , Jilles Vreeken , Michael Kamp

Recent analysis of deep neural networks has revealed their vulnerability to carefully structured adversarial examples. Many effective algorithms exist to craft these adversarial examples, but performant defenses seem to be far away. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Neale Ratzlaff , Li Fuxin

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

Machine Learning · Computer Science 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

Adversarial training is a widely used method to improve the robustness of deep neural networks (DNNs) over adversarial perturbations. However, it is empirically observed that adversarial training on over-parameterized networks often suffers…

Machine Learning · Statistics 2024-01-25 Zhongjie Shi , Fanghui Liu , Yuan Cao , Johan A. K. Suykens

In this paper we aim to explore the general robustness of neural network classifiers by utilizing adversarial as well as natural perturbations. Different from previous works which mainly focus on studying the robustness of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders

Adversarial robustness is considered as a required property of deep neural networks. In this study, we discover that adversarially trained models might have significantly different characteristics in terms of margin and smoothness, even…

Machine Learning · Computer Science 2021-08-26 Hoki Kim , Woojin Lee , Sungyoon Lee , Jaewook Lee

Given the apparent difficulty of learning models that are robust to adversarial perturbations, we propose tackling the simpler problem of developing adversarially robust features. Specifically, given a dataset and metric of interest, the…

Machine Learning · Computer Science 2024-08-27 Shivam Garg , Vatsal Sharan , Brian Hu Zhang , Gregory Valiant

While deep learning has led to remarkable results on a number of challenging problems, researchers have discovered a vulnerability of neural networks in adversarial settings, where small but carefully chosen perturbations to the input can…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Edward Grefenstette , Robert Stanforth , Brendan O'Donoghue , Jonathan Uesato , Grzegorz Swirszcz , Pushmeet Kohli

Previous studies demonstrate DNNs' vulnerability to adversarial examples and adversarial training can establish a defense to adversarial examples. In addition, recent studies show that deep neural networks also exhibit vulnerability to…

Machine Learning · Computer Science 2022-04-15 Zhiyuan Zhang , Ruixuan Luo , Xuancheng Ren , Qi Su , Liangyou Li , Xu Sun