English
Related papers

Related papers: Decoder-free Robustness Disentanglement without (A…

200 papers

Adversarial defenses train deep neural networks to be invariant to the input perturbations from adversarial attacks. Almost all defense strategies achieve this invariance through adversarial training i.e. training on inputs with adversarial…

Machine Learning · Computer Science 2021-08-30 Landan Seguin , Anthony Ndirango , Neeli Mishra , SueYeon Chung , Tyler Lee

It is well-known that deep neural networks (DNNs) are susceptible to adversarial attacks, exposing a severe fragility of deep learning systems. As the result, adversarial training (AT) method, by incorporating adversarial examples during…

Machine Learning · Computer Science 2022-03-01 Tuan Anh Bui , Trung Le , Quan Tran , He Zhao , Dinh Phung

Extensive research demonstrates that Deep Reinforcement Learning (DRL) models are susceptible to adversarially constructed inputs (i.e., adversarial examples), which can mislead the agent to take suboptimal or unsafe actions. Recent methods…

Machine Learning · Computer Science 2026-02-24 Shenghong He

Adversarial training and its many variants substantially improve deep network robustness, yet at the cost of compromising standard accuracy. Moreover, the training process is heavy and hence it becomes impractical to thoroughly explore the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Haotao Wang , Tianlong Chen , Shupeng Gui , Ting-Kuei Hu , Ji Liu , Zhangyang Wang

Adversarial training (i.e., training on adversarially perturbed input data) is a well-studied method for making neural networks robust to potential adversarial attacks during inference. However, the improved robustness does not come for…

Robotics · Computer Science 2023-01-27 Mathias Lechner , Alexander Amini , Daniela Rus , Thomas A. Henzinger

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Machine Learning · Statistics 2021-11-01 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani , Alejandro Ribeiro

Many variants of adversarial training have been proposed, with most research focusing on problems with relatively few classes. In this paper, we propose Two Head Adversarial Training (THAT), a two-stream adversarial learning network that is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Zuxuan Wu , Tom Goldstein , Larry S. Davis , Ser-Nam Lim

This paper addresses the tradeoff between standard accuracy on clean examples and robustness against adversarial examples in deep neural networks (DNNs). Although adversarial training (AT) improves robustness, it degrades the standard…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Satoshi Suzuki , Shin'ya Yamaguchi , Shoichiro Takeda , Sekitoshi Kanai , Naoki Makishima , Atsushi Ando , Ryo Masumura

Adversarial Training (AT) has become arguably the state-of-the-art algorithm for extracting robust features. However, researchers recently notice that AT suffers from severe robust overfitting problems, particularly after learning rate (LR)…

Machine Learning · Computer Science 2023-10-31 Yifei Wang , Liangchen Li , Jiansheng Yang , Zhouchen Lin , Yisen Wang

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

Machine Learning · Computer Science 2020-08-13 Alex Serban , Erik Poll , Joost Visser

Adversarial training (AT) constructs robust neural networks by incorporating adversarial perturbations into natural data. However, it is plagued by the issue of robust overfitting (RO), which severely damages the model's robustness. In this…

Machine Learning · Computer Science 2024-07-30 Chaojian Yu , Xiaolong Shi , Jun Yu , Bo Han , Tongliang Liu

Adversarial training (AT) is an effective technique for enhancing adversarial robustness, but it usually comes at the cost of a decline in generalization ability. Recent studies have attempted to use clean training to assist adversarial…

Machine Learning · Computer Science 2025-04-02 MingWei Zhou , Xiaobing Pei

To advance the understanding of robust deep learning, we delve into the effects of adversarial training on self-supervised and supervised contrastive learning alongside supervised learning. Our analysis uncovers significant disparities…

Machine Learning · Computer Science 2023-06-08 Fatemeh Ghofrani , Mehdi Yaghouti , Pooyan Jamshidi

Adversarial training is an effective learning technique to improve the robustness of deep neural networks. In this study, the influence of adversarial training on deep learning models in terms of fairness, robustness, and generalization is…

Machine Learning · Computer Science 2023-05-19 Xiaoling Zhou , Nan Yang , Ou Wu

Recent studies demonstrate that Graph Neural Networks (GNNs) are vulnerable to slight but adversarially designed perturbations, known as adversarial examples. To address this issue, robust training methods against adversarial examples have…

Machine Learning · Computer Science 2022-11-22 Jintang Li , Jiaying Peng , Liang Chen , Zibin Zheng , Tingting Liang , Qing Ling

The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted great attention in the machine learning community. The problem is related to non-flatness and non-smoothness of normally obtained loss landscapes.…

Machine Learning · Computer Science 2023-02-13 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Adversarial training often suffers from a robustness-accuracy trade-off, where achieving high robustness comes at the cost of accuracy. One approach to mitigate this trade-off is leveraging invariance regularization, which encourages model…

Machine Learning · Computer Science 2025-08-29 Futa Waseda , Ching-Chun Chang , Isao Echizen

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique that approximately solves a robust optimization problem to minimize the worst-case loss and is widely…

Machine Learning · Computer Science 2022-03-28 Theodoros Tsiligkaridis , Jay Roberts

Deep learning methods have achieved great success in solving computer vision tasks, and they have been widely utilized in artificially intelligent systems for image processing, analysis, and understanding. However, deep neural networks have…

Machine Learning · Computer Science 2022-11-23 Hanshu Yan