English
Related papers

Related papers: SAT: Improving Adversarial Training via Curriculum…

200 papers

Adversarial training (AT) is among the most effective techniques to improve model robustness by augmenting training data with adversarial examples. However, most existing AT methods adopt a specific attack to craft adversarial examples,…

Machine Learning · Computer Science 2020-11-20 Yinpeng Dong , Zhijie Deng , Tianyu Pang , Hang Su , Jun Zhu

In this paper, we investigate on improving the adversarial robustness obtained in adversarial training (AT) via reducing the difficulty of optimization. To better study this problem, we build a novel Bregman divergence perspective for AT,…

Machine Learning · Computer Science 2024-01-08 Zihui Wu , Haichang Gao , Bingqian Zhou , Xiaoyan Guo , Shudong Zhang

Adversarial training (AT) has proven to be one of the most effective ways to defend Deep Neural Networks (DNNs) against adversarial attacks. However, the phenomenon of robust overfitting, i.e., the robustness will drop sharply at a certain…

Machine Learning · Computer Science 2022-05-25 Shudong Zhang , Haichang Gao , Tianwei Zhang , Yunyi Zhou , Zihui Wu

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

Machine Learning · Computer Science 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Deep neural networks are susceptible to human imperceptible adversarial perturbations. One of the strongest defense mechanisms is \emph{Adversarial Training} (AT). In this paper, we aim to address two predominant problems in AT. First,…

Machine Learning · Computer Science 2023-08-21 Jianhui Sun , Sanchit Sinha , Aidong Zhang

Adversarial training is a method for enhancing neural networks to improve the robustness against adversarial examples. Besides the security concerns of potential adversarial examples, adversarial training can also improve the generalization…

Machine Learning · Computer Science 2022-12-21 Zhiyuan Zhang , Wei Li , Ruihan Bao , Keiko Harimoto , Yunfang Wu , Xu Sun

Predicting the trajectories of surrounding objects is a critical task for self-driving vehicles and many other autonomous systems. Recent works demonstrate that adversarial attacks on trajectory prediction, where small crafted perturbations…

Machine Learning · Computer Science 2023-03-22 Ruochen Jiao , Xiangguo Liu , Takami Sato , Qi Alfred Chen , Qi Zhu

Adversarial training (AT) is widely considered the state-of-the-art technique for improving the robustness of deep neural networks (DNNs) against adversarial examples (AE). Nevertheless, recent studies have revealed that adversarially…

Machine Learning · Computer Science 2023-08-04 Chenhao Lin , Xiang Ji , Yulong Yang , Qian Li , Chao Shen , Run Wang , Liming Fang

Adversarial training (AT) is one of the most effective strategies for promoting model robustness. However, recent benchmarks show that most of the proposed improvements on AT are less effective than simply early stopping the training…

Machine Learning · Computer Science 2021-04-01 Tianyu Pang , Xiao Yang , Yinpeng Dong , Hang Su , Jun Zhu

Robust watermarking is typically trained with random post-processing augmentation, but random sampling under-covers the combinatorial space of realistic attack pipelines and rarely encounters the rare compositions that actually break…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Anirudh Satheesh , Michael-Andrei Panaitescu-Liess , Andrew Xu , Georgios Milis , Heng Huang , Zikui Cai , Furong Huang

Adversarial training enhances neural network robustness but suffers from a tendency to overfit and increased generalization errors on clean data. This work introduces CLAT, an innovative approach that mitigates adversarial overfitting by…

Machine Learning · Computer Science 2024-12-25 Bhavna Gopal , Huanrui Yang , Jingyang Zhang , Mark Horton , Yiran Chen

Adversarial training (AT) has been considered one of the most effective methods for making deep neural networks robust against adversarial attacks, while the training mechanisms and dynamics of AT remain open research problems. In this…

Machine Learning · Computer Science 2025-06-06 Zeming Wei , Yiwen Guo , Yisen Wang

Adversarial Training (AT) is widely recognized as an effective approach to enhance the adversarial robustness of Deep Neural Networks. As a variant of AT, Adversarial Robustness Distillation (ARD) has shown outstanding performance in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Shiji Zhao , Chi Chen , Ranjie Duan , Xizhe Wang , Xingxing Wei

Adversarial training has proven effective in improving the robustness of deep neural networks against adversarial attacks. However, this enhanced robustness often comes at the cost of a substantial drop in accuracy on clean data. In this…

Machine Learning · Computer Science 2026-04-17 Bongsoo Yi , Rongjie Lai , Yao Li

Adversarial training is an important topic in robust deep learning, but the community lacks attention to its practical usage. In this paper, we aim to resolve a real-world challenge, i.e., training a model on an imbalanced and noisy dataset…

Machine Learning · Computer Science 2023-12-05 Guanlin Li , Kangjie Chen , Yuan Xu , Han Qiu , Tianwei Zhang

Deep neural networks (DNNs) are sensitive to adversarial examples, resulting in fragile and unreliable performance in the real world. Although adversarial training (AT) is currently one of the most effective methodologies to robustify DNNs,…

Machine Learning · Computer Science 2023-03-01 Yize Li , Pu Zhao , Xue Lin , Bhavya Kailkhura , Ryan Goldhahn

Adversarial Training (AT) is proposed to alleviate the adversarial vulnerability of machine learning models by extracting only robust features from the input, which, however, inevitably leads to severe accuracy reduction as it discards the…

Machine Learning · Statistics 2020-07-06 Yifei Wang , Dan Peng , Furui Liu , Zhenguo Li , Zhitang Chen , Jiansheng Yang

In this paper, we study fast training of adversarially robust models. From the analyses of the state-of-the-art defense method, i.e., the multi-step adversarial training, we hypothesize that the gradient magnitude links to the model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jianyu Wang , Haichao Zhang

While leveraging additional training data is well established to improve adversarial robustness, it incurs the unavoidable cost of data collection and the heavy computation to train models. To mitigate the costs, we propose Guided…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Salah Ghamizi , Jingfeng Zhang , Maxime Cordy , Mike Papadakis , Masashi Sugiyama , Yves Le Traon

Adversarial training (AT) is one of the most effective defenses against adversarial attacks for deep learning models. In this work, we advocate incorporating the hypersphere embedding (HE) mechanism into the AT procedure by regularizing the…

Machine Learning · Computer Science 2020-11-26 Tianyu Pang , Xiao Yang , Yinpeng Dong , Kun Xu , Jun Zhu , Hang Su