English
Related papers

Related papers: Omnipotent Adversarial Training in the Wild

200 papers

Adversarial training (AT) methods are effective against adversarial attacks, yet they introduce severe disparity of accuracy and robustness between different classes, known as the robust fairness problem. Previously proposed Fair Robust…

Machine Learning · Computer Science 2022-09-19 Chunyu Sun , Chenye Xu , Chengyuan Yao , Siyuan Liang , Yichao Wu , Ding Liang , XiangLong Liu , Aishan Liu

Adversarial training has proven effective in improving the robustness of deep neural networks against adversarial attacks. However, this enhanced robustness often comes at the cost of a substantial drop in accuracy on clean data. In this…

Machine Learning · Computer Science 2026-04-17 Bongsoo Yi , Rongjie Lai , Yao Li

In this paper, we study fast training of adversarially robust models. From the analyses of the state-of-the-art defense method, i.e., the multi-step adversarial training, we hypothesize that the gradient magnitude links to the model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jianyu Wang , Haichao Zhang

Despite the remarkable progress of deep neural networks (DNNs) in various visual tasks, their vulnerability to adversarial examples raises significant security concerns. Recent adversarial training methods leverage inverse adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kejia Zhang , Juanjuan Weng , Shaozi Li , Zhiming Luo

Recent work has uncovered the interesting (and somewhat surprising) finding that training models to be invariant to adversarial perturbations requires substantially larger datasets than those required for standard classification. This…

Machine Learning · Computer Science 2019-12-06 Jonathan Uesato , Jean-Baptiste Alayrac , Po-Sen Huang , Robert Stanforth , Alhussein Fawzi , Pushmeet Kohli

Adversarial training is an effective learning technique to improve the robustness of deep neural networks. In this study, the influence of adversarial training on deep learning models in terms of fairness, robustness, and generalization is…

Machine Learning · Computer Science 2023-05-19 Xiaoling Zhou , Nan Yang , Ou Wu

Corruptions due to data perturbations and label noise are prevalent in the datasets from unreliable sources, which poses significant threats to model training. Despite existing efforts in developing robust models, current learning methods…

Machine Learning · Computer Science 2024-05-08 Peng-Fei Zhang , Zi Huang , Xin-Shun Xu , Guangdong Bai

Adversarial Training (AT) is one of the most effective methods to enhance the robustness of Deep Neural Networks (DNNs). However, existing AT methods suffer from an inherent accuracy-robustness trade-off. Previous works have studied this…

Machine Learning · Computer Science 2025-05-28 Yanyun Wang , Li Liu , Zi Liang , Yi R. , Fung , Qingqing Ye , Haibo Hu

Adversarial training has been proven to be an effective technique for improving the adversarial robustness of models. However, there seems to be an inherent trade-off between optimizing the model for accuracy and robustness. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Elahe Arani , Fahad Sarfraz , Bahram Zonooz

We answer the question in the title, showing that adversarial training (AT) for diffusion models (DMs) fundamentally differs from classifiers: while AT in classifiers enforces output invariance, AT in DMs requires equivariance to keep the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Briglia Maria Rosaria , Mujtaba Hussain Mirza , Giuseppe Lisanti , Iacopo Masi

Though deep neural networks exhibit superior performance on various tasks, they are still plagued by adversarial examples. Adversarial training has been demonstrated to be the most effective method to defend against adversarial attacks.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xin Liu , Yichen Yang , Kun He , John E. Hopcroft

Deep neural networks can be easily fooled into making incorrect predictions through corruption of the input by adversarial perturbations: human-imperceptible artificial noise. So far adversarial training has been the most successful defense…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Lin Li , Michael Spratling

Adversarial training (AT) is a prominent technique employed by deep learning models to defend against adversarial attacks, and to some extent, enhance model robustness. However, there are three main drawbacks of the existing AT-based…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 X. Peng , D. Zhou , G. Sun , J. Shi , L. Wu

Recently proposed adversarial training methods show the robustness to both adversarial and original examples and achieve state-of-the-art results in supervised and semi-supervised learning. All the existing adversarial training methods…

Machine Learning · Computer Science 2019-11-15 Shufei Zhang , Kaizhu Huang , Jianke Zhu , Yang Liu

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Adversarial training, as one of the most effective defense methods against adversarial attacks, tends to learn an inclusive decision boundary to increase the robustness of deep learning models. However, due to the large and unnecessary…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Xiaoyu Liang , Yaguan Qian , Jianchang Huang , Xiang Ling , Bin Wang , Chunming Wu , Wassim Swaileh

While leveraging additional training data is well established to improve adversarial robustness, it incurs the unavoidable cost of data collection and the heavy computation to train models. To mitigate the costs, we propose Guided…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Salah Ghamizi , Jingfeng Zhang , Maxime Cordy , Mike Papadakis , Masashi Sugiyama , Yves Le Traon

Deep neural networks are susceptible to adversarial attacks and common corruptions, which undermine their robustness. In order to enhance model resilience against such challenges, Adversarial Training (AT) has emerged as a prominent…

Machine Learning · Computer Science 2025-06-17 Tejaswini Medi , Steffen Jung , Margret Keuper

Despite the fact that adversarial training has become the de facto method for improving the robustness of deep neural networks, it is well-known that vanilla adversarial training suffers from daunting robust overfitting, resulting in…

Machine Learning · Computer Science 2024-02-06 Tianjin Huang , Shiwei Liu , Tianlong Chen , Meng Fang , Li Shen , Vlaod Menkovski , Lu Yin , Yulong Pei , Mykola Pechenizkiy

Adversarial Training (AT) has been found to substantially improve the robustness of deep learning classifiers against adversarial attacks. AT involves obtaining robustness by including adversarial examples in training a classifier. Most…

Machine Learning · Computer Science 2023-07-17 Olukorede Fakorede , Ashutosh Kumar Nirala , Modeste Atsague , Jin Tian