English
Related papers

Related papers: Provable Unrestricted Adversarial Training without…

200 papers

Adversarial training (AT) is a powerful regularization method for neural networks, aiming to achieve robustness to input perturbations. Yet, the specific effects of the robustness obtained from AT are still unclear in the context of natural…

Computation and Language · Computer Science 2018-04-23 Michihiro Yasunaga , Jungo Kasai , Dragomir Radev

Although attention mechanisms have been applied to a variety of deep learning models and have been shown to improve the prediction performance, it has been reported to be vulnerable to perturbations to the mechanism. To overcome the…

Computation and Language · Computer Science 2022-11-23 Shunsuke Kitada , Hitoshi Iyatomi

Although adversarial training (AT) has proven effective in enhancing the model's robustness, the recently revealed issue of fairness in robustness has not been well addressed, i.e. the robust accuracy varies significantly among different…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yanghao Zhang , Tianle Zhang , Ronghui Mu , Xiaowei Huang , Wenjie Ruan

Adversarial training, as one of the most effective defense methods against adversarial attacks, tends to learn an inclusive decision boundary to increase the robustness of deep learning models. However, due to the large and unnecessary…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Xiaoyu Liang , Yaguan Qian , Jianchang Huang , Xiang Ling , Bin Wang , Chunming Wu , Wassim Swaileh

In this paper, we study adversarial training on datasets that obey the long-tailed distribution, which is practical but rarely explored in previous works. Compared with conventional adversarial training on balanced datasets, this process…

Machine Learning · Computer Science 2023-12-05 Guanlin Li , Guowen Xu , Tianwei Zhang

Recently demonstrated physical-world adversarial attacks have exposed vulnerabilities in perception systems that pose severe risks for safety-critical applications such as autonomous driving. These attacks place adversarial artifacts in the…

Machine Learning · Computer Science 2021-06-23 Jan Hendrik Metzen , Nicole Finnie , Robin Hutmacher

Adversarial training has been empirically proven to be one of the most effective and reliable defense methods against adversarial attacks. However, almost all existing studies about adversarial training are focused on balanced datasets,…

Machine Learning · Computer Science 2021-07-30 Wentao Wang , Han Xu , Xiaorui Liu , Yaxin Li , Bhavani Thuraisingham , Jiliang Tang

Remarkable successes were made in Medical Image Classification (MIC) recently, mainly due to wide applications of convolutional neural networks (CNNs). However, adversarial examples (AEs) exhibited imperceptible similarity with raw data,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Shuai Li , Xiaoguang Ma , Shancheng Jiang , Lu Meng

Beyond the success story of adversarial training (AT) in the recent text domain on top of pre-trained language models (PLMs), our empirical study showcases the inconsistent gains from AT on some tasks, e.g. commonsense reasoning, named…

Computation and Language · Computer Science 2023-05-09 Hongqiu Wu , Yongxiang Liu , Hanwen Shi , Hai Zhao , Min Zhang

Unlearnable Examples (UEs) serve as a data protection strategy that generates imperceptible perturbations to mislead models into learning spurious correlations instead of underlying semantics. In this paper, we uncover a fundamental…

Machine Learning · Computer Science 2026-03-06 Zhihao Li , Gezheng Xu , Jiale Cai , Ruiyi Fang , Di Wu , Qicheng Lao , Charles Ling , Boyu Wang

Adversarial training is an important topic in robust deep learning, but the community lacks attention to its practical usage. In this paper, we aim to resolve a real-world challenge, i.e., training a model on an imbalanced and noisy dataset…

Machine Learning · Computer Science 2023-12-05 Guanlin Li , Kangjie Chen , Yuan Xu , Han Qiu , Tianwei Zhang

With the wide application of deep neural network models in various computer vision tasks, there has been a proliferation of adversarial example generation strategies aimed at deeply exploring model security. However, existing adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Wenxuan Wang , Chenglei Wang , Huihui Qi , Menghao Ye , Xuelin Qian , Peng Wang , Yanning Zhang

Adversarial Training (AT) is one of the most effective methods for developing robust deep neural networks (DNNs). However, AT faces a trade-off problem between clean accuracy and adversarial robustness. In this work, we reveal a surprising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Yanyun Wang , Qingqing Ye , Li Liu , Zi Liang , Haibo Hu

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

Machine Learning · Statistics 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

The strategy of ensemble has become popular in adversarial defense, which trains multiple base classifiers to defend against adversarial attacks in a cooperative manner. Despite the empirical success, theoretical explanations on why an…

Machine Learning · Computer Science 2023-11-03 Yian Deng , Tingting Mu

The deep neural networks are known to be vulnerable to well-designed adversarial attacks. The most successful defense technique based on adversarial training (AT) can achieve optimal robustness against particular attacks but cannot…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Guang Lin , Chao Li , Jianhai Zhang , Toshihisa Tanaka , Qibin Zhao

Adversarial training (AT) is an effective technique for enhancing adversarial robustness, but it usually comes at the cost of a decline in generalization ability. Recent studies have attempted to use clean training to assist adversarial…

Machine Learning · Computer Science 2025-04-02 MingWei Zhou , Xiaobing Pei

Adversarial training for LLMs is one of the most promising methods to reliably improve robustness against adversaries. However, despite significant progress, models remain vulnerable to simple in-distribution exploits, such as rewriting…

Machine Learning · Computer Science 2026-02-19 Chengzhi Hu , Jonas Dornbusch , David Lüdke , Stephan Günnemann , Leo Schwinn

It is well-known that deep neural networks (DNNs) are susceptible to adversarial attacks, exposing a severe fragility of deep learning systems. As the result, adversarial training (AT) method, by incorporating adversarial examples during…

Machine Learning · Computer Science 2022-03-01 Tuan Anh Bui , Trung Le , Quan Tran , He Zhao , Dinh Phung

The vulnerability of Deep Neural Networks to Adversarial Attacks has fuelled research towards building robust models. While most Adversarial Training algorithms aim at defending attacks constrained within low magnitude Lp norm bounds,…

Machine Learning · Computer Science 2022-10-19 Sravanti Addepalli , Samyak Jain , Gaurang Sriramanan , R. Venkatesh Babu