English
Related papers

Related papers: Provable Unrestricted Adversarial Training without…

200 papers

Neural network models are vulnerable to adversarial examples, and adversarial transferability further increases the risk of adversarial attacks. Current methods based on transferability often rely on substitute models, which can be…

Computation and Language · Computer Science 2023-11-07 Minxuan Lv , Chengwei Dai , Kun Li , Wei Zhou , Songlin Hu

Self-ensemble adversarial training methods improve model robustness by ensembling models at different training epochs, such as model weight averaging (WA). However, previous research has shown that self-ensemble defense methods in…

Machine Learning · Computer Science 2024-06-21 Zhaozhe Hu , Jia-Li Yin , Bin Chen , Luojun Lin , Bo-Hao Chen , Ximeng Liu

Single-step adversarial training (SSAT) has demonstrated the potential to achieve both efficiency and robustness. However, SSAT suffers from catastrophic overfitting (CO), a phenomenon that leads to a severely distorted classifier, making…

Machine Learning · Computer Science 2024-09-17 Runqi Lin , Chaojian Yu , Tongliang Liu

Despite their performance, Artificial Neural Networks are not reliable enough for most of industrial applications. They are sensitive to noises, rotations, blurs and adversarial examples. There is a need to build defenses that protect…

Machine Learning · Computer Science 2020-08-20 Alfred Laugros , Alice Caplier , Matthieu Ospici

Adversarial training is a promising strategy for enhancing model robustness against adversarial attacks. However, its impact on generalization under substantial data distribution shifts in audio classification remains largely unexplored. To…

Machine Learning · Computer Science 2025-07-21 René Heinrich , Lukas Rauch , Bernhard Sick , Christoph Scholz

Rationalization models, which select a subset of input text as rationale-crucial for humans to understand and trust predictions-have recently emerged as a prominent research area in eXplainable Artificial Intelligence. However, most of…

Computation and Language · Computer Science 2024-09-20 Yuankai Zhang , Lingxiao Kong , Haozhao Wang , Ruixuan Li , Jun Wang , Yuhua Li , Wei Liu

Recent studies demonstrate that Graph Neural Networks (GNNs) are vulnerable to slight but adversarially designed perturbations, known as adversarial examples. To address this issue, robust training methods against adversarial examples have…

Machine Learning · Computer Science 2022-11-22 Jintang Li , Jiaying Peng , Liang Chen , Zibin Zheng , Tingting Liang , Qing Ling

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

Large vision models have been found vulnerable to adversarial examples, emphasizing the need for enhancing their adversarial robustness. While adversarial training is an effective defense for deep convolutional models, it often faces…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Kangtao Lv , Huangsen Cao , Kainan Tu , Yihuai Xu , Zhimeng Zhang , Xin Ding , Yongwei Wang

To be successful in single source domain generalization, maximizing diversity of synthesized domains has emerged as one of the most effective strategies. Many of the recent successes have come from methods that pre-specify the types of…

Machine Learning · Computer Science 2022-12-14 Tejas Gokhale , Rushil Anirudh , Jayaraman J. Thiagarajan , Bhavya Kailkhura , Chitta Baral , Yezhou Yang

Adversarial training (AT) as a regularization method has proved its effectiveness on various tasks. Though there are successful applications of AT on some NLP tasks, the distinguishing characteristics of NLP tasks have not been exploited.…

Computation and Language · Computer Science 2021-11-29 Ziqing Yang , Yiming Cui , Chenglei Si , Wanxiang Che , Ting Liu , Shijin Wang , Guoping Hu

Adversarial training has been proven to be an effective technique for improving the adversarial robustness of models. However, there seems to be an inherent trade-off between optimizing the model for accuracy and robustness. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Elahe Arani , Fahad Sarfraz , Bahram Zonooz

Adversarial training (AT) is currently one of the most effective ways to obtain the robustness of deep neural networks against adversarial attacks. However, most AT methods suffer from robust overfitting, i.e., a significant generalization…

Machine Learning · Computer Science 2024-03-15 Daiwei Yu , Zhuorong Li , Lina Wei , Canghong Jin , Yun Zhang , Sixian Chan

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

Adversarial training (AT) is a robust learning algorithm that can defend against adversarial attacks in the inference phase and mitigate the side effects of corrupted data in the training phase. As such, it has become an indispensable…

Cryptography and Security · Computer Science 2023-05-02 Jingfeng Zhang , Bo Song , Bo Han , Lei Liu , Gang Niu , Masashi Sugiyama

Adversarial Training (AT) is a widely adopted defense against adversarial examples. However, existing approaches typically apply a uniform training objective across all classes, overlooking disparities in class-wise vulnerability. This…

Machine Learning · Computer Science 2025-07-11 Tejaswini Medi , Steffen Jung , Margret Keuper

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

Machine Learning · Computer Science 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

A key challenge in training generally-capable agents is the design of training tasks that facilitate broad generalization and robustness to environment variations. This challenge motivates the problem setting of Unsupervised Environment…

Machine Learning · Computer Science 2023-08-23 Ishita Mediratta , Minqi Jiang , Jack Parker-Holder , Michael Dennis , Eugene Vinitsky , Tim Rocktäschel

Generalization and robustness are both key desiderata for designing machine learning methods. Adversarial training can enhance robustness, but past work often finds it hurts generalization. In natural language processing (NLP), pre-training…

Computation and Language · Computer Science 2020-05-01 Xiaodong Liu , Hao Cheng , Pengcheng He , Weizhu Chen , Yu Wang , Hoifung Poon , Jianfeng Gao

The need for abundant labelled data in supervised Adversarial Training (AT) has prompted the use of Self-Supervised Learning (SSL) techniques with AT. However, the direct application of existing SSL methods to adversarial training has been…

Machine Learning · Computer Science 2024-06-11 Sravanti Addepalli , Priyam Dey , R. Venkatesh Babu