English
Related papers

Related papers: MixUp as Directional Adversarial Training

200 papers

Adversarial training can improve the robustness of neural networks. Previous methods focus on a single adversarial training strategy and do not consider the model property trained by different strategies. By revisiting the previous methods,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xingbin Liu , Huafeng Kuang , Xianming Lin , Yongjian Wu , Rongrong Ji

Despite their overwhelming success on a wide range of applications, convolutional neural networks (CNNs) are widely recognized to be vulnerable to adversarial examples. This intriguing phenomenon led to a competition between adversarial…

Machine Learning · Computer Science 2021-04-08 Philipp Benz , Chaoning Zhang , Adil Karjauv , In So Kweon

Adversarial training is an effective but time-consuming way to train robust deep neural networks that can withstand strong adversarial attacks. As a response to its inefficiency, we propose Dynamic Efficient Adversarial Training (DEAT),…

Machine Learning · Computer Science 2023-03-15 Fu Wang , Yanghao Zhang , Yanbin Zheng , Wenjie Ruan

Recently demonstrated physical-world adversarial attacks have exposed vulnerabilities in perception systems that pose severe risks for safety-critical applications such as autonomous driving. These attacks place adversarial artifacts in the…

Machine Learning · Computer Science 2021-06-23 Jan Hendrik Metzen , Nicole Finnie , Robin Hutmacher

Machine unlearning is a critical area of research aimed at safeguarding data privacy by enabling the removal of sensitive information from machine learning models. One unique challenge in this field is catastrophic unlearning, where erasing…

Machine Learning · Computer Science 2025-02-17 Zhuoyi Peng , Yixuan Tang , Yi Yang

Adversarial training (AT) is among the most effective techniques to improve model robustness by augmenting training data with adversarial examples. However, most existing AT methods adopt a specific attack to craft adversarial examples,…

Machine Learning · Computer Science 2020-11-20 Yinpeng Dong , Zhijie Deng , Tianyu Pang , Hang Su , Jun Zhu

Adversarial training (AT) is a prominent technique employed by deep learning models to defend against adversarial attacks, and to some extent, enhance model robustness. However, there are three main drawbacks of the existing AT-based…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 X. Peng , D. Zhou , G. Sun , J. Shi , L. Wu

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

Machine Learning · Computer Science 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

Adversarial training is one of the most effective methods for enhancing model robustness. Recent approaches incorporate adversarial distillation in adversarial training architectures. However, we notice two scenarios of defense methods that…

Machine Learning · Computer Science 2024-08-26 Zhenyu Liu , Haoran Duan , Huizhi Liang , Yang Long , Vaclav Snasel , Guiseppe Nicosia , Rajiv Ranjan , Varun Ojha

Deep neural networks are susceptible to adversarially crafted, small and imperceptible changes in the natural inputs. The most effective defense mechanism against these examples is adversarial training which constructs adversarial examples…

Machine Learning · Computer Science 2021-11-10 Muhammad Awais , Fengwei Zhou , Chuanlong Xie , Jiawei Li , Sung-Ho Bae , Zhenguo Li

Despite the empirical success in various domains, it has been revealed that deep neural networks are vulnerable to maliciously perturbed input data that much degrade their performance. This is known as adversarial attacks. To counter…

Machine Learning · Computer Science 2021-08-17 Nanyang Ye , Qianxiao Li , Xiao-Yun Zhou , Zhanxing Zhu

It is well-known that deep neural networks (DNNs) are susceptible to adversarial attacks, exposing a severe fragility of deep learning systems. As the result, adversarial training (AT) method, by incorporating adversarial examples during…

Machine Learning · Computer Science 2022-03-01 Tuan Anh Bui , Trung Le , Quan Tran , He Zhao , Dinh Phung

We answer the question in the title, showing that adversarial training (AT) for diffusion models (DMs) fundamentally differs from classifiers: while AT in classifiers enforces output invariance, AT in DMs requires equivariance to keep the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Briglia Maria Rosaria , Mujtaba Hussain Mirza , Giuseppe Lisanti , Iacopo Masi

Multimodal recommender systems exploit visual and textual signals to alleviate data sparsity, but this also makes them more vulnerable to evasion-based promotion attacks. Existing defenses are largely limited to single-modal settings and…

Machine Learning · Computer Science 2026-05-08 Guanmeng Xian , Ning Yang , Philip S. Yu

Deep neural networks (DNNs) are known to be vulnerable to adversarial examples/attacks, raising concerns about their reliability in safety-critical applications. A number of defense methods have been proposed to train robust DNNs resistant…

Machine Learning · Computer Science 2021-04-23 Yujing Jiang , Xingjun Ma , Sarah Monazam Erfani , James Bailey

Adversarial Training (AT) and Virtual Adversarial Training (VAT) are the regularization techniques that train Deep Neural Networks (DNNs) with adversarial examples generated by adding small but worst-case perturbations to input examples. In…

Machine Learning · Computer Science 2020-06-24 Xiulong Yang , Shihao Ji

Recent studies have shown that robustness to adversarial attacks can be transferred across networks. In other words, we can make a weak model more robust with the help of a strong teacher model. We ask if instead of learning from a static…

Machine Learning · Computer Science 2023-02-13 Jiang Liu , Chun Pong Lau , Hossein Souri , Soheil Feizi , Rama Chellappa

Large deep neural networks are powerful, but exhibit undesirable behaviors such as memorization and sensitivity to adversarial examples. In this work, we propose mixup, a simple learning principle to alleviate these issues. In essence,…

Machine Learning · Computer Science 2018-05-01 Hongyi Zhang , Moustapha Cisse , Yann N. Dauphin , David Lopez-Paz

Adversarial training is an effective learning technique to improve the robustness of deep neural networks. In this study, the influence of adversarial training on deep learning models in terms of fairness, robustness, and generalization is…

Machine Learning · Computer Science 2023-05-19 Xiaoling Zhou , Nan Yang , Ou Wu

We consider the problem of OOD generalization, where the goal is to train a model that performs well on test distributions that are different from the training distribution. Deep learning models are known to be fragile to such shifts and…

Machine Learning · Computer Science 2022-08-22 Anshul Nasery , Sravanti Addepalli , Praneeth Netrapalli , Prateek Jain