English
Related papers

Related papers: Smooth Adversarial Training

200 papers

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches to training robust models against…

Machine Learning · Computer Science 2023-08-09 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such…

Machine Learning · Computer Science 2020-08-11 Jiachen Zhong , Xuanqing Liu , Cho-Jui Hsieh

Neural networks have led to major improvements in image classification but suffer from being non-robust to adversarial changes, unreliable uncertainty estimates on out-distribution samples and their inscrutable black-box decisions. In this…

Machine Learning · Computer Science 2020-07-30 Maximilian Augustin , Alexander Meinke , Matthias Hein

Adversarial training serves as one of the most popular and effective methods to defend against adversarial perturbations. However, most defense mechanisms only consider a single type of perturbation while various attack methods might be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Huihui Gong , Minjing Dong , Siqi Ma , Seyit Camtepe , Surya Nepal , Chang Xu

Adversarial training often suffers from a robustness-accuracy trade-off, where achieving high robustness comes at the cost of accuracy. One approach to mitigate this trade-off is leveraging invariance regularization, which encourages model…

Machine Learning · Computer Science 2025-08-29 Futa Waseda , Ching-Chun Chang , Isao Echizen

Supervised learning models are challenged by the intrinsic complexities of training data such as outliers and minority subpopulations and intentional attacks at inference time with adversarial samples. While traditional robust learning…

Machine Learning · Computer Science 2023-09-12 Shu Hu , Zhenhuan Yang , Xin Wang , Yiming Ying , Siwei Lyu

Adversarial attacks pose significant challenges for vision models in critical fields like healthcare, where reliability is essential. Although adversarial training has been well studied in natural images, its application to biomedical and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Hashmat Shadab Malik , Shahina Kunhimon , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

The choice of activation function in deep networks has a significant effect on the training dynamics and task performance. At present, the most effective and widely-used activation function is ReLU. However, because of the non-zero mean,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yuan Zhou , Dandan Li , Shuwei Huo , Sun-Yuan Kung

Despite their impressive capabilities, Multimodal Large Language Models (MLLMs) exhibit perceptual fragility when confronted with visually complex scenes. This weakness stems from a reliance on finite training datasets, which are…

Machine Learning · Computer Science 2026-03-05 Yicheng Bao , Xuhong Wang , Qiaosheng Zhang , Chaochao Lu , Xia Hu , Xin Tan

Adversarial Training (AT) is a cornerstone defense, but many variants overlook foundational feature representations by primarily focusing on stronger attack generation. We introduce Adversarial Evolution Training (AET), a simple yet…

Machine Learning · Computer Science 2025-10-14 Wang Yu-Hang , Liu ying , Fang liang , Wang Xuelin , Junkang Guo , Shiwei Li , Lei Gao , Jian Liu , Wenfei Yin

We explore the concept of co-design in the context of neural network verification. Specifically, we aim to train deep neural networks that not only are robust to adversarial perturbations but also whose robustness can be verified more…

Machine Learning · Computer Science 2019-04-25 Kai Y. Xiao , Vincent Tjeng , Nur Muhammad Shafiullah , Aleksander Madry

Adversarial training (AT) is a prominent technique employed by deep learning models to defend against adversarial attacks, and to some extent, enhance model robustness. However, there are three main drawbacks of the existing AT-based…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 X. Peng , D. Zhou , G. Sun , J. Shi , L. Wu

Adversarial training of Deep Neural Networks is known to be significantly more data-hungry when compared to standard training. Furthermore, complex data augmentations such as AutoAugment, which have led to substantial gains in standard…

Machine Learning · Computer Science 2022-10-28 Sravanti Addepalli , Samyak Jain , R. Venkatesh Babu

Adversarial training is a popular defense strategy against attack threat models with bounded Lp norms. However, it often degrades the model performance on normal images and the defense does not generalize well to novel attacks. Given the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Wei-An Lin , Chun Pong Lau , Alexander Levine , Rama Chellappa , Soheil Feizi

Recent improvements in deep learning models and their practical applications have raised concerns about the robustness of these models against adversarial examples. Adversarial training (AT) has been shown effective to reach a robust model…

Machine Learning · Computer Science 2021-03-30 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL). However, most current RL-based approaches fail to generalize since: (a) the gap between…

Machine Learning · Computer Science 2017-03-09 Lerrel Pinto , James Davidson , Rahul Sukthankar , Abhinav Gupta

Adversarial training is extensively utilized to improve the adversarial robustness of deep neural networks. Yet, mitigating the degradation of standard generalization performance in adversarial-trained models remains an open problem. This…

Machine Learning · Computer Science 2024-03-27 Xiangyu Yin , Wenjie Ruan

Adversarial robustness has been studied extensively in image classification, especially for the $\ell_\infty$-threat model, but significantly less so for related tasks such as object detection and semantic segmentation, where attacks turn…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Francesco Croce , Naman D Singh , Matthias Hein

In recent years, there has been an explosion of research into developing more robust deep neural networks against adversarial examples. Adversarial training appears as one of the most successful methods. To deal with both the robustness…

Machine Learning · Computer Science 2023-03-21 Gaojie Jin , Xinping Yi , Dengyu Wu , Ronghui Mu , Xiaowei Huang

Though deep neural networks exhibit superior performance on various tasks, they are still plagued by adversarial examples. Adversarial training has been demonstrated to be the most effective method to defend against adversarial attacks.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xin Liu , Yichen Yang , Kun He , John E. Hopcroft