English
Related papers

Related papers: Stable and Efficient Adversarial Training through …

200 papers

Adversarial Training (AT) has been demonstrated as one of the most effective methods against adversarial examples. While most existing works focus on AT with a single type of perturbation e.g., the $\ell_\infty$ attacks), DNNs are facing…

Machine Learning · Computer Science 2022-10-04 Jiancong Xiao , Zeyu Qin , Yanbo Fan , Baoyuan Wu , Jue Wang , Zhi-Quan Luo

Adversarial training is one of the most effective methods for enhancing model robustness. Recent approaches incorporate adversarial distillation in adversarial training architectures. However, we notice two scenarios of defense methods that…

Machine Learning · Computer Science 2024-08-26 Zhenyu Liu , Haoran Duan , Huizhi Liang , Yang Long , Vaclav Snasel , Guiseppe Nicosia , Rajiv Ranjan , Varun Ojha

By injecting adversarial examples into training data, adversarial training is promising for improving the robustness of deep learning models. However, most existing adversarial training approaches are based on a specific type of adversarial…

Machine Learning · Computer Science 2019-03-18 Chuanbiao Song , Kun He , Liwei Wang , John E. Hopcroft

Adversarial training (AT) is the de facto method for building robust neural networks, but it can be computationally expensive. To mitigate this, fast single-step attacks can be used, but this may lead to catastrophic overfitting (CO). This…

Federated learning (FL) is one of the most important paradigms addressing privacy and data governance issues in machine learning (ML). Adversarial training has emerged, so far, as the most promising approach against evasion threats on ML…

Machine Learning · Computer Science 2020-12-04 Giulio Zizzo , Ambrish Rawat , Mathieu Sinn , Beat Buesser

Adversarial Training (AT) has been shown to significantly enhance adversarial robustness via a min-max optimization approach. However, its effectiveness in video recognition tasks is hampered by two main challenges. First, fast adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Songping Wang , Hanqing Liu , Yueming Lyu , Xiantao Hu , Ziwen He , Wei Wang , Caifeng Shan , Liang Wang

Adversarial neural networks solve many important problems in data science, but are notoriously difficult to train. These difficulties come from the fact that optimal weights for adversarial nets correspond to saddle points, and not…

Machine Learning · Computer Science 2018-02-12 Abhay Yadav , Sohil Shah , Zheng Xu , David Jacobs , Tom Goldstein

Adversarial training is an effective method to boost model robustness to malicious, adversarial attacks. However, such improvement in model robustness often leads to a significant sacrifice of standard performance on clean images. In many…

Machine Learning · Computer Science 2022-04-29 Pengyue Hou , Ming Zhou , Jie Han , Petr Musilek , Xingyu Li

Despite their promising performance across various natural language processing (NLP) tasks, current NLP systems are vulnerable to textual adversarial attacks. To defend against these attacks, most existing methods apply adversarial training…

Computation and Language · Computer Science 2023-07-06 Junjie Wu , Dit-Yan Yeung

Adversarial training is widely used to improve the robustness of deep neural networks to adversarial attack. However, adversarial training is prone to overfitting, and the cause is far from clear. This work sheds light on the mechanisms…

Machine Learning · Computer Science 2022-12-12 Lin Li , Michael Spratling

Instances-reweighted adversarial training (IRAT) can significantly boost the robustness of trained models, where data being less/more vulnerable to the given attack are assigned smaller/larger weights during training. However, when tested…

Machine Learning · Computer Science 2021-07-01 Ruize Gao , Feng Liu , Kaiwen Zhou , Gang Niu , Bo Han , James Cheng

Classical adversarial training (AT) frameworks are designed to achieve high adversarial accuracy against a single attack type, typically $\ell_\infty$ norm-bounded perturbations. Recent extensions in AT have focused on defending against the…

Machine Learning · Computer Science 2021-06-15 Ameya D. Patil , Michael Tuttle , Alexander G. Schwing , Naresh R. Shanbhag

Recent studies have found that removing the norm-bounded projection and increasing search steps in adversarial training can significantly improve robustness. However, we observe that a too large number of search steps can hurt accuracy. We…

Computation and Language · Computer Science 2022-04-29 Bin Zhu , Zhaoquan Gu , Le Wang , Jinyin Chen , Qi Xuan

Adversarial Training (AT) is known as an effective approach to enhance the robustness of deep neural networks. Recently researchers notice that robust models with AT have good generative ability and can synthesize realistic images, while…

Machine Learning · Computer Science 2022-03-28 Yifei Wang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

Deep neural networks are widely used in various fields because of their powerful performance. However, recent studies have shown that deep learning models are vulnerable to adversarial attacks, i.e., adding a slight perturbation to the…

Machine Learning · Computer Science 2022-05-17 Youhuan Yang , Lei Sun , Leyu Dai , Song Guo , Xiuqing Mao , Xiaoqin Wang , Bayi Xu

In this paper, we use reinforcement learning for safety driving in adversary settings. In our work, the knowledge in state-of-art planning methods is reused by single-step options whose action suggestions are compared in parallel with…

Artificial Intelligence · Computer Science 2019-12-02 Nazmus Sakib , Hengshuai Yao , Hong Zhang , Shangling Jui

In this paper, we introduce a novel neural network training framework that increases model's adversarial robustness to adversarial attacks while maintaining high clean accuracy by combining contrastive learning (CL) with adversarial…

Machine Learning · Computer Science 2022-09-13 Adir Rahamim , Itay Naeh

Enhancing model robustness under new and even adversarial environments is a crucial milestone toward building trustworthy machine learning systems. Current robust training methods such as adversarial training explicitly uses an "attack"…

Machine Learning · Computer Science 2020-12-23 Minhao Cheng , Pin-Yu Chen , Sijia Liu , Shiyu Chang , Cho-Jui Hsieh , Payel Das

Adversarial training (AT) is considered to be one of the most reliable defenses against adversarial attacks. However, models trained with AT sacrifice standard accuracy and do not generalize well to novel attacks. Recent works show…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Chun Pong Lau , Jiang Liu , Hossein Souri , Wei-An Lin , Soheil Feizi , Rama Chellappa

Adversarial training, originally designed to resist test-time adversarial examples, has shown to be promising in mitigating training-time availability attacks. This defense ability, however, is challenged in this paper. We identify a novel…

Machine Learning · Computer Science 2022-10-11 Lue Tao , Lei Feng , Hongxin Wei , Jinfeng Yi , Sheng-Jun Huang , Songcan Chen