English
Related papers

Related papers: Revisiting and Advancing Adversarial Training Thro…

200 papers

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

Machine Learning · Computer Science 2023-02-09 Boqi Li , Weiwei Liu

Adversarial training enhances the robustness of Machine Learning (ML) models against adversarial attacks. However, obtaining labeled training and adversarial training data in network/cybersecurity domains is challenging and costly.…

Machine Learning · Computer Science 2024-05-30 Mohamed elShehaby , Aditya Kotha , Ashraf Matrawy

Instances-reweighted adversarial training (IRAT) can significantly boost the robustness of trained models, where data being less/more vulnerable to the given attack are assigned smaller/larger weights during training. However, when tested…

Machine Learning · Computer Science 2021-07-01 Ruize Gao , Feng Liu , Kaiwen Zhou , Gang Niu , Bo Han , James Cheng

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

Machine Learning · Computer Science 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial Training (AT) is proposed to alleviate the adversarial vulnerability of machine learning models by extracting only robust features from the input, which, however, inevitably leads to severe accuracy reduction as it discards the…

Machine Learning · Statistics 2020-07-06 Yifei Wang , Dan Peng , Furui Liu , Zhenguo Li , Zhitang Chen , Jiansheng Yang

Deep Neural Network (DNN) are vulnerable to adversarial attacks. As a countermeasure, adversarial training aims to achieve robustness based on the min-max optimization problem and it has shown to be one of the most effective defense…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Yaxin Li , Xiaorui Liu , Han Xu , Wentao Wang , Jiliang Tang

This paper revisits the simple, long-studied, yet still unsolved problem of making image classifiers robust to imperceptible perturbations. Taking CIFAR10 as an example, SOTA clean accuracy is about $100$%, but SOTA robustness to…

Machine Learning · Computer Science 2024-07-11 Brian R. Bartoldson , James Diffenderfer , Konstantinos Parasyris , Bhavya Kailkhura

Recent studies demonstrate that deep networks, even robustified by the state-of-the-art adversarial training (AT), still suffer from large robust generalization gaps, in addition to the much more expensive training costs than standard…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Tianlong Chen , Zhenyu Zhang , Pengjun Wang , Santosh Balachandra , Haoyu Ma , Zehao Wang , Zhangyang Wang

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

Adversarial training (AT) with samples generated by Fast Gradient Sign Method (FGSM), also known as FGSM-AT, is a computationally simple method to train robust networks. However, during its training procedure, an unstable mode of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Zichao Li , Li Liu , Zeyu Wang , Yuyin Zhou , Cihang Xie

Medical imaging AI systems such as disease classification and segmentation are increasingly inspired and transformed from computer vision based AI systems. Although an array of adversarial training and/or loss function based defense…

Machine Learning · Computer Science 2020-06-25 Xin Li , Deng Pan , Dongxiao Zhu

Adversarial training is an approach of increasing the robustness of models to adversarial attacks by including adversarial examples in the training set. One major challenge of producing adversarial examples is to contain sufficient…

Machine Learning · Computer Science 2021-10-13 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

Adversarial training is one of the most effective defenses against adversarial attacks, but it incurs a high computational cost. In this study, we present the first theoretical analysis suggesting that adversarially pretrained transformers…

Machine Learning · Computer Science 2026-03-03 Soichiro Kumano , Hiroshi Kera , Toshihiko Yamasaki

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

Machine Learning · Statistics 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

Adversarial Training (AT) is one of the most effective methods to enhance the robustness of Deep Neural Networks (DNNs). However, existing AT methods suffer from an inherent accuracy-robustness trade-off. Previous works have studied this…

Machine Learning · Computer Science 2025-05-28 Yanyun Wang , Li Liu , Zi Liang , Yi R. , Fung , Qingqing Ye , Haibo Hu

Meta-learning model can quickly adapt to new tasks using few-shot labeled data. However, despite achieving good generalization on few-shot classification tasks, it is still challenging to improve the adversarial robustness of the…

Machine Learning · Computer Science 2021-07-02 Fan Liu , Shuyu Zhao , Xuelong Dai , Bin Xiao

Recent works have shown that self-supervised learning can achieve remarkable robustness when integrated with adversarial training (AT). However, the robustness gap between supervised AT (sup-AT) and self-supervised AT (self-AT) remains…

Machine Learning · Computer Science 2023-03-06 Rundong Luo , Yifei Wang , Yisen Wang

Adversarial examples have become one of the largest challenges that machine learning models, especially neural network classifiers, face. These adversarial examples break the assumption of attack-free scenario and fool state-of-the-art…

Machine Learning · Computer Science 2020-02-28 Guanxiong Liu , Issa Khalil , Abdallah Khreishah

The progress in the last decade has enabled machine learning models to achieve impressive performance across a wide range of tasks in Computer Vision. However, a plethora of works have demonstrated the susceptibility of these models to…

Machine Learning · Computer Science 2020-02-06 B. S. Vivek , R. Venkatesh Babu