English
Related papers

Related papers: Improving Fast Adversarial Training with Prior-Gui…

200 papers

Adversarial training is the most effective method to obtain adversarial robustness for deep neural networks by directly involving adversarial samples in the training procedure. To obtain an accurate and robust model, the weighted-average…

Machine Learning · Computer Science 2024-10-23 Zhiyu Xue , Haohan Wang , Yao Qin , Ramtin Pedarsani

Deep neural networks are vulnerable to adversarial examples. Adversarial training (AT) is an effective defense against adversarial examples. However, AT is prone to overfitting which degrades robustness substantially. Recently, data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Lin Li , Jianing Qiu , Michael Spratling

Recent studies have found that removing the norm-bounded projection and increasing search steps in adversarial training can significantly improve robustness. However, we observe that a too large number of search steps can hurt accuracy. We…

Computation and Language · Computer Science 2022-04-29 Bin Zhu , Zhaoquan Gu , Le Wang , Jinyin Chen , Qi Xuan

In this technical report, we evaluate the adversarial robustness of a very recent method called "Geometry-aware Instance-reweighted Adversarial Training"[7]. GAIRAT reports state-of-the-art results on defenses to adversarial attacks on the…

Machine Learning · Computer Science 2021-03-08 Dorjan Hitaj , Giulio Pagnotta , Iacopo Masi , Luigi V. Mancini

Adversarial Training (AT) is one of the most effective methods to train robust Deep Neural Networks (DNNs). However, AT creates an inherent trade-off between clean accuracy and adversarial robustness, which is commonly attributed to the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yanyun Wang , Li Liu

Despite the remarkable success of Vision Transformers (ViTs) across a wide range of vision tasks, recent studies have revealed that they remain vulnerable to adversarial examples, much like Convolutional Neural Networks (CNNs). A common…

Machine Learning · Computer Science 2026-04-22 Jiaming Zhang , Meng Ding , Shaopeng Fu , Jingfeng Zhang , Di Wang

In semi-supervised learning, virtual adversarial training (VAT) approach is one of the most attractive method due to its intuitional simplicity and powerful performances. VAT finds a classifier which is robust to data perturbation toward…

Machine Learning · Statistics 2019-09-17 Dongha Kim , Yongchan Choi , Yongdai Kim

We consider the problem of OOD generalization, where the goal is to train a model that performs well on test distributions that are different from the training distribution. Deep learning models are known to be fragile to such shifts and…

Machine Learning · Computer Science 2022-08-22 Anshul Nasery , Sravanti Addepalli , Praneeth Netrapalli , Prateek Jain

Fast Adversarial Training (FastAT) seeks to achieve adversarial robustness at a fraction of the computational cost incurred by standard multi-step methods such as PGD-AT. Although numerous FastAT techniques have been proposed in recent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Chao Pan , Xin Yao

Overfitting negatively impacts the generalization ability of deep neural networks (DNNs) in both natural and adversarial training. Existing methods struggle to consistently address different types of overfitting, typically designing…

Machine Learning · Computer Science 2024-09-17 Runqi Lin , Chaojian Yu , Bo Han , Tongliang Liu

Owing to security implications of adversarial vulnerability, adversarial robustness of deep metric learning models has to be improved. In order to avoid model collapse due to excessively hard examples, the existing defenses dismiss the…

Machine Learning · Computer Science 2022-03-04 Mo Zhou , Vishal M. Patel

Adversarial attacks on deep-learning models pose a serious threat to their reliability and security. Existing defense mechanisms are narrow addressing a specific type of attack or being vulnerable to sophisticated attacks. We propose a new…

Machine Learning · Computer Science 2023-06-22 Mouna Rabhi , Roberto Di Pietro

In the future, powerful AI systems may be deployed in high-stakes settings, where a single failure could be catastrophic. One technique for improving AI safety in high-stakes settings is adversarial training, which uses an adversary to…

Transfer-based attack adopts the adversarial examples generated on the surrogate model to attack various models, making it applicable in the physical world and attracting increasing interest. Recently, various adversarial attacks have…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Zhijin Ge , Hongying Liu , Xiaosen Wang , Fanhua Shang , Yuanyuan Liu

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

Machine Learning · Computer Science 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna

Recent improvements in deep learning models and their practical applications have raised concerns about the robustness of these models against adversarial examples. Adversarial training (AT) has been shown effective to reach a robust model…

Machine Learning · Computer Science 2021-03-30 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Efforts to address declining accuracy as a result of data shifts often involve various data-augmentation strategies. Adversarial training is one such method, designed to improve robustness to worst-case distribution shifts caused by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Fatemeh Amerehi , Patrick Healy

Previous adversarial training raises model robustness under the compromise of accuracy on natural data. In this paper, we reduce natural accuracy degradation. We use the model logits from one clean model to guide learning of another one…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Jiequan Cui , Shu Liu , Liwei Wang , Jiaya Jia

Although current deep learning techniques have yielded superior performance on various computer vision tasks, yet they are still vulnerable to adversarial examples. Adversarial training and its variants have been shown to be the most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Junhao Dong , Seyed-Mohsen Moosavi-Dezfooli , Jianhuang Lai , Xiaohua Xie

Model robustness against adversarial examples of single perturbation type such as the $\ell_{p}$-norm has been widely studied, yet its generalization to more realistic scenarios involving multiple semantic perturbations and their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Lei Hsiung , Yun-Yun Tsai , Pin-Yu Chen , Tsung-Yi Ho