English
Related papers

Related papers: THAT: Two Head Adversarial Training for Improving …

200 papers

Adversarial Training (AT) is proposed to alleviate the adversarial vulnerability of machine learning models by extracting only robust features from the input, which, however, inevitably leads to severe accuracy reduction as it discards the…

Machine Learning · Statistics 2020-07-06 Yifei Wang , Dan Peng , Furui Liu , Zhenguo Li , Zhitang Chen , Jiansheng Yang

Raw deep neural network (DNN) performance is not enough; in real-world settings, computational load, training efficiency and adversarial security are just as or even more important. We propose to simultaneously tackle Performance,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Madan Ravi Ganesh , Salimeh Yasaei Sekeh , Jason J. Corso

Meta-learning model can quickly adapt to new tasks using few-shot labeled data. However, despite achieving good generalization on few-shot classification tasks, it is still challenging to improve the adversarial robustness of the…

Machine Learning · Computer Science 2021-07-02 Fan Liu , Shuyu Zhao , Xuelong Dai , Bin Xiao

Adversarial robustness is a critical challenge in deploying deep neural networks for real-world applications. While adversarial training is a widely recognized defense strategy, most existing studies focus on balanced datasets, overlooking…

Machine Learning · Computer Science 2025-03-24 Wang YuHang , Junkang Guo , Aolei Liu , Kaihao Wang , Zaitong Wu , Zhenyu Liu , Wenfei Yin , Jian Liu

Previous work on adversarially robust neural networks for image classification requires large training sets and computationally expensive training procedures. On the other hand, few-shot learning methods are highly vulnerable to adversarial…

Machine Learning · Computer Science 2020-10-16 Micah Goldblum , Liam Fowl , Tom Goldstein

Adversarial training is a widely-applied approach to training deep neural networks to be robust against adversarial perturbation. However, although adversarial training has achieved empirical success in practice, it still remains unclear…

Machine Learning · Computer Science 2025-02-10 Binghui Li , Yuanzhi Li

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Adversarial training (AT) is proved to reliably improve network's robustness against adversarial data. However, current AT with a pre-specified perturbation budget has limitations in learning a robust network. Firstly, applying a…

Machine Learning · Computer Science 2022-10-05 Chaojian Yu , Dawei Zhou , Li Shen , Jun Yu , Bo Han , Mingming Gong , Nannan Wang , Tongliang Liu

Adversarial training has proven effective in improving the robustness of deep neural networks against adversarial attacks. However, this enhanced robustness often comes at the cost of a substantial drop in accuracy on clean data. In this…

Machine Learning · Computer Science 2026-04-17 Bongsoo Yi , Rongjie Lai , Yao Li

Recent analysis of deep neural networks has revealed their vulnerability to carefully structured adversarial examples. Many effective algorithms exist to craft these adversarial examples, but performant defenses seem to be far away. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Neale Ratzlaff , Li Fuxin

Adversarial training (AT) has been considered one of the most effective methods for making deep neural networks robust against adversarial attacks, while the training mechanisms and dynamics of AT remain open research problems. In this…

Machine Learning · Computer Science 2025-06-06 Zeming Wei , Yiwen Guo , Yisen Wang

While convolutional neural networks (CNNs) have achieved excellent performances in various computer vision tasks, they often misclassify with malicious samples, a.k.a. adversarial examples. Adversarial training is a popular and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Hiroki Adachi , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi , Yasunori Ishii , Kazuki Kozuka

Adversarial training has been empirically proven to be one of the most effective and reliable defense methods against adversarial attacks. However, almost all existing studies about adversarial training are focused on balanced datasets,…

Machine Learning · Computer Science 2021-07-30 Wentao Wang , Han Xu , Xiaorui Liu , Yaxin Li , Bhavani Thuraisingham , Jiliang Tang

Deep Convolution Neural Networks (CNNs) can easily be fooled by subtle, imperceptible changes to the input images. To address this vulnerability, adversarial training creates perturbation patterns and includes them in the training set to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Muzammal Naseer , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Fatih Porikli

Adversarial training for neural networks has been in the limelight in recent years. The advancement in neural network architectures over the last decade has led to significant improvement in their performance. It sparked an interest in…

Machine Learning · Computer Science 2022-06-07 Abhijith Sharma , Apurva Narayan

While leveraging additional training data is well established to improve adversarial robustness, it incurs the unavoidable cost of data collection and the heavy computation to train models. To mitigate the costs, we propose Guided…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Salah Ghamizi , Jingfeng Zhang , Maxime Cordy , Mike Papadakis , Masashi Sugiyama , Yves Le Traon

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

Machine Learning · Computer Science 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial training and its many variants substantially improve deep network robustness, yet at the cost of compromising standard accuracy. Moreover, the training process is heavy and hence it becomes impractical to thoroughly explore the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Haotao Wang , Tianlong Chen , Shupeng Gui , Ting-Kuei Hu , Ji Liu , Zhangyang Wang

Despite the success on few-shot learning problems, most meta-learned models only focus on achieving good performance on clean examples and thus easily break down when given adversarially perturbed samples. While some recent works have shown…

Machine Learning · Computer Science 2023-10-27 Minseon Kim , Hyeonjeong Ha , Dong Bok Lee , Sung Ju Hwang

There has been great interest in enhancing the robustness of neural network classifiers to defend against adversarial perturbations through adversarial training, while balancing the trade-off between robust accuracy and standard accuracy.…

Machine Learning · Computer Science 2022-10-24 Chester Holtz , Tsui-Wei Weng , Gal Mishne