English
Related papers

Related papers: Improving Clean Accuracy via a Tangent-Space Persp…

200 papers

Adversarial training is an effective but time-consuming way to train robust deep neural networks that can withstand strong adversarial attacks. As a response to its inefficiency, we propose Dynamic Efficient Adversarial Training (DEAT),…

Machine Learning · Computer Science 2023-03-15 Fu Wang , Yanghao Zhang , Yanbin Zheng , Wenjie Ruan

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

Machine Learning · Computer Science 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

Recent studies have found that removing the norm-bounded projection and increasing search steps in adversarial training can significantly improve robustness. However, we observe that a too large number of search steps can hurt accuracy. We…

Computation and Language · Computer Science 2022-04-29 Bin Zhu , Zhaoquan Gu , Le Wang , Jinyin Chen , Qi Xuan

Adversarial training, as one of the most effective defense methods against adversarial attacks, tends to learn an inclusive decision boundary to increase the robustness of deep learning models. However, due to the large and unnecessary…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Xiaoyu Liang , Yaguan Qian , Jianchang Huang , Xiang Ling , Bin Wang , Chunming Wu , Wassim Swaileh

Adversarial training is exploited to develop a robust Deep Neural Network (DNN) model against the malicious altered data. These attacks may have catastrophic effects on DNN models but are indistinguishable for a human being. For example, an…

Machine Learning · Computer Science 2022-10-14 Farzad Nikfam , Alberto Marchisio , Maurizio Martina , Muhammad Shafique

Adversarial training (AT) methods are effective against adversarial attacks, yet they introduce severe disparity of accuracy and robustness between different classes, known as the robust fairness problem. Previously proposed Fair Robust…

Machine Learning · Computer Science 2022-09-19 Chunyu Sun , Chenye Xu , Chengyuan Yao , Siyuan Liang , Yichao Wu , Ding Liang , XiangLong Liu , Aishan Liu

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

Machine Learning · Computer Science 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

Deep neural networks are vulnerable to adversarial examples. Adversarial training (AT) is an effective defense against adversarial examples. However, AT is prone to overfitting which degrades robustness substantially. Recently, data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Lin Li , Jianing Qiu , Michael Spratling

Deep neural networks can be easily fooled into making incorrect predictions through corruption of the input by adversarial perturbations: human-imperceptible artificial noise. So far adversarial training has been the most successful defense…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Lin Li , Michael Spratling

Current deep neural networks (DNNs) are vulnerable to adversarial attacks, where adversarial perturbations to the inputs can change or manipulate classification. To defend against such attacks, an effective and popular approach, known as…

Machine Learning · Computer Science 2022-09-08 Gaoyuan Zhang , Songtao Lu , Yihua Zhang , Xiangyi Chen , Pin-Yu Chen , Quanfu Fan , Lee Martie , Lior Horesh , Mingyi Hong , Sijia Liu

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

Despite their performance, Artificial Neural Networks are not reliable enough for most of industrial applications. They are sensitive to noises, rotations, blurs and adversarial examples. There is a need to build defenses that protect…

Machine Learning · Computer Science 2020-08-20 Alfred Laugros , Alice Caplier , Matthieu Ospici

Adversarial training (AT) is proved to reliably improve network's robustness against adversarial data. However, current AT with a pre-specified perturbation budget has limitations in learning a robust network. Firstly, applying a…

Machine Learning · Computer Science 2022-10-05 Chaojian Yu , Dawei Zhou , Li Shen , Jun Yu , Bo Han , Mingming Gong , Nannan Wang , Tongliang Liu

Machine learning has achieved great success in electroencephalogram (EEG) based brain-computer interfaces (BCIs). Most existing BCI studies focused on improving the decoding accuracy, with only a few considering the adversarial security.…

Human-Computer Interaction · Computer Science 2024-11-05 Xiaoqing Chen , Ziwei Wang , Dongrui Wu

Adversarial Training (AT), which adversarially perturb the input samples during training, has been acknowledged as one of the most effective defenses against adversarial attacks, yet suffers from inevitably decreased clean accuracy. Instead…

Machine Learning · Computer Science 2024-06-06 Yihao Zhang , Hangzhou He , Jingyu Zhu , Huanran Chen , Yifei Wang , Zeming Wei

Compared with standard supervised learning, the key difficulty in semi-supervised learning is how to make full use of the unlabeled data. A recently proposed method, virtual adversarial training (VAT), smartly performs adversarial training…

Machine Learning · Computer Science 2019-03-04 Bing Yu , Jingfeng Wu , Jinwen Ma , Zhanxing Zhu

Adversarial training enhances neural network robustness but suffers from a tendency to overfit and increased generalization errors on clean data. This work introduces CLAT, an innovative approach that mitigates adversarial overfitting by…

Machine Learning · Computer Science 2024-12-25 Bhavna Gopal , Huanrui Yang , Jingyang Zhang , Mark Horton , Yiran Chen

Adversarial Training (AT) is one of the most effective methods to enhance the robustness of Deep Neural Networks (DNNs). However, existing AT methods suffer from an inherent accuracy-robustness trade-off. Previous works have studied this…

Machine Learning · Computer Science 2025-05-28 Yanyun Wang , Li Liu , Zi Liang , Yi R. , Fung , Qingqing Ye , Haibo Hu

In response to the threat of adversarial examples, adversarial training provides an attractive option for enhancing the model robustness by training models on online-augmented adversarial examples. However, most of the existing adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jia-Li Yin , Lehui Xie , Wanqing Zhu , Ximeng Liu , Bo-Hao Chen

In this paper, we study fast training of adversarially robust models. From the analyses of the state-of-the-art defense method, i.e., the multi-step adversarial training, we hypothesize that the gradient magnitude links to the model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jianyu Wang , Haichao Zhang