English
Related papers

Related papers: Understanding and Increasing Efficiency of Frank-W…

200 papers

In recent years, deep neural networks have demonstrated outstanding performance in many machine learning tasks. However, researchers have discovered that these state-of-the-art models are vulnerable to adversarial examples: legitimate…

Machine Learning · Computer Science 2018-10-10 Ting-Jui Chang , Yukun He , Peng Li

In response to the threat of adversarial examples, adversarial training provides an attractive option for enhancing the model robustness by training models on online-augmented adversarial examples. However, most of the existing adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jia-Li Yin , Lehui Xie , Wanqing Zhu , Ximeng Liu , Bo-Hao Chen

Classical adversarial training (AT) frameworks are designed to achieve high adversarial accuracy against a single attack type, typically $\ell_\infty$ norm-bounded perturbations. Recent extensions in AT have focused on defending against the…

Machine Learning · Computer Science 2021-06-15 Ameya D. Patil , Michael Tuttle , Alexander G. Schwing , Naresh R. Shanbhag

Adversarial training is promising for improving robustness of deep neural networks towards adversarial perturbations, especially on the classification task. The effect of this type of training on semantic segmentation, contrarily, just…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Xiaogang Xu , Hengshuang Zhao , Jiaya Jia

Deep neural networks (DNNs) are incredibly vulnerable to crafted, imperceptible adversarial perturbations. While adversarial training (AT) has proven to be an effective defense approach, the AT mechanism for robustness improvement is not…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Binxiao Huang , Rui Lin , Chaofan Tao , Ngai Wong

It is known that Deep Neural networks (DNNs) are vulnerable to adversarial attacks, and the adversarial robustness of DNNs could be improved by adding adversarial noises to training data (e.g., the standard adversarial training (SAT)).…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Linhai Ma , Liang Liang

To protect deep neural networks (DNNs) from adversarial attacks, adversarial training (AT) is developed by incorporating adversarial examples (AEs) into model training. Recent studies show that adversarial attacks disproportionately impact…

Machine Learning · Computer Science 2024-10-17 Fengpeng Li , Kemou Li , Haiwei Wu , Jinyu Tian , Jiantao Zhou

Deep neural networks (DNNs) are vulnerable to adversarial examples, in which DNNs are misled to false outputs due to inputs containing imperceptible perturbations. Adversarial training, a reliable and effective method of defense, may…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zongyuan Zhang , Qingwen Bu , Tianyang Duan , Zheng Lin , Yuhao Qing , Zihan Fang , Heming Cui , Dong Huang

Deep models, while being extremely flexible and accurate, are surprisingly vulnerable to "small, imperceptible" perturbations known as adversarial attacks. While the majority of existing attacks focus on measuring perturbations under the…

Machine Learning · Computer Science 2020-08-10 Kaiwen Wu , Allen Houze Wang , Yaoliang Yu

Adversarial training for LLMs is one of the most promising methods to reliably improve robustness against adversaries. However, despite significant progress, models remain vulnerable to simple in-distribution exploits, such as rewriting…

Machine Learning · Computer Science 2026-02-19 Chengzhi Hu , Jonas Dornbusch , David Lüdke , Stephan Günnemann , Leo Schwinn

Adversarial training is a popular method to give neural nets robustness against adversarial perturbations. In practice adversarial training leads to low robust training loss. However, a rigorous explanation for why this happens under…

Machine Learning · Computer Science 2020-02-25 Yi Zhang , Orestis Plevrakis , Simon S. Du , Xingguo Li , Zhao Song , Sanjeev Arora

Learning a deep neural network requires solving a challenging optimization problem: it is a high-dimensional, non-convex and non-smooth minimization problem with a large number of terms. The current practice in neural network optimization…

Machine Learning · Computer Science 2021-02-23 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

Adversarial training has shown promise in building robust models against adversarial examples. A major drawback of adversarial training is the computational overhead introduced by the generation of adversarial examples. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Xiaojun Jia , Jianshu Li , Jindong Gu , Yang Bai , Xiaochun Cao

Deep Convolution Neural Networks (CNNs) can easily be fooled by subtle, imperceptible changes to the input images. To address this vulnerability, adversarial training creates perturbation patterns and includes them in the training set to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Muzammal Naseer , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Fatih Porikli

The neural network (NN) becomes one of the most heated type of models in various signal processing applications. However, NNs are extremely vulnerable to adversarial examples (AEs). To defend AEs, adversarial training (AT) is believed to be…

Machine Learning · Computer Science 2023-08-31 Mingyuan Fan , Yang Liu , Cen Chen

Due to numerous breakthroughs in real-world applications brought by machine intelligence, deep neural networks (DNNs) are widely employed in critical applications. However, predictions of DNNs are easily manipulated with imperceptible…

Machine Learning · Computer Science 2022-05-04 Hongjun Wang , Yisen Wang

Deep neural network based speaker recognition systems can easily be deceived by an adversary using minuscule imperceptible perturbations to the input speech samples. These adversarial attacks pose serious security threats to the speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-02 Monisankha Pal , Arindam Jati , Raghuveer Peri , Chin-Cheng Hsu , Wael AbdAlmageed , Shrikanth Narayanan

We consider the problem of OOD generalization, where the goal is to train a model that performs well on test distributions that are different from the training distribution. Deep learning models are known to be fragile to such shifts and…

Machine Learning · Computer Science 2022-08-22 Anshul Nasery , Sravanti Addepalli , Praneeth Netrapalli , Prateek Jain

Adversarial training is widely used to improve the robustness of deep neural networks to adversarial attack. However, adversarial training is prone to overfitting, and the cause is far from clear. This work sheds light on the mechanisms…

Machine Learning · Computer Science 2022-12-12 Lin Li , Michael Spratling

Deep neural networks (DNNs) have achieved remarkable performance in many tasks, yet they often behave as opaque black boxes. Explanation-guided learning (EGL) methods steer DNNs using human-provided explanations or supervision on model…

Machine Learning · Computer Science 2026-03-03 Chao Chen , Yanhui Chen , Shanshan Lin , Dongsheng Hong , Shu Wu , Xiangwen Liao , Chuanyi Liu