English
Related papers

Related papers: Generalization Properties of Adversarial Training …

200 papers

Despite being widely adopted as a canonical framework for learning robust models, adversarial training suffers from robust overfitting. Existing empirical measures and theoretical explorations are insufficient to provide satisfying…

Machine Learning · Computer Science 2026-03-10 Yuelin Xu , Xiao Zhang

The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted great attention in the machine learning community. The problem is related to non-flatness and non-smoothness of normally obtained loss landscapes.…

Machine Learning · Computer Science 2023-02-13 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Despite the recent advances of graph neural networks (GNNs) in modeling graph data, the training of GNNs on large datasets is notoriously hard due to the overfitting. Adversarial training, which augments data with the worst-case adversarial…

Machine Learning · Computer Science 2021-10-29 Haotian Xue , Kaixiong Zhou , Tianlong Chen , Kai Guo , Xia Hu , Yi Chang , Xin Wang

Several existing works study either adversarial or natural distributional robustness of deep neural networks separately. In practice, however, models need to enjoy both types of robustness to ensure reliability. In this work, we bridge this…

Machine Learning · Computer Science 2022-09-19 Mazda Moayeri , Kiarash Banihashem , Soheil Feizi

Algorithmic stability is an established tool for analyzing generalization. While adversarial training enhances model robustness, it often suffers from robust overfitting and an enlarged generalization gap. Although recent work has…

Machine Learning · Computer Science 2025-09-24 Hesam Hosseini , Ying Cao , Ali H. Sayed

Current neural-network-based classifiers are susceptible to adversarial examples. The most empirically successful approach to defending against such adversarial examples is adversarial training, which incorporates a strong self-attack…

Machine Learning · Computer Science 2020-06-08 Bai Li , Shiqi Wang , Suman Jana , Lawrence Carin

Neural networks have a number of shortcomings. Amongst the severest ones is the sensitivity to distribution shifts which allows models to be easily fooled into wrong predictions by small perturbations to inputs that are often imperceivable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Paul Gavrikov , Janis Keuper , Margret Keuper

Owing to the susceptibility of deep learning systems to adversarial attacks, there has been a great deal of work in developing (both empirically and certifiably) robust classifiers. While most work has defended against a single type of…

Machine Learning · Computer Science 2020-07-30 Pratyush Maini , Eric Wong , J. Zico Kolter

It is common practice in deep learning to use overparameterized networks and train for as long as possible; there are numerous studies that show, both theoretically and empirically, that such practices surprisingly do not unduly harm the…

Machine Learning · Computer Science 2020-03-05 Leslie Rice , Eric Wong , J. Zico Kolter

Black-box adversarial attacks designing adversarial examples for unseen neural networks (NNs) have received great attention over the past years. While several successful black-box attack schemes have been proposed in the literature, the…

Machine Learning · Computer Science 2022-06-22 Yilin Wang , Farzan Farnia

Adversarial training (AT) refers to integrating adversarial examples -- inputs altered with imperceptible perturbations that can significantly impact model predictions -- into the training process. Recent studies have demonstrated the…

Machine Learning · Computer Science 2024-10-22 Mengnan Zhao , Lihe Zhang , Jingwen Ye , Huchuan Lu , Baocai Yin , Xinchao Wang

Machine learning models are vulnerable to adversarial perturbations, that when added to an input, can cause high confidence misclassifications. The adversarial learning research community has made remarkable progress in the understanding of…

Machine Learning · Computer Science 2020-06-09 Jamie Hayes

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

Machine Learning · Computer Science 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

Powerful deep neural networks are vulnerable to adversarial attacks. To obtain adversarially robust models, researchers have separately developed adversarial training and Jacobian regularization techniques. There are abundant theoretical…

Machine Learning · Statistics 2024-12-18 Dongya Wu , Xin Li

Adversarial examples reveal the blind spots of deep neural networks (DNNs) and represent a major concern for security-critical applications. The transferability of adversarial examples makes real-world attacks possible in black-box…

Computer Vision and Pattern Recognition · Computer Science 2019-10-16 Muzammal Naseer , Salman H. Khan , Harris Khan , Fahad Shahbaz Khan , Fatih Porikli

We propose a general approach to evaluating the performance of robust estimators based on adversarial losses under misspecified models. We first show that adversarial risk is equivalent to the risk induced by a distributional adversarial…

Machine Learning · Statistics 2023-09-06 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

Adversarial examples can cause catastrophic mistakes in Deep Neural Network (DNNs) based vision systems e.g., for classification, segmentation and object detection. The vulnerability of DNNs against such attacks can prove a major roadblock…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Muzammal Naseer , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Fatih Porikli

Adversarial Training has proved to be an effective training paradigm to enforce robustness against adversarial examples in modern neural network architectures. Despite many efforts, explanations of the foundational principles underpinning…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Mattia Carletti , Matteo Terzi , Gian Antonio Susto

Neural network classifiers are vulnerable to misclassification of adversarial samples, for which the current best defense trains classifiers with adversarial samples. However, adversarial samples are not optimal for steering attack…

Machine Learning · Computer Science 2021-02-10 Blerta Lindqvist

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus