中文
相关论文

相关论文: Generalization Properties of Adversarial Training …

200 篇论文

Despite being widely adopted as a canonical framework for learning robust models, adversarial training suffers from robust overfitting. Existing empirical measures and theoretical explorations are insufficient to provide satisfying…

机器学习 · 计算机科学 2026-03-10 Yuelin Xu , Xiao Zhang

The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted great attention in the machine learning community. The problem is related to non-flatness and non-smoothness of normally obtained loss landscapes.…

机器学习 · 计算机科学 2023-02-13 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Despite the recent advances of graph neural networks (GNNs) in modeling graph data, the training of GNNs on large datasets is notoriously hard due to the overfitting. Adversarial training, which augments data with the worst-case adversarial…

机器学习 · 计算机科学 2021-10-29 Haotian Xue , Kaixiong Zhou , Tianlong Chen , Kai Guo , Xia Hu , Yi Chang , Xin Wang

Several existing works study either adversarial or natural distributional robustness of deep neural networks separately. In practice, however, models need to enjoy both types of robustness to ensure reliability. In this work, we bridge this…

机器学习 · 计算机科学 2022-09-19 Mazda Moayeri , Kiarash Banihashem , Soheil Feizi

Algorithmic stability is an established tool for analyzing generalization. While adversarial training enhances model robustness, it often suffers from robust overfitting and an enlarged generalization gap. Although recent work has…

机器学习 · 计算机科学 2025-09-24 Hesam Hosseini , Ying Cao , Ali H. Sayed

Current neural-network-based classifiers are susceptible to adversarial examples. The most empirically successful approach to defending against such adversarial examples is adversarial training, which incorporates a strong self-attack…

机器学习 · 计算机科学 2020-06-08 Bai Li , Shiqi Wang , Suman Jana , Lawrence Carin

Neural networks have a number of shortcomings. Amongst the severest ones is the sensitivity to distribution shifts which allows models to be easily fooled into wrong predictions by small perturbations to inputs that are often imperceivable…

计算机视觉与模式识别 · 计算机科学 2023-03-23 Paul Gavrikov , Janis Keuper , Margret Keuper

Owing to the susceptibility of deep learning systems to adversarial attacks, there has been a great deal of work in developing (both empirically and certifiably) robust classifiers. While most work has defended against a single type of…

机器学习 · 计算机科学 2020-07-30 Pratyush Maini , Eric Wong , J. Zico Kolter

It is common practice in deep learning to use overparameterized networks and train for as long as possible; there are numerous studies that show, both theoretically and empirically, that such practices surprisingly do not unduly harm the…

机器学习 · 计算机科学 2020-03-05 Leslie Rice , Eric Wong , J. Zico Kolter

Black-box adversarial attacks designing adversarial examples for unseen neural networks (NNs) have received great attention over the past years. While several successful black-box attack schemes have been proposed in the literature, the…

机器学习 · 计算机科学 2022-06-22 Yilin Wang , Farzan Farnia

Adversarial training (AT) refers to integrating adversarial examples -- inputs altered with imperceptible perturbations that can significantly impact model predictions -- into the training process. Recent studies have demonstrated the…

机器学习 · 计算机科学 2024-10-22 Mengnan Zhao , Lihe Zhang , Jingwen Ye , Huchuan Lu , Baocai Yin , Xinchao Wang

Machine learning models are vulnerable to adversarial perturbations, that when added to an input, can cause high confidence misclassifications. The adversarial learning research community has made remarkable progress in the understanding of…

机器学习 · 计算机科学 2020-06-09 Jamie Hayes

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

机器学习 · 计算机科学 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

Powerful deep neural networks are vulnerable to adversarial attacks. To obtain adversarially robust models, researchers have separately developed adversarial training and Jacobian regularization techniques. There are abundant theoretical…

机器学习 · 统计学 2024-12-18 Dongya Wu , Xin Li

Adversarial examples reveal the blind spots of deep neural networks (DNNs) and represent a major concern for security-critical applications. The transferability of adversarial examples makes real-world attacks possible in black-box…

计算机视觉与模式识别 · 计算机科学 2019-10-16 Muzammal Naseer , Salman H. Khan , Harris Khan , Fahad Shahbaz Khan , Fatih Porikli

We propose a general approach to evaluating the performance of robust estimators based on adversarial losses under misspecified models. We first show that adversarial risk is equivalent to the risk induced by a distributional adversarial…

机器学习 · 统计学 2023-09-06 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

Adversarial examples can cause catastrophic mistakes in Deep Neural Network (DNNs) based vision systems e.g., for classification, segmentation and object detection. The vulnerability of DNNs against such attacks can prove a major roadblock…

计算机视觉与模式识别 · 计算机科学 2020-06-11 Muzammal Naseer , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Fatih Porikli

Adversarial Training has proved to be an effective training paradigm to enforce robustness against adversarial examples in modern neural network architectures. Despite many efforts, explanations of the foundational principles underpinning…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Mattia Carletti , Matteo Terzi , Gian Antonio Susto

Neural network classifiers are vulnerable to misclassification of adversarial samples, for which the current best defense trains classifiers with adversarial samples. However, adversarial samples are not optimal for steering attack…

机器学习 · 计算机科学 2021-02-10 Blerta Lindqvist

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

机器学习 · 计算机科学 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus