中文
相关论文

相关论文: On robust overfitting: adversarial training induce…

200 篇论文

Adversarial training has been demonstrated to be one of the most effective remedies for defending adversarial examples, yet it often suffers from the huge robustness generalization gap on unseen testing adversaries, deemed as the…

机器学习 · 计算机科学 2023-03-13 Aishan Liu , Shiyu Tang , Siyuan Liang , Ruihao Gong , Boxi Wu , Xianglong Liu , Dacheng Tao

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of source domains. To address such potential distribution shifts, we develop an unsupervised domain adaptation approach that…

机器学习 · 统计学 2025-03-25 Zhenyu Wang , Peter Bühlmann , Zijian Guo

We study a class of adversarial bandit optimization problems in which the loss functions may be non-convex and non-smooth. In each round, the learner observes a loss that consists of an underlying linear component together with an…

机器学习 · 计算机科学 2026-03-30 Zhuoyu Cheng , Kohei Hatano , Eiji Takimoto

Neural networks are vulnerable to adversarially-constructed perturbations of their inputs. Most research so far has considered perturbations of a fixed magnitude under some $l_p$ norm. Although studying these attacks is valuable, there has…

机器学习 · 计算机科学 2019-10-02 Isaac Dunn , Hadrien Pouget , Tom Melham , Daniel Kroening

Despite its popularity, deep neural networks are easily fooled. To alleviate this deficiency, researchers are actively developing new training strategies, which encourage models that are robust to small input perturbations. Several…

机器学习 · 计算机科学 2021-10-28 Jingyue Lu , M. Pawan Kumar

Recent studies demonstrate that deep networks, even robustified by the state-of-the-art adversarial training (AT), still suffer from large robust generalization gaps, in addition to the much more expensive training costs than standard…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Tianlong Chen , Zhenyu Zhang , Pengjun Wang , Santosh Balachandra , Haoyu Ma , Zehao Wang , Zhangyang Wang

The phenomenon of adversarial examples in deep learning models has caused substantial concern over their reliability. While many deep neural networks have shown impressive performance in terms of predictive accuracy, it has been shown that…

机器学习 · 计算机科学 2021-06-28 Sadia Chowdhury , Ruth Urner

Adversarial training has been demonstrated as one of the most effective methods for training robust models to defend against adversarial examples. However, adversarially trained models often lack adversarially robust generalization on…

计算机视觉与模式识别 · 计算机科学 2020-02-04 Chuanbiao Song , Kun He , Jiadong Lin , Liwei Wang , John E. Hopcroft

In this paper we aim to explore the general robustness of neural network classifiers by utilizing adversarial as well as natural perturbations. Different from previous works which mainly focus on studying the robustness of neural networks…

计算机视觉与模式识别 · 计算机科学 2020-10-06 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

机器学习 · 计算机科学 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

The vulnerability to slight input perturbations is a worrying yet intriguing property of deep neural networks (DNNs). Despite many previous works studying the reason behind such adversarial behavior, the relationship between the…

机器学习 · 统计学 2019-06-07 Yujun Shi , Benben Liao , Guangyong Chen , Yun Liu , Ming-Ming Cheng , Jiashi Feng

Recent improvements in deep learning models and their practical applications have raised concerns about the robustness of these models against adversarial examples. Adversarial training (AT) has been shown effective to reach a robust model…

机器学习 · 计算机科学 2021-03-30 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Recent empirical and theoretical studies have established the generalization capabilities of large machine learning models that are trained to (approximately or exactly) fit noisy data. In this work, we prove a surprising result that even…

机器学习 · 计算机科学 2024-01-26 Yifan Hao , Tong Zhang

Discrete adversarial attacks are symbolic perturbations to a language input that preserve the output label but lead to a prediction error. While such attacks have been extensively explored for the purpose of evaluating model robustness,…

机器学习 · 计算机科学 2021-11-02 Maor Ivgi , Jonathan Berant

Adversarial training is an effective methodology for training deep neural networks that are robust against adversarial, norm-bounded perturbations. However, the computational cost of adversarial training grows prohibitively as the size of…

Adversarial robustness of machine learning models is critical to ensuring reliable performance under data perturbations. Recent progress has been on point estimators, and this paper considers distributional predictors. First, using the link…

机器学习 · 计算机科学 2025-02-21 Mahalakshmi Sabanayagam , Russell Tsuchida , Cheng Soon Ong , Debarghya Ghoshdastidar

Deep learning has achieved great success in computer vision, but remains vulnerable to adversarial attacks. Adversarial training is the leading defense designed to improve model robustness. However, its effect on the transferability of…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Mohamed Awad , Mahmoud Akrm , Walid Gomaa

Efforts to address declining accuracy as a result of data shifts often involve various data-augmentation strategies. Adversarial training is one such method, designed to improve robustness to worst-case distribution shifts caused by…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Fatemeh Amerehi , Patrick Healy

It is well-known that modern neural networks are vulnerable to adversarial examples. To mitigate this problem, a series of robust learning algorithms have been proposed. However, although the robust training error can be near zero via some…

机器学习 · 计算机科学 2022-10-17 Binghui Li , Jikai Jin , Han Zhong , John E. Hopcroft , Liwei Wang

Deep neural networks (DNNs) have set benchmarks on a wide array of supervised learning tasks. Trained DNNs, however, often lack robustness to minor adversarial perturbations to the input, which undermines their true practicality. Recent…

机器学习 · 计算机科学 2018-11-20 Farzan Farnia , Jesse M. Zhang , David Tse