中文
相关论文

相关论文: Provable Robustness of Adversarial Training for Le…

200 篇论文

The proper handling of out-of-distribution (OOD) samples in deep classifiers is a critical concern for ensuring the suitability of deep neural networks in safety-critical systems. Existing approaches developed for robust OOD detection in…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Nasrin Alipour , Seyyed Ali SeyyedSalehi

We demonstrate, theoretically and empirically, that adversarial robustness can significantly benefit from semisupervised learning. Theoretically, we revisit the simple Gaussian model of Schmidt et al. that shows a sample complexity gap…

机器学习 · 统计学 2022-01-14 Yair Carmon , Aditi Raghunathan , Ludwig Schmidt , Percy Liang , John C. Duchi

Traditional (fickle) adversarial examples involve finding a small perturbation that does not change an input's true label but confuses the classifier into outputting a different prediction. Conversely, obstinate adversarial examples occur…

计算与语言 · 计算机科学 2022-11-01 Hannah Chen , Yangfeng Ji , David Evans

Neural networks are vulnerable to small adversarial perturbations. Existing literature largely focused on understanding and mitigating the vulnerability of learned models. In this paper, we demonstrate an intriguing phenomenon about the…

机器学习 · 计算机科学 2019-02-25 Gavin Weiguang Ding , Kry Yik Chau Lui , Xiaomeng Jin , Luyu Wang , Ruitong Huang

Adversarial training for neural networks has been in the limelight in recent years. The advancement in neural network architectures over the last decade has led to significant improvement in their performance. It sparked an interest in…

机器学习 · 计算机科学 2022-06-07 Abhijith Sharma , Apurva Narayan

In recent years, there has been an explosion of research into developing more robust deep neural networks against adversarial examples. Adversarial training appears as one of the most successful methods. To deal with both the robustness…

机器学习 · 计算机科学 2023-03-21 Gaojie Jin , Xinping Yi , Dengyu Wu , Ronghui Mu , Xiaowei Huang

In this paper, we investigate the following question: Can we obtain adversarially-trained models without training on adversarial examples? Our intuition is that training a model with inherent stochasticity, i.e., optimizing the parameters…

机器学习 · 计算机科学 2023-12-15 Ayoub Arous , Andres F Lopez-Lopera , Nael Abu-Ghazaleh , Ihsen Alouani

It is becoming increasingly important to understand the vulnerability of machine learning models to adversarial attacks. One of the fundamental problems in adversarial machine learning is to quantify how much training data is needed in the…

机器学习 · 计算机科学 2023-08-24 Pascale Gourdeau

Deep neural networks (DNNs) are vulnerable to adversarial examples, in which DNNs are misled to false outputs due to inputs containing imperceptible perturbations. Adversarial training, a reliable and effective method of defense, may…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Zongyuan Zhang , Qingwen Bu , Tianyang Duan , Zheng Lin , Yuhao Qing , Zihan Fang , Heming Cui , Dong Huang

"Benign overfitting", where classifiers memorize noisy training data yet still achieve a good generalization performance, has drawn great attention in the machine learning community. To explain this surprising phenomenon, a series of works…

机器学习 · 计算机科学 2022-01-03 Jinghui Chen , Yuan Cao , Quanquan Gu

Adversarial training augments the training set with perturbations to improve the robust error (over worst-case perturbations), but it often leads to an increase in the standard error (on unperturbed test inputs). Previous explanations for…

机器学习 · 计算机科学 2020-07-08 Aditi Raghunathan , Sang Michael Xie , Fanny Yang , John Duchi , Percy Liang

Classifiers such as deep neural networks have been shown to be vulnerable against adversarial perturbations on problems with high-dimensional input space. While adversarial training improves the robustness of image classifiers against such…

计算机视觉与模式识别 · 计算机科学 2019-08-14 Chaithanya Kumar Mummadi , Thomas Brox , Jan Hendrik Metzen

In real scenarios, state observations that an agent observes may contain measurement errors or adversarial noises, misleading the agent to take suboptimal actions or even collapse while training. In this paper, we study the training…

机器学习 · 计算机科学 2023-06-23 Ke Sun , Yingnan Zhao , Shangling Jui , Linglong Kong

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Aritra Ghosh , Andrew Lan

Adversarial Robustness is a growing field that evidences the brittleness of neural networks. Although the literature on adversarial robustness is vast, a dimension is missing in these studies: assessing how severe the mistakes are. We call…

机器学习 · 计算机科学 2021-08-27 Guillaume Jeanneret , Juan C Perez , Pablo Arbelaez

Adversarial Training (AT) is proposed to alleviate the adversarial vulnerability of machine learning models by extracting only robust features from the input, which, however, inevitably leads to severe accuracy reduction as it discards the…

机器学习 · 统计学 2020-07-06 Yifei Wang , Dan Peng , Furui Liu , Zhenguo Li , Zhitang Chen , Jiansheng Yang

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

机器学习 · 计算机科学 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

We initiate the study of tolerant adversarial PAC-learning with respect to metric perturbation sets. In adversarial PAC-learning, an adversary is allowed to replace a test point $x$ with an arbitrary point in a closed ball of radius $r$…

机器学习 · 统计学 2023-02-16 Hassan Ashtiani , Vinayak Pathak , Ruth Urner

Recently, adversarial training has been incorporated in self-supervised contrastive pre-training to augment label efficiency with exciting adversarial robustness. However, the robustness came at a cost of expensive adversarial training. In…

机器学习 · 计算机科学 2022-11-01 Yijiang Pang , Boyang Liu , Jiayu Zhou

To ensure that the data collected from human subjects is entrusted with a secret, rival labels are introduced to conceal the information provided by the participants on purpose. The corresponding learning task can be formulated as a noisy…

机器学习 · 计算机科学 2023-04-04 Cheng Chen , Yueming Lyu , Ivor W. Tsang