中文
相关论文

相关论文: On the Clean Generalization and Robust Overfitting…

200 篇论文

Most previous works usually explained adversarial examples from several specific perspectives, lacking relatively integral comprehension about this problem. In this paper, we present a systematic study on adversarial examples from three…

机器学习 · 计算机科学 2019-03-01 Ke Sun , Zhanxing Zhu , Zhouchen Lin

Deep Neural Networks (DNNs) have shown substantial success in various applications but remain vulnerable to adversarial attacks. This study aims to identify and isolate the components of two different adversarial training techniques that…

机器学习 · 计算机科学 2025-08-26 William Brooks , Marelie H. Davel , Coenraad Mouton

This paper revisits the robust overfitting phenomenon of adversarial training. Observing that models with better robust generalization performance are less certain in predicting adversarially generated training inputs, we argue that…

机器学习 · 计算机科学 2025-01-15 Minxing Zhang , Michael Backes , Xiao Zhang

Deep learning models have a propensity for fitting the entire training set even with random labels, which requires memorization of every training sample. In this paper, we explore the memorization effect in adversarial training (AT) for…

机器学习 · 计算机科学 2022-03-15 Yinpeng Dong , Ke Xu , Xiao Yang , Tianyu Pang , Zhijie Deng , Hang Su , Jun Zhu

It is commonly believed that networks cannot be both accurate and robust, that gaining robustness means losing accuracy. It is also generally believed that, unless making networks larger, network architectural elements would otherwise…

机器学习 · 计算机科学 2021-07-13 Cihang Xie , Mingxing Tan , Boqing Gong , Alan Yuille , Quoc V. Le

Adversarial examples can cause catastrophic mistakes in Deep Neural Network (DNNs) based vision systems e.g., for classification, segmentation and object detection. The vulnerability of DNNs against such attacks can prove a major roadblock…

计算机视觉与模式识别 · 计算机科学 2020-06-11 Muzammal Naseer , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Fatih Porikli

Deep neural networks obtained by standard training have been constantly plagued by adversarial examples. Although adversarial training demonstrates its capability to defend against adversarial examples, unfortunately, it leads to an…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Hongjun Wang , Yisen Wang

This paper presents GReAT (Graph Regularized Adversarial Training), a novel regularization method designed to enhance the robust classification performance of deep learning models. Adversarial examples, characterized by subtle perturbations…

机器学习 · 计算机科学 2024-05-06 Samet Bayram , Kenneth Barner

Adversarial training is one of the most effective defenses against adversarial attacks. Previous works suggest that overfitting is a dominant phenomenon in adversarial training leading to a large generalization gap between test and train…

机器学习 · 计算机科学 2021-08-20 Vasu Singla , Sahil Singla , David Jacobs , Soheil Feizi

Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of…

机器学习 · 计算机科学 2017-11-08 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

The easiness at which adversarial instances can be generated in deep neural networks raises some fundamental questions on their functioning and concerns on their use in critical systems. In this paper, we draw a connection between…

机器学习 · 计算机科学 2018-03-02 Mahdieh Abbasi , Christian Gagné

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

Neural networks have led to major improvements in image classification but suffer from being non-robust to adversarial changes, unreliable uncertainty estimates on out-distribution samples and their inscrutable black-box decisions. In this…

机器学习 · 计算机科学 2020-07-30 Maximilian Augustin , Alexander Meinke , Matthias Hein

The two key players in Generative Adversarial Networks (GANs), the discriminator and generator, are usually parameterized as deep neural networks (DNNs). On many generative tasks, GANs achieve state-of-the-art performance but are often…

机器学习 · 计算机科学 2019-01-31 Babajide O. Ayinde , Keishin Nishihama , Jacek M. Zurada

Neural networks are known to be highly sensitive to adversarial examples. These may arise due to different factors, such as random initialization, or spurious correlations in the learning problem. To better understand these factors, we…

机器学习 · 统计学 2022-07-05 Elvis Dohmatob , Alberto Bietti

We investigate the effect of the dimensionality of the representations learned in Deep Neural Networks (DNNs) on their robustness to input perturbations, both adversarial and random. To achieve low dimensionality of learned representations,…

机器学习 · 计算机科学 2020-02-20 Amartya Sanyal , Varun Kanade , Philip H. S. Torr , Puneet K. Dokania

Recent studies on the adversarial vulnerability of neural networks have shown that models trained with the objective of minimizing an upper bound on the worst-case loss over all possible adversarial perturbations improve robustness against…

机器学习 · 计算机科学 2019-10-22 Anindya Sarkar , Nikhil Kumar Gupta , Raghu Iyengar

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

机器学习 · 统计学 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

In this paper, for the first time, we propose an evaluation method for deep learning models that assesses the performance of a model not only in an unseen test scenario, but also in extreme cases of noise, outliers and ambiguous input data.…

计算机视觉与模式识别 · 计算机科学 2018-04-03 Magdalini Paschali , Sailesh Conjeti , Fernando Navarro , Nassir Navab

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

机器学习 · 计算机科学 2023-02-09 Boqi Li , Weiwei Liu