English
Related papers

Related papers: Adversarial Robustness Overestimation and Instabil…

200 papers

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on both heuristics-driven and data-driven augmentations as a means to reduce…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Sylvestre-Alvise Rebuffi , Sven Gowal , Dan A. Calian , Florian Stimberg , Olivia Wiles , Timothy Mann

In adversarial machine learning, neural networks suffer from a significant issue known as robust overfitting, where the robust test accuracy decreases over epochs (Rice et al., 2020). Recent research conducted by Xing et al.,2021; Xiao et…

Machine Learning · Computer Science 2024-05-06 Jiancong Xiao , Jiawei Zhang , Zhi-Quan Luo , Asuman Ozdaglar

Adversarial training is a training scheme designed to counter adversarial attacks by augmenting the training dataset with adversarial examples. Surprisingly, several studies have observed that loss gradients from adversarially trained DNNs…

Machine Learning · Computer Science 2019-04-22 Beomsu Kim , Junghoon Seo , Taegyun Jeon

Deep neural networks are vulnerable to adversarial attacks. Recent studies about adversarial robustness focus on the loss landscape in the parameter space since it is related to optimization and generalization performance. These studies…

Machine Learning · Computer Science 2023-03-07 Sekitoshi Kanai , Masanori Yamada , Hiroshi Takahashi , Yuki Yamanaka , Yasutoshi Ida

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on reducing robust overfitting by using common data augmentation schemes. We…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Sylvestre-Alvise Rebuffi , Sven Gowal , Dan A. Calian , Florian Stimberg , Olivia Wiles , Timothy Mann

Adversarial training is by far the most successful strategy for improving robustness of neural networks to adversarial attacks. Despite its success as a defense mechanism, adversarial training fails to generalize well to unperturbed test…

Machine Learning · Computer Science 2019-10-18 Yogesh Balaji , Tom Goldstein , Judy Hoffman

Adversarial training has proven to be effective in hardening networks against adversarial examples. However, the gained robustness is limited by network capacity and number of training samples. Consequently, to build more robust models, it…

Machine Learning · Computer Science 2020-06-02 Zheng Xu , Ali Shafahi , Tom Goldstein

In adversarial machine learning, there was a common belief that robustness and accuracy hurt each other. The belief was challenged by recent studies where we can maintain the robustness and improve the accuracy. However, the other…

Machine Learning · Computer Science 2021-06-01 Jingfeng Zhang , Jianing Zhu , Gang Niu , Bo Han , Masashi Sugiyama , Mohan Kankanhalli

In recent years, it has been found that neural networks can be easily fooled by adversarial examples, which is a potential safety hazard in some safety-critical applications. Many researchers have proposed various method to make neural…

Machine Learning · Computer Science 2018-04-24 Shuangtao Li , Yuanke Chen , Yanlin Peng , Lin Bai

Deep models, while being extremely versatile and accurate, are vulnerable to adversarial attacks: slight perturbations that are imperceptible to humans can completely flip the prediction of deep models. Many attack and defense mechanisms…

Machine Learning · Computer Science 2019-07-30 Kaiwen Wu , Yaoliang Yu

Projected Gradient Descent (PGD) is a strong and widely used first-order adversarial attack, yet its computational cost scales poorly, as all training samples undergo identical iterative inner-loop optimization despite contributing…

Machine Learning · Computer Science 2025-12-29 Youran Ye , Dejin Wang , Ajinkya Bhandare

The trade-off between robustness and accuracy has been widely studied in the adversarial literature. Although still controversial, the prevailing view is that this trade-off is inherent, either empirically or theoretically. Thus, we dig for…

Machine Learning · Computer Science 2022-06-17 Tianyu Pang , Min Lin , Xiao Yang , Jun Zhu , Shuicheng Yan

It is common practice in deep learning to use overparameterized networks and train for as long as possible; there are numerous studies that show, both theoretically and empirically, that such practices surprisingly do not unduly harm the…

Machine Learning · Computer Science 2020-03-05 Leslie Rice , Eric Wong , J. Zico Kolter

Performance-critical machine learning models should be robust to input perturbations not seen during training. Adversarial training is a method for improving a model's robustness to some perturbations by including them in the training…

Machine Learning · Computer Science 2018-07-24 Angus Galloway , Thomas Tanay , Graham W. Taylor

Adversarial training is a popular method to robustify models against adversarial attacks. However, it exhibits much more severe overfitting than training on clean inputs. In this work, we investigate this phenomenon from the perspective of…

Machine Learning · Computer Science 2024-12-18 Chen Liu , Zhichao Huang , Mathieu Salzmann , Tong Zhang , Sabine Süsstrunk

Adversarial perturbations are imperceptible changes to input pixels that can change the prediction of deep learning models. Learned weights of models robust to such perturbations are previously found to be transferable across different…

Machine Learning · Computer Science 2020-10-30 Alvin Chan , Yi Tay , Yew-Soon Ong

Deep neural networks are easily misled by adversarial examples. Although lots of defense methods are proposed, many of them are demonstrated to lose effectiveness when against properly performed adaptive attacks. How to evaluate the…

Cryptography and Security · Computer Science 2021-01-08 Pengfei Xia , Ziqiang Li , Hongjing Niu , Bin Li

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

The field of adversarial robustness has attracted significant attention in machine learning. Contrary to the common approach of training models that are accurate in average case, it aims at training models that are accurate for worst case…

Machine Learning · Computer Science 2020-10-12 Oriol Barbany Mayor

Current techniques in machine learning are so far are unable to learn classifiers that are robust to adversarial perturbations. However, they are able to learn non-robust classifiers with very high accuracy, even in the presence of random…

Machine Learning · Computer Science 2019-01-04 Preetum Nakkiran