English
Related papers

Related papers: Adversarial Training Can Provably Improve Robustne…

200 papers

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches to training robust models against…

Machine Learning · Computer Science 2023-08-09 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial training and its variants have become de facto standards for learning robust deep neural networks. In this paper, we explore the landscape around adversarial training in a bid to uncover its limits. We systematically study the…

Machine Learning · Statistics 2021-03-31 Sven Gowal , Chongli Qin , Jonathan Uesato , Timothy Mann , Pushmeet Kohli

In this paper we aim to explore the general robustness of neural network classifiers by utilizing adversarial as well as natural perturbations. Different from previous works which mainly focus on studying the robustness of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders

Recent work has demonstrated that neural networks are vulnerable to adversarial examples. To escape from the predicament, many works try to harden the model in various ways, in which adversarial training is an effective way which learns…

Machine Learning · Computer Science 2020-02-04 Kejiang Chen , Hang Zhou , Yuefeng Chen , Xiaofeng Mao , Yuhong Li , Yuan He , Hui Xue , Weiming Zhang , Nenghai Yu

Upon the discovery of adversarial attacks, robust models have become obligatory for deep learning-based systems. Adversarial training with first-order attacks has been one of the most effective defenses against adversarial perturbations to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Inci M. Baytas , Debayan Deb

The robustness of neural networks to intended perturbations has recently attracted significant attention. In this paper, we propose a new method, \emph{learning with a strong adversary}, that learns robust classifiers from supervised data.…

Machine Learning · Computer Science 2016-01-19 Ruitong Huang , Bing Xu , Dale Schuurmans , Csaba Szepesvari

Several existing works study either adversarial or natural distributional robustness of deep neural networks separately. In practice, however, models need to enjoy both types of robustness to ensure reliability. In this work, we bridge this…

Machine Learning · Computer Science 2022-09-19 Mazda Moayeri , Kiarash Banihashem , Soheil Feizi

Owing to security implications of adversarial vulnerability, adversarial robustness of deep metric learning models has to be improved. In order to avoid model collapse due to excessively hard examples, the existing defenses dismiss the…

Machine Learning · Computer Science 2022-03-04 Mo Zhou , Vishal M. Patel

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

Machine Learning · Computer Science 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

As deep learning applications, especially programs of computer vision, are increasingly deployed in our lives, we have to think more urgently about the security of these applications.One effective way to improve the security of deep…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Xiao Tan , Jingbo Gao , Ruolin Li

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

Driven by massive amounts of data and important advances in computational resources, new deep learning systems have achieved outstanding results in a large spectrum of applications. Nevertheless, our current theoretical understanding on the…

Machine Learning · Computer Science 2021-01-29 Guillermo Ortiz-Jimenez , Apostolos Modas , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard

Despite the success of convolutional neural networks (CNNs) in many academic benchmarks for computer vision tasks, their application in the real-world is still facing fundamental challenges. One of these open problems is the inherent lack…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Julia Grabinski , Paul Gavrikov , Janis Keuper , Margret Keuper

The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the…

Machine Learning · Computer Science 2023-10-05 Matan Levi , Aryeh Kontorovich

Recent work has put forth the hypothesis that adversarial vulnerabilities in neural networks are due to them overusing "non-robust features" inherent in the training data. We show empirically that for PGD-attacks, there is a training stage…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Zuowen Wang , Leo Horne

Adversarial robustness has become an emerging challenge for neural network owing to its over-sensitivity to small input perturbations. While being critical, we argue that solving this singular issue alone fails to provide a comprehensive…

Machine Learning · Computer Science 2021-03-02 Yu-Lin Tsai , Chia-Yi Hsu , Chia-Mu Yu , Pin-Yu Chen

Adversarial training is a training scheme designed to counter adversarial attacks by augmenting the training dataset with adversarial examples. Surprisingly, several studies have observed that loss gradients from adversarially trained DNNs…

Machine Learning · Computer Science 2019-04-22 Beomsu Kim , Junghoon Seo , Taegyun Jeon

The robustness of deep neural networks (DNNs) against adversarial attacks has been studied extensively in hopes of both better understanding how deep learning models converge and in order to ensure the security of these models in…

Machine Learning · Computer Science 2023-07-11 Jovon Craig , Josh Andle , Theodore S. Nowak , Salimeh Yasaei Sekeh