English
Related papers

Related papers: Convergence and Margin of Adversarial Training on …

200 papers

Modern machine learning and deep learning models are shown to be vulnerable when testing data are slightly perturbed. Existing theoretical studies of adversarial training algorithms mostly focus on either adversarial training losses or…

Machine Learning · Statistics 2021-04-07 Yue Xing , Qifan Song , Guang Cheng

We propose a framework for adversarial training that relies on a sample rather than a single sample point as the fundamental unit of discrimination. Inspired by discrepancy measures and two-sample tests between probability distributions, we…

Machine Learning · Computer Science 2017-07-11 Chengtao Li , David Alvarez-Melis , Keyulu Xu , Stefanie Jegelka , Suvrit Sra

State-of-the-art classifiers have been shown to be largely vulnerable to adversarial perturbations. One of the most effective strategies to improve robustness is adversarial training. In this paper, we investigate the effect of adversarial…

Machine Learning · Computer Science 2018-11-27 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Jonathan Uesato , Pascal Frossard

Adversarial learning can learn fairer and less biased models of language than standard methods. However, current adversarial techniques only partially mitigate model bias, added to which their training procedures are often unstable. In this…

Machine Learning · Computer Science 2021-01-26 Xudong Han , Timothy Baldwin , Trevor Cohn

The robustness of neural networks to intended perturbations has recently attracted significant attention. In this paper, we propose a new method, \emph{learning with a strong adversary}, that learns robust classifiers from supervised data.…

Machine Learning · Computer Science 2016-01-19 Ruitong Huang , Bing Xu , Dale Schuurmans , Csaba Szepesvari

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

This paper explores the use of adversarial examples in training speech recognition systems to increase robustness of deep neural network acoustic models. During training, the fast gradient sign method is used to generate adversarial…

Computation and Language · Computer Science 2018-06-19 Sining Sun , Ching-Feng Yeh , Mari Ostendorf , Mei-Yuh Hwang , Lei Xie

Adversarial training has been shown to be one of the most effective approaches to improve the robustness of deep neural networks. It is formalized as a min-max optimization over model weights and adversarial perturbations, where the weights…

Machine Learning · Computer Science 2022-03-14 Gaojie Jin , Xinping Yi , Wei Huang , Sven Schewe , Xiaowei Huang

Neural network classifiers are vulnerable to misclassification of adversarial samples, for which the current best defense trains classifiers with adversarial samples. However, adversarial samples are not optimal for steering attack…

Machine Learning · Computer Science 2021-02-10 Blerta Lindqvist

Deep Imitation Learning requires a large number of expert demonstrations, which are not always easy to obtain, especially for complex tasks. A way to overcome this shortage of labels is through data augmentation. However, this cannot be…

Machine Learning · Computer Science 2021-03-29 Dafni Antotsiou , Carlo Ciliberto , Tae-Kyun Kim

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

Machine Learning · Computer Science 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

In this work we revisit gradient regularization for adversarial robustness with some new ingredients. First, we derive new per-image theoretical robustness bounds based on local gradient information. These bounds strongly motivate input…

Machine Learning · Statistics 2019-10-07 Chris Finlay , Adam M Oberman

In the transfer-based adversarial attacks, adversarial examples are only generated by the surrogate models and achieve effective perturbation in the victim models. Although considerable efforts have been developed on improving the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Xiangyuan Yang , Jie Lin , Hanlin Zhang , Xinyu Yang , Peng Zhao

We present a new algorithm to learn a deep neural network model robust against adversarial attacks. Previous algorithms demonstrate an adversarially trained Bayesian Neural Network (BNN) provides improved robustness. We recognize the…

Machine Learning · Computer Science 2023-12-04 Bao Gia Doan , Ehsan Abbasnejad , Javen Qinfeng Shi , Damith C. Ranasinghe

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

Despite the wide use of machine learning in adversarial settings including computer security, recent studies have demonstrated vulnerabilities to evasion attacks---carefully crafted adversarial samples that closely resemble legitimate…

Cryptography and Security · Computer Science 2017-05-26 Yi Han , Benjamin I. P. Rubinstein

Recent works show that adversarial examples exist for random neural networks [Daniely and Schacham, 2020] and that these examples can be found using a single step of gradient ascent [Bubeck et al., 2021]. In this work, we extend this line…

Machine Learning · Computer Science 2022-10-19 Yunjuan Wang , Enayat Ullah , Poorya Mianjy , Raman Arora

Projected Gradient Descent (PGD) based adversarial training has become one of the most prominent methods for building robust deep neural network models. However, the computational complexity associated with this approach, due to the…

Machine Learning · Computer Science 2020-05-01 Sidharth Gupta , Parijat Dube , Ashish Verma

Adversarial training was introduced as a way to improve the robustness of deep learning models to adversarial attacks. This training method improves robustness against adversarial attacks, but increases the models vulnerability to privacy…

Neural networks are vulnerable to small adversarial perturbations. Existing literature largely focused on understanding and mitigating the vulnerability of learned models. In this paper, we demonstrate an intriguing phenomenon about the…

Machine Learning · Computer Science 2019-02-25 Gavin Weiguang Ding , Kry Yik Chau Lui , Xiaomeng Jin , Luyu Wang , Ruitong Huang