English
Related papers

Related papers: Efficient Adversarial Training With Data Pruning

200 papers

It is necessary to improve the performance of some special classes or to particularly protect them from attacks in adversarial learning. This paper proposes a framework combining cost-sensitive classification and adversarial learning…

Machine Learning · Computer Science 2022-06-24 Haojing Shen , Sihong Chen , Ran Wang , Xizhao Wang

Adversarial training is widely believed to be a reliable approach to improve model robustness against adversarial attack. However, in this paper, we show that when trained on one type of poisoned data, adversarial training can also be…

Machine Learning · Computer Science 2021-11-22 Zhirui Wang , Yifei Wang , Yisen Wang

Deep neural networks can be easily fooled into making incorrect predictions through corruption of the input by adversarial perturbations: human-imperceptible artificial noise. So far adversarial training has been the most successful defense…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Lin Li , Michael Spratling

Deep Neural Networks (DNNs) are everywhere, frequently performing a fairly complex task that used to be unimaginable for machines to carry out. In doing so, they do a lot of decision making which, depending on the application, may be…

Machine Learning · Computer Science 2022-11-17 Avriti Chauhan , Mohammad Afzal , Hrishikesh Karmarkar , Yizhak Elboher , Kumar Madhukar , Guy Katz

Most previous works usually explained adversarial examples from several specific perspectives, lacking relatively integral comprehension about this problem. In this paper, we present a systematic study on adversarial examples from three…

Machine Learning · Computer Science 2019-03-01 Ke Sun , Zhanxing Zhu , Zhouchen Lin

Adversarial training deep neural networks often experience serious overfitting problem. Recently, it is explained that the overfitting happens because the sample complexity of training data is insufficient to generalize robustness. In…

Machine Learning · Computer Science 2020-09-23 Joong-Won Hwang , Youngwan Lee , Sungchan Oh , Yuseok Bae

We analyze the influence of adversarial training on the loss landscape of machine learning models. To this end, we first provide analytical studies of the properties of adversarial loss functions under different adversarial budgets. We then…

Machine Learning · Computer Science 2020-11-04 Chen Liu , Mathieu Salzmann , Tao Lin , Ryota Tomioka , Sabine Süsstrunk

Adversarial training (AT) is widely considered the state-of-the-art technique for improving the robustness of deep neural networks (DNNs) against adversarial examples (AE). Nevertheless, recent studies have revealed that adversarially…

Machine Learning · Computer Science 2023-08-04 Chenhao Lin , Xiang Ji , Yulong Yang , Qian Li , Chao Shen , Run Wang , Liming Fang

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Despite the empirical success of using Adversarial Training to defend deep learning models against adversarial perturbations, so far, it still remains rather unclear what the principles are behind the existence of adversarial perturbations,…

Machine Learning · Computer Science 2022-06-14 Zeyuan Allen-Zhu , Yuanzhi Li

Machine learning researchers have long noticed the phenomenon that the model training process will be more effective and efficient when the training samples are densely sampled around the underlying decision boundary. While this observation…

Machine Learning · Computer Science 2021-09-24 Honggang Yu , Shihfeng Zeng , Teng Zhang , Ing-Chao Lin , Yier Jin

Modern machine learning and deep learning models are shown to be vulnerable when testing data are slightly perturbed. Existing theoretical studies of adversarial training algorithms mostly focus on either adversarial training losses or…

Machine Learning · Statistics 2021-04-07 Yue Xing , Qifan Song , Guang Cheng

Neural networks have a number of shortcomings. Amongst the severest ones is the sensitivity to distribution shifts which allows models to be easily fooled into wrong predictions by small perturbations to inputs that are often imperceivable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Paul Gavrikov , Janis Keuper , Margret Keuper

Deep neural networks (DNNs) are vulnerable to adversarial examples that are carefully designed to cause the deep learning model to make mistakes. Adversarial examples of 2D images and 3D point clouds have been extensively studied, but…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Wooju Lee , Hyun Myung

Neural networks are known to be vulnerable to adversarial examples. Carefully chosen perturbations to real images, while imperceptible to humans, induce misclassification and threaten the reliability of deep learning systems in the wild. To…

Recent works have demonstrated convolutional neural networks are vulnerable to adversarial examples, i.e., inputs to machine learning models that an attacker has intentionally designed to cause the models to make a mistake. To improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Xianxu Hou , Jingxin Liu , Bolei Xu , Xiaolong Wang , Bozhi Liu , Guoping Qiu

In recent years, deep neural networks have known a wide success in various application domains. However, they require important computational and memory resources, which severely hinders their deployment, notably on mobile devices or for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Nathan Hubens , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia

In adversarial data collection (ADC), a human workforce interacts with a model in real time, attempting to produce examples that elicit incorrect predictions. Researchers hope that models trained on these more challenging datasets will rely…

Computation and Language · Computer Science 2021-06-03 Divyansh Kaushik , Douwe Kiela , Zachary C. Lipton , Wen-tau Yih

Current deep neural networks (DNNs) are vulnerable to adversarial attacks, where adversarial perturbations to the inputs can change or manipulate classification. To defend against such attacks, an effective and popular approach, known as…

Machine Learning · Computer Science 2022-09-08 Gaoyuan Zhang , Songtao Lu , Yihua Zhang , Xiangyi Chen , Pin-Yu Chen , Quanfu Fan , Lee Martie , Lior Horesh , Mingyi Hong , Sijia Liu

Adversarial training (AT) is among the most effective techniques to improve model robustness by augmenting training data with adversarial examples. However, most existing AT methods adopt a specific attack to craft adversarial examples,…

Machine Learning · Computer Science 2020-11-20 Yinpeng Dong , Zhijie Deng , Tianyu Pang , Hang Su , Jun Zhu