English
Related papers

Related papers: MemLoss: Enhancing Adversarial Training with Recyc…

200 papers

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

Machine Learning · Computer Science 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

Machine Learning · Computer Science 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

Adversarial training (AT) is widely considered the state-of-the-art technique for improving the robustness of deep neural networks (DNNs) against adversarial examples (AE). Nevertheless, recent studies have revealed that adversarially…

Machine Learning · Computer Science 2023-08-04 Chenhao Lin , Xiang Ji , Yulong Yang , Qian Li , Chao Shen , Run Wang , Liming Fang

Deep learning models continue to advance in accuracy, yet they remain vulnerable to adversarial attacks, which often lead to the misclassification of adversarial examples. Adversarial training is used to mitigate this problem by increasing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Leo Hyun Park , Jaeuk Kim , Myung Gyo Oh , Jaewoo Park , Taekyoung Kwon

Deep neural networks have been shown to be susceptible to adversarial examples -- small, imperceptible changes constructed to cause mis-classification in otherwise highly accurate image classifiers. As a practical alternative, recent work…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Sukrut Rao , David Stutz , Bernt Schiele

Learning from demonstrations has made great progress over the past few years. However, it is generally data hungry and task specific. In other words, it requires a large amount of data to train a decent model on a particular task, and the…

Machine Learning · Computer Science 2021-03-29 Pin Wang , Hanhan Li , Ching-Yao Chan

Recently, deep learning has been applied to many security-sensitive applications, such as facial authentication. The existence of adversarial examples hinders such applications. The state-of-the-art result on defense shows that adversarial…

Machine Learning · Computer Science 2018-05-15 Qi-Zhi Cai , Min Du , Chang Liu , Dawn Song

Adversarial training can improve the robustness of neural networks. Previous methods focus on a single adversarial training strategy and do not consider the model property trained by different strategies. By revisiting the previous methods,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xingbin Liu , Huafeng Kuang , Xianming Lin , Yongjian Wu , Rongrong Ji

Current machine learning models achieve super-human performance in many real-world applications. Still, they are susceptible against imperceptible adversarial perturbations. The most effective solution for this problem is adversarial…

Machine Learning · Computer Science 2023-01-26 Mohammad Azizmalayeri , Arman Zarei , Alireza Isavand , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

In this work, we consider model robustness of deep neural networks against adversarial attacks from a global manifold perspective. Leveraging both the local and global latent information, we propose a novel adversarial training method…

Machine Learning · Computer Science 2022-10-04 Zhuang Qian , Shufei Zhang , Kaizhu Huang , Qiufeng Wang , Rui Zhang , Xinping Yi

Machine learning systems based on deep neural networks, being able to produce state-of-the-art results on various perception tasks, have gained mainstream adoption in many applications. However, they are shown to be vulnerable to…

Machine Learning · Computer Science 2018-01-16 Bo Luo , Yannan Liu , Lingxiao Wei , Qiang Xu

Recent work has explored integrating autoregressive language models with energy-based models (EBMs) to enhance text generation capabilities. However, learning effective EBMs for text is challenged by the discrete nature of language. This…

Computation and Language · Computer Science 2023-11-14 Xuwang Yin

Neural machine translation systems tend to fail on less decent inputs despite its significant efficacy, which may significantly harm the credibility of this systems-fathoming how and when neural-based systems fail in such cases is critical…

Computation and Language · Computer Science 2020-05-27 Wei Zou , Shujian Huang , Jun Xie , Xinyu Dai , Jiajun Chen

A human does not have to see all elephants to recognize an animal as an elephant. On contrast, current state-of-the-art deep learning approaches heavily depend on the variety of training samples and the capacity of the network. In practice,…

Machine Learning · Computer Science 2019-05-30 Shaokai Ye , Sia Huat Tan , Kaidi Xu , Yanzhi Wang , Chenglong Bao , Kaisheng Ma

Adversarial robustness has become a central goal in deep learning, both in the theory and the practice. However, successful methods to improve the adversarial robustness (such as adversarial training) greatly hurt generalization performance…

Machine Learning · Statistics 2022-10-20 Alex Lamb , Vikas Verma , Kenji Kawaguchi , Alexander Matyasko , Savya Khosla , Juho Kannala , Yoshua Bengio

We study the model robustness against adversarial examples, referred to as small perturbed input data that may however fool many state-of-the-art deep learning models. Unlike previous research, we establish a novel theory addressing the…

Machine Learning · Computer Science 2020-06-11 Shufei Zhang , Kaizhu Huang , Zenglin Xu

Adversarial examples pose a unique challenge for deep learning systems. Despite recent advances in both attacks and defenses, there is still a lack of clarity and consensus in the community about the true nature and underlying properties of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Shishira R Maiya , Max Ehrlich , Vatsal Agarwal , Ser-Nam Lim , Tom Goldstein , Abhinav Shrivastava

Over the last few years, the phenomenon of adversarial examples --- maliciously constructed inputs that fool trained machine learning models --- has captured the attention of the research community, especially when the adversary is…

Machine Learning · Computer Science 2019-01-31 Nic Ford , Justin Gilmer , Nicolas Carlini , Dogus Cubuk

Deep learning has achieved great success in computer vision, but remains vulnerable to adversarial attacks. Adversarial training is the leading defense designed to improve model robustness. However, its effect on the transferability of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Mohamed Awad , Mahmoud Akrm , Walid Gomaa

Adversarial training and its variants have become de facto standards for learning robust deep neural networks. In this paper, we explore the landscape around adversarial training in a bid to uncover its limits. We systematically study the…

Machine Learning · Statistics 2021-03-31 Sven Gowal , Chongli Qin , Jonathan Uesato , Timothy Mann , Pushmeet Kohli