English
Related papers

Related papers: Understanding and Improving Ensemble Adversarial D…

200 papers

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

Machine Learning · Computer Science 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Self-ensemble adversarial training methods improve model robustness by ensembling models at different training epochs, such as model weight averaging (WA). However, previous research has shown that self-ensemble defense methods in…

Machine Learning · Computer Science 2024-06-21 Zhaozhe Hu , Jia-Li Yin , Bin Chen , Luojun Lin , Bo-Hao Chen , Ximeng Liu

In this paper, we study adversarial training on datasets that obey the long-tailed distribution, which is practical but rarely explored in previous works. Compared with conventional adversarial training on balanced datasets, this process…

Machine Learning · Computer Science 2023-12-05 Guanlin Li , Guowen Xu , Tianwei Zhang

The neural network (NN) becomes one of the most heated type of models in various signal processing applications. However, NNs are extremely vulnerable to adversarial examples (AEs). To defend AEs, adversarial training (AT) is believed to be…

Machine Learning · Computer Science 2023-08-31 Mingyuan Fan , Yang Liu , Cen Chen

In this paper, we study fast training of adversarially robust models. From the analyses of the state-of-the-art defense method, i.e., the multi-step adversarial training, we hypothesize that the gradient magnitude links to the model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jianyu Wang , Haichao Zhang

Adversarial training is one of the most effective approaches to improve model robustness against adversarial examples. However, previous works mainly focus on the overall robustness of the model, and the in-depth analysis on the role of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Qi Tian , Kun Kuang , Kelu Jiang , Fei Wu , Yisen Wang

The vulnerability of deep neural network models to adversarial example attacks is a practical challenge in many artificial intelligence applications. A recent line of work shows that the use of randomization in adversarial training is the…

Machine Learning · Computer Science 2023-06-30 Jiahao Xie , Chao Zhang , Weijie Liu , Wensong Bai , Hui Qian

Adversarial training (AT) is widely considered as the most promising strategy to defend against adversarial attacks and has drawn increasing interest from researchers. However, the existing AT methods still suffer from two challenges.…

Machine Learning · Computer Science 2024-05-21 Lilin Zhang , Ning Yang , Yanchao Sun , Philip S. Yu

Modern applications of artificial neural networks have yielded remarkable performance gains in a wide range of tasks. However, recent studies have discovered that such modelling strategy is vulnerable to Adversarial Examples, i.e. examples…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 João Monteiro , Isabela Albuquerque , Zahid Akhtar , Tiago H. Falk

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

Machine Learning · Statistics 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

Machine Learning · Computer Science 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

Developing robust models against adversarial perturbations has been an active area of research and many algorithms have been proposed to train individual robust models. Taking these pretrained robust models, we aim to study whether it is…

Machine Learning · Computer Science 2020-12-01 Devvrit , Minhao Cheng , Cho-Jui Hsieh , Inderjit Dhillon

Deep neural networks (DNNs) have achieved remarkable performance in many tasks, yet they often behave as opaque black boxes. Explanation-guided learning (EGL) methods steer DNNs using human-provided explanations or supervision on model…

Machine Learning · Computer Science 2026-03-03 Chao Chen , Yanhui Chen , Shanshan Lin , Dongsheng Hong , Shu Wu , Xiangwen Liao , Chuanyi Liu

Ensemble everything everywhere is a defense to adversarial examples that was recently proposed to make image classifiers robust. This defense works by ensembling a model's intermediate representations at multiple noisy image resolutions,…

Deep Metric Learning (DML) has shown remarkable successes in many domains by taking advantage of powerful deep neural networks. Deep neural networks are prone to adversarial attacks and could be easily fooled by adversarial examples. The…

Machine Learning · Computer Science 2025-01-14 Xiaopeng Ke

Despite the tremendous success of deep neural networks across various tasks, their vulnerability to imperceptible adversarial perturbations has hindered their deployment in the real world. Recently, works on randomized ensembles have…

Machine Learning · Computer Science 2022-06-15 Hassan Dbouk , Naresh R. Shanbhag

The field of defense strategies against adversarial attacks has significantly grown over the last years, but progress is hampered as the evaluation of adversarial defenses is often insufficient and thus gives a wrong impression of…

Machine Learning · Computer Science 2020-08-06 Francesco Croce , Matthias Hein

Instances-reweighted adversarial training (IRAT) can significantly boost the robustness of trained models, where data being less/more vulnerable to the given attack are assigned smaller/larger weights during training. However, when tested…

Machine Learning · Computer Science 2021-07-01 Ruize Gao , Feng Liu , Kaiwen Zhou , Gang Niu , Bo Han , James Cheng

Adversarial training (AT) is proved to reliably improve network's robustness against adversarial data. However, current AT with a pre-specified perturbation budget has limitations in learning a robust network. Firstly, applying a…

Machine Learning · Computer Science 2022-10-05 Chaojian Yu , Dawei Zhou , Li Shen , Jun Yu , Bo Han , Mingming Gong , Nannan Wang , Tongliang Liu

Deep neural networks are susceptible to human imperceptible adversarial perturbations. One of the strongest defense mechanisms is \emph{Adversarial Training} (AT). In this paper, we aim to address two predominant problems in AT. First,…

Machine Learning · Computer Science 2023-08-21 Jianhui Sun , Sanchit Sinha , Aidong Zhang