English
Related papers

Related papers: Enhance Diffusion to Improve Robust Generalization

200 papers

Recent studies have highlighted that deep neural networks (DNNs) are vulnerable to adversarial examples. In this paper, we improve the robustness of DNNs by utilizing techniques of Distance Metric Learning. Specifically, we incorporate…

Machine Learning · Computer Science 2019-05-29 Pengcheng Li , Jinfeng Yi , Bowen Zhou , Lijun Zhang

Adversarial training (AT) has been demonstrated to be effective in improving model robustness by leveraging adversarial examples for training. However, most AT methods are in face of expensive time and computational cost for calculating…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xiaojun Jia , Yong Zhang , Baoyuan Wu , Jue Wang , Xiaochun Cao

Deep neural networks (DNNs) are sensitive to adversarial examples, resulting in fragile and unreliable performance in the real world. Although adversarial training (AT) is currently one of the most effective methodologies to robustify DNNs,…

Machine Learning · Computer Science 2023-03-01 Yize Li , Pu Zhao , Xue Lin , Bhavya Kailkhura , Ryan Goldhahn

Self-ensemble adversarial training methods improve model robustness by ensembling models at different training epochs, such as model weight averaging (WA). However, previous research has shown that self-ensemble defense methods in…

Machine Learning · Computer Science 2024-06-21 Zhaozhe Hu , Jia-Li Yin , Bin Chen , Luojun Lin , Bo-Hao Chen , Ximeng Liu

Unsupervised Domain Adaptation (UDA) methods aim to transfer knowledge from a labeled source domain to an unlabeled target domain. UDA has been extensively studied in the computer vision literature. Deep networks have been shown to be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Shao-Yuan Lo , Vishal M. Patel

The need for abundant labelled data in supervised Adversarial Training (AT) has prompted the use of Self-Supervised Learning (SSL) techniques with AT. However, the direct application of existing SSL methods to adversarial training has been…

Machine Learning · Computer Science 2024-06-11 Sravanti Addepalli , Priyam Dey , R. Venkatesh Babu

To be successful in single source domain generalization, maximizing diversity of synthesized domains has emerged as one of the most effective strategies. Many of the recent successes have come from methods that pre-specify the types of…

Machine Learning · Computer Science 2022-12-14 Tejas Gokhale , Rushil Anirudh , Jayaraman J. Thiagarajan , Bhavya Kailkhura , Chitta Baral , Yezhou Yang

Neural networks are known to be susceptible to adversarial samples: small variations of natural examples crafted to deliberately mislead the models. While they can be easily generated using gradient-based techniques in digital and physical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Haotian Xue , Alexandre Araujo , Bin Hu , Yongxin Chen

Adversarial training (AT) is a powerful regularization method for neural networks, aiming to achieve robustness to input perturbations. Yet, the specific effects of the robustness obtained from AT are still unclear in the context of natural…

Computation and Language · Computer Science 2018-04-23 Michihiro Yasunaga , Jungo Kasai , Dragomir Radev

Adversarial Training (AT) is one of the most effective methods to enhance the robustness of Deep Neural Networks (DNNs). However, existing AT methods suffer from an inherent accuracy-robustness trade-off. Previous works have studied this…

Machine Learning · Computer Science 2025-05-28 Yanyun Wang , Li Liu , Zi Liang , Yi R. , Fung , Qingqing Ye , Haibo Hu

Adversarial training is a method for enhancing neural networks to improve the robustness against adversarial examples. Besides the security concerns of potential adversarial examples, adversarial training can also improve the generalization…

Machine Learning · Computer Science 2022-12-21 Zhiyuan Zhang , Wei Li , Ruihan Bao , Keiko Harimoto , Yunfang Wu , Xu Sun

Developing image-generative models, which are robust to outliers in the training process, has recently drawn attention from the research community. Due to the ease of integrating unbalanced optimal transport (UOT) into adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Quan Dao , Binh Ta , Tung Pham , Anh Tran

Despite being widely adopted as a canonical framework for learning robust models, adversarial training suffers from robust overfitting. Existing empirical measures and theoretical explorations are insufficient to provide satisfying…

Machine Learning · Computer Science 2026-03-10 Yuelin Xu , Xiao Zhang

Deep Neural Networks are vulnerable to adversarial attacks. Among many defense strategies, adversarial training with untargeted attacks is one of the most effective methods. Theoretically, adversarial perturbation in untargeted attacks can…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Pengyue Hou , Jie Han , Xingyu Li

Research on improving the robustness of neural networks to adversarial noise - imperceptible malicious perturbations of the data - has received significant attention. The currently uncontested state-of-the-art defense to obtain robust deep…

Machine Learning · Computer Science 2023-04-20 Jingtong Su , Julia Kempe

Adversarial training (AT) is a regularization method that can be used to improve the robustness of neural network methods by adding small perturbations in the training data. We show how to use AT for the tasks of entity recognition and…

Computation and Language · Computer Science 2019-01-15 Giannis Bekoulis , Johannes Deleu , Thomas Demeester , Chris Develder

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a label-rich source domain to an unlabeled target domain by addressing domain shifts. Most UDA approaches emphasize transfer ability, but often overlook robustness against…

Machine Learning · Computer Science 2025-11-17 Fuxiang Huang , Xiaowei Fu , Shiyu Ye , Lina Ma , Wen Li , Xinbo Gao , David Zhang , Lei Zhang

Adversarial training (AT) with projected gradient descent is the most popular method to improve model robustness under adversarial attacks. However, computational overheads become prohibitively large when AT is applied to large backbone…

Machine Learning · Computer Science 2025-08-26 Quanwei Wu , Jun Guo , Wei Wang , Yi Wang

Adversarial Training (AT) impacts different architectures in distinct ways: vision models gain robustness but face reduced generalization, encoder-based models exhibit limited robustness improvements with minimal generalization loss, and…

Machine Learning · Computer Science 2025-05-27 Enes Altinisik , Safa Messaoud , Husrev Taha Sencar , Hassan Sajjad , Sanjay Chawla

Adversarial learning methods are a promising approach to training robust deep networks, and can generate complex samples across diverse domains. They also can improve recognition despite the presence of domain shift or dataset bias: several…

Computer Vision and Pattern Recognition · Computer Science 2017-02-20 Eric Tzeng , Judy Hoffman , Kate Saenko , Trevor Darrell