English
Related papers

Related papers: Improving the Generalization of Adversarial Traini…

200 papers

Adversarial example detection, which can be conveniently applied in many scenarios, is important in the area of adversarial defense. Unfortunately, existing detection methods suffer from poor generalization performance, because their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Heqi Peng , Yunhong Wang , Ruijie Yang , Beichen Li , Rui Wang , Yuanfang Guo

Domain adversarial training has been ubiquitous for achieving invariant representations and is used widely for various domain adaptation tasks. In recent times, methods converging to smooth optima have shown improved generalization for…

Machine Learning · Computer Science 2022-06-17 Harsh Rangwani , Sumukh K Aithal , Mayank Mishra , Arihant Jain , R. Venkatesh Babu

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

Machine Learning · Computer Science 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

Machine Learning · Computer Science 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Unsupervised domain adaptation, which involves transferring knowledge from a label-rich source domain to an unlabeled target domain, can be used to substantially reduce annotation costs in the field of object detection. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kazuma Fujii , Hiroshi Kera , Kazuhiko Kawamoto

To be successful in single source domain generalization, maximizing diversity of synthesized domains has emerged as one of the most effective strategies. Many of the recent successes have come from methods that pre-specify the types of…

Machine Learning · Computer Science 2022-12-14 Tejas Gokhale , Rushil Anirudh , Jayaraman J. Thiagarajan , Bhavya Kailkhura , Chitta Baral , Yezhou Yang

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Adversarial training, the process of training a deep learning model with adversarial data, is one of the most successful adversarial defense methods for deep learning models. We have found that the robustness to white-box attack of an…

Machine Learning · Computer Science 2021-12-24 Zhiwen Yan , Teck Khim Ng

Adversarial training is a defense technique that improves adversarial robustness of a deep neural network (DNN) by including adversarial examples in the training data. In this paper, we identify an overlooked problem of adversarial training…

Machine Learning · Computer Science 2020-09-24 Wonseok Lee , Hanbit Lee , Sang-goo Lee

Deep Neural Network (DNN) are vulnerable to adversarial attacks. As a countermeasure, adversarial training aims to achieve robustness based on the min-max optimization problem and it has shown to be one of the most effective defense…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Yaxin Li , Xiaorui Liu , Han Xu , Wentao Wang , Jiliang Tang

In this work we address the problem of transferring knowledge obtained from a vast annotated source domain to a low labeled target domain. We propose Adversarial Variational Domain Adaptation (AVDA), a semi-supervised domain adaptation…

Machine Learning · Computer Science 2021-01-26 Manuel Pérez-Carrasco , Guillermo Cabrera-Vives , Pavlos Protopapas , Nicolás Astorga , Marouan Belhaj

Data augmentation has been widely used to improve generalization in training deep neural networks. Recent works show that using worst-case transformations or adversarial augmentation strategies can significantly improve the accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Liang Xiao , Jiaolong Xu , Dawei Zhao , Erke Shang , Qi Zhu , Bin Dai

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

Recent advances in domain adaptation reveal that adversarial learning on deep neural networks can learn domain invariant features to reduce the shift between source and target domains. While such adversarial approaches achieve domain-level…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Nishant Yadav , Mahbubul Alam , Ahmed Farahat , Dipanjan Ghosh , Chetan Gupta , Auroop R. Ganguly

Adversarial training (AT) is a popular method for training robust deep neural networks (DNNs) against adversarial attacks. Yet, AT suffers from two shortcomings: (i) the robustness of DNNs trained by AT is highly intertwined with the size…

Machine Learning · Computer Science 2024-05-24 Shayan Mohajer Hamidi , Linfeng Ye

Adversarial training (AT) has been demonstrated to be effective in improving model robustness by leveraging adversarial examples for training. However, most AT methods are in face of expensive time and computational cost for calculating…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xiaojun Jia , Yong Zhang , Baoyuan Wu , Jue Wang , Xiaochun Cao

Adversarial training (AT) has been demonstrated as one of the most promising defense methods against various adversarial attacks. To our knowledge, existing AT-based methods usually train with the locally most adversarial perturbed points…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Chuanbiao Song , Yanbo Fan , Yichen Yang , Baoyuan Wu , Yiming Li , Zhifeng Li , Kun He

While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain…

Machine Learning · Computer Science 2017-10-31 Han Zhao , Shanghang Zhang , Guanhang Wu , João P. Costeira , José M. F. Moura , Geoffrey J. Gordon

Adversarial adaptation models have demonstrated significant progress towards transferring knowledge from a labeled source dataset to an unlabeled target dataset. Partial domain adaptation (PDA) investigates the scenarios in which the source…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Mohsen Kheirandishfard , Fariba Zohrizadeh , Farhad Kamangar

Adversarial training is by far the most successful strategy for improving robustness of neural networks to adversarial attacks. Despite its success as a defense mechanism, adversarial training fails to generalize well to unperturbed test…

Machine Learning · Computer Science 2019-10-18 Yogesh Balaji , Tom Goldstein , Judy Hoffman