English
Related papers

Related papers: Enhance the Visual Representation via Discrete Adv…

200 papers

Federated learning enables model training over a distributed corpus of agent data. However, the trained model is vulnerable to adversarial examples, designed to elicit misclassification. We study the feasibility of using adversarial…

Machine Learning · Computer Science 2021-03-03 Devansh Shah , Parijat Dube , Supriyo Chakraborty , Ashish Verma

Gradient-based adversarial training is widely used in improving the robustness of neural networks, while it cannot be easily adapted to natural language processing tasks since the embedding space is discrete. In natural language processing…

Computation and Language · Computer Science 2020-12-07 Linyang Li , Xipeng Qiu

Deep Neural Networks (DNNs) are highly sensitive to imperceptible malicious perturbations, known as adversarial attacks. Following the discovery of this vulnerability in real-world imaging and vision applications, the associated safety…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tsachi Blau , Roy Ganz , Bahjat Kawar , Alex Bronstein , Michael Elad

To mitigate the susceptibility of neural networks to adversarial attacks, adversarial training has emerged as a prevalent and effective defense strategy. Intrinsically, this countermeasure incurs a trade-off, as it sacrifices the model's…

Machine Learning · Computer Science 2024-09-19 Hanyi Hu , Qiao Han , Kui Chen , Yao Yang

Adversarial training is an important topic in robust deep learning, but the community lacks attention to its practical usage. In this paper, we aim to resolve a real-world challenge, i.e., training a model on an imbalanced and noisy dataset…

Machine Learning · Computer Science 2023-12-05 Guanlin Li , Kangjie Chen , Yuan Xu , Han Qiu , Tianwei Zhang

Domain adversarial training has shown its effective capability for finding domain invariant feature representations and been successfully adopted for various domain adaptation tasks. However, recent advances of large models (e.g., vision…

Machine Learning · Computer Science 2024-07-18 Jiahong Chen , Zhilin Zhang , Lucy Li , Behzad Shahrasbi , Arjun Mishra

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

Machine Learning · Computer Science 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Training models that are robust to data domain shift has gained an increasing interest both in academia and industry. Question-Answering language models, being one of the typical problem in Natural Language Processing (NLP) research, has…

Computation and Language · Computer Science 2022-06-27 Shubham Shrivastava , Kaiyue Wang

Virtual Adversarial Training (VAT) has shown impressive results among recently developed regularization methods called consistency regularization. VAT utilizes adversarial samples, generated by injecting perturbation in the input space, for…

Machine Learning · Computer Science 2022-12-27 Genki Osada , Budrul Ahsan , Revoti Prasad Bora , Takashi Nishide

Robust watermarking is typically trained with random post-processing augmentation, but random sampling under-covers the combinatorial space of realistic attack pipelines and rarely encounters the rare compositions that actually break…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Anirudh Satheesh , Michael-Andrei Panaitescu-Liess , Andrew Xu , Georgios Milis , Heng Huang , Zikui Cai , Furong Huang

Generalization and robustness are both key desiderata for designing machine learning methods. Adversarial training can enhance robustness, but past work often finds it hurts generalization. In natural language processing (NLP), pre-training…

Computation and Language · Computer Science 2020-05-01 Xiaodong Liu , Hao Cheng , Pengcheng He , Weizhu Chen , Yu Wang , Hoifung Poon , Jianfeng Gao

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

While deep learning in the form of recurrent neural networks (RNNs) has caused a significant improvement in neural language modeling, the fact that they are extremely prone to overfitting is still a mainly unresolved issue. In this paper we…

Computation and Language · Computer Science 2022-11-18 Sajad Movahedi , Azadeh Shakery

Despite the empirical success in various domains, it has been revealed that deep neural networks are vulnerable to maliciously perturbed input data that much degrade their performance. This is known as adversarial attacks. To counter…

Machine Learning · Computer Science 2021-08-17 Nanyang Ye , Qianxiao Li , Xiao-Yun Zhou , Zhanxing Zhu

The deep neural networks are known to be vulnerable to well-designed adversarial attacks. The most successful defense technique based on adversarial training (AT) can achieve optimal robustness against particular attacks but cannot…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Guang Lin , Chao Li , Jianhai Zhang , Toshihisa Tanaka , Qibin Zhao

Recent studies demonstrate that Graph Neural Networks (GNNs) are vulnerable to slight but adversarially designed perturbations, known as adversarial examples. To address this issue, robust training methods against adversarial examples have…

Machine Learning · Computer Science 2022-11-22 Jintang Li , Jiaying Peng , Liang Chen , Zibin Zheng , Tingting Liang , Qing Ling

Adversarial Training (AT) impacts different architectures in distinct ways: vision models gain robustness but face reduced generalization, encoder-based models exhibit limited robustness improvements with minimal generalization loss, and…

Machine Learning · Computer Science 2025-05-27 Enes Altinisik , Safa Messaoud , Husrev Taha Sencar , Hassan Sajjad , Sanjay Chawla

Adversarial training (AT) is one of the most effective strategies for promoting model robustness. However, recent benchmarks show that most of the proposed improvements on AT are less effective than simply early stopping the training…

Machine Learning · Computer Science 2021-04-01 Tianyu Pang , Xiao Yang , Yinpeng Dong , Hang Su , Jun Zhu

Recently, a multitude of methods for image-to-image translation have demonstrated impressive results on problems such as multi-domain or multi-attribute transfer. The vast majority of such works leverages the strengths of adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 James Oldfield , Yannis Panagakis , Mihalis A. Nicolaou

Deep Neural Network (DNN) are vulnerable to adversarial attacks. As a countermeasure, adversarial training aims to achieve robustness based on the min-max optimization problem and it has shown to be one of the most effective defense…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Yaxin Li , Xiaorui Liu , Han Xu , Wentao Wang , Jiliang Tang