English
Related papers

Related papers: Revisiting Adversarial Training at Scale

200 papers

The automatic evaluation of natural language generation (NLG) systems presents a long-lasting challenge. Recent studies have highlighted various neural metrics that align well with human evaluations. Yet, the robustness of these evaluators…

Computation and Language · Computer Science 2024-10-03 Yiming Chen , Chen Zhang , Danqing Luo , Luis Fernando D'Haro , Robby T. Tan , Haizhou Li

In semi-supervised learning, virtual adversarial training (VAT) approach is one of the most attractive method due to its intuitional simplicity and powerful performances. VAT finds a classifier which is robust to data perturbation toward…

Machine Learning · Statistics 2019-09-17 Dongha Kim , Yongchan Choi , Yongdai Kim

Data augmentation (DA) has been widely utilized to improve generalization in training deep neural networks. Recently, human-designed data augmentation has been gradually replaced by automatically learned augmentation policy. Through finding…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Xinyu Zhang , Qiang Wang , Jian Zhang , Zhao Zhong

Recently, Pyramid Adversarial training (Herrmann et al., 2022) has been shown to be very effective for improving clean accuracy and distribution-shift robustness of vision transformers. However, due to the iterative nature of adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Ping-yeh Chiang , Yipin Zhou , Omid Poursaeed , Satya Narayan Shukla , Ashish Shah , Tom Goldstein , Ser-Nam Lim

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Machine Learning · Statistics 2021-11-01 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani , Alejandro Ribeiro

Adversarial examples derived from deliberately crafted perturbations on visual inputs can easily harm decision process of deep neural networks. To prevent potential threats, various adversarial training-based defense methods have grown…

Machine Learning · Computer Science 2023-07-19 Byung-Kwan Lee , Junho Kim , Yong Man Ro

We propose an adversarial deep reinforcement learning (ADRL) algorithm for high-dimensional stochastic control problems. Inspired by the information relaxation duality, ADRL reformulates the control problem as a min-max optimization between…

Optimization and Control · Mathematics 2025-07-03 Nan Chen , Mengzhou Liu , Xiaoyan Wang , Nanyi Zhang

It is well-known that deep learning models are vulnerable to adversarial examples. Existing studies of adversarial training have made great progress against this challenge. As a typical trait, they often assume that the class distribution…

Machine Learning · Computer Science 2022-06-27 Wenzheng Hou , Qianqian Xu , Zhiyong Yang , Shilong Bao , Yuan He , Qingming Huang

The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the…

Machine Learning · Computer Science 2023-10-05 Matan Levi , Aryeh Kontorovich

Adversarial datasets should validate AI robustness by providing samples on which humans perform well, but models do not. However, as models evolve, datasets can become obsolete. Measuring whether a dataset remains adversarial is hindered by…

Computation and Language · Computer Science 2025-02-20 Yoo Yeon Sung , Maharshi Gor , Eve Fleisig , Ishani Mondal , Jordan Lee Boyd-Graber

Though much work has been done in the domain of improving the adversarial robustness of facial recognition systems, a surprisingly small percentage of it has focused on self-supervised approaches. In this work, we present an approach that…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Nazmul Karim , Umar Khalid , Nick Meeker , Sarinda Samarasinghe

Adversarial machine learning (AML) studies attacks that can fool machine learning algorithms into generating incorrect outcomes as well as the defenses against worst-case attacks to strengthen model robustness. Specifically for image…

Human-Computer Interaction · Computer Science 2024-10-08 Yuzhe You , Jarvis Tse , Jian Zhao

Advancements in reinforcement learning (RL) have been remarkable in recent years. However, the limitations of traditional training methods have become increasingly evident, particularly in meta-RL settings where agents face new, unseen…

Machine Learning · Computer Science 2023-02-07 Ramnath Kumar , Tristan Deleu , Yoshua Bengio

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

Machine Learning · Computer Science 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial training is an effective methodology for training deep neural networks that are robust against adversarial, norm-bounded perturbations. However, the computational cost of adversarial training grows prohibitively as the size of…

Adversarial reprogramming allows repurposing a machine-learning model to perform a different task. For example, a model trained to recognize animals can be reprogrammed to recognize digits by embedding an adversarial program in the digit…

Machine Learning · Computer Science 2023-03-14 Yang Zheng , Xiaoyi Feng , Zhaoqiang Xia , Xiaoyue Jiang , Ambra Demontis , Maura Pintor , Battista Biggio , Fabio Roli

Previous work on adversarially robust neural networks for image classification requires large training sets and computationally expensive training procedures. On the other hand, few-shot learning methods are highly vulnerable to adversarial…

Machine Learning · Computer Science 2020-10-16 Micah Goldblum , Liam Fowl , Tom Goldstein

Deep Convolution Neural Networks (CNNs) can easily be fooled by subtle, imperceptible changes to the input images. To address this vulnerability, adversarial training creates perturbation patterns and includes them in the training set to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Muzammal Naseer , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Fatih Porikli

Adversarial training is wildly considered as one of the most effective way to defend against adversarial examples. However, existing adversarial training methods consume unbearable time, due to the fact that they need to generate…

Machine Learning · Computer Science 2021-03-10 Yaguan Qian , Qiqi Shao , Tengteng Yao , Bin Wang , Shouling Ji , Shaoning Zeng , Zhaoquan Gu , Wassim Swaileh

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

Machine Learning · Computer Science 2023-02-09 Boqi Li , Weiwei Liu