English
Related papers

Related papers: Amata: An Annealing Mechanism for Adversarial Trai…

200 papers

Modern deep neural networks (DNNs) are vulnerable to adversarial attacks and adversarial training has been shown to be a promising method for improving the adversarial robustness of DNNs. Pruning methods have been considered in adversarial…

Machine Learning · Computer Science 2022-03-08 Xupeng Shi , Pengfei Zheng , A. Adam Ding , Yuan Gao , Weizhong Zhang

Adversarial training is a standard defense against malicious input perturbations in security-critical machine-learning systems. Its main burden is structural: before every parameter update, the current model must first be attacked to find a…

Quantum Physics · Physics 2026-03-31 Yue Wang , Guangyi He , Liepeng Zhang , Lukas Gonon , Qi Zhao

There has been an increasing interest in multi-task learning for video understanding in recent years. In this work, we propose a generalized notion of multi-task learning by incorporating both auxiliary tasks that the model should perform…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Stephen Su , Samuel Kwong , Qingyu Zhao , De-An Huang , Juan Carlos Niebles , Ehsan Adeli

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturbations are crafted…

Machine Learning · Statistics 2020-04-28 Florian Tramèr , Alexey Kurakin , Nicolas Papernot , Ian Goodfellow , Dan Boneh , Patrick McDaniel

Adversarial training is a computationally expensive task and hence searching for neural network architectures with robustness as the criterion can be challenging. As a step towards practical automation, this work explores the efficacy of a…

Machine Learning · Computer Science 2021-09-07 Ambrish Rawat , Mathieu Sinn , Beat Buesser

The design of better automated dialogue evaluation metrics offers the potential of accelerate evaluation research on conversational AI. However, existing trainable dialogue evaluation models are generally restricted to classifiers trained…

Computation and Language · Computer Science 2021-04-19 Xiang Gao , Yizhe Zhang , Michel Galley , Bill Dolan

Adversarial training has been widely acknowledged as the most effective method to improve the adversarial robustness against adversarial examples for Deep Neural Networks (DNNs). So far, most existing works focus on enhancing the overall…

Machine Learning · Computer Science 2023-03-28 Zeming Wei , Yifei Wang , Yiwen Guo , Yisen Wang

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

Adversarial training (AT) has proven to be one of the most effective ways to defend Deep Neural Networks (DNNs) against adversarial attacks. However, the phenomenon of robust overfitting, i.e., the robustness will drop sharply at a certain…

Machine Learning · Computer Science 2022-05-25 Shudong Zhang , Haichang Gao , Tianwei Zhang , Yunyi Zhou , Zihui Wu

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yihan Wu , Xinda Li , Florian Kerschbaum , Heng Huang , Hongyang Zhang

With the increasing amount of available data and advances in computing capabilities, deep neural networks (DNNs) have been successfully employed to solve challenging tasks in various areas, including healthcare, climate, and finance.…

Machine Learning · Computer Science 2023-01-12 Marcele O. K. Mendonça , Javier Maroto , Pascal Frossard , Paulo S. R. Diniz

Many adversarial defense methods have been proposed to enhance the adversarial robustness of natural language processing models. However, most of them introduce additional pre-set linguistic knowledge and assume that the synonym candidates…

Computation and Language · Computer Science 2024-02-28 Yichen Yang , Xin Liu , Kun He

Pretrained language models (PLMs) perform poorly under adversarial attacks. To improve the adversarial robustness, adversarial data augmentation (ADA) has been widely adopted to cover more search space of adversarial attacks by adding…

Computation and Language · Computer Science 2021-06-08 Chenglei Si , Zhengyan Zhang , Fanchao Qi , Zhiyuan Liu , Yasheng Wang , Qun Liu , Maosong Sun

Injecting adversarial examples during training, known as adversarial training, can improve robustness against one-step attacks, but not for unknown iterative attacks. To address this challenge, we first show iteratively generated…

Machine Learning · Statistics 2018-03-20 Taesik Na , Jong Hwan Ko , Saibal Mukhopadhyay

Adversarial Training (AT) is proposed to alleviate the adversarial vulnerability of machine learning models by extracting only robust features from the input, which, however, inevitably leads to severe accuracy reduction as it discards the…

Machine Learning · Statistics 2020-07-06 Yifei Wang , Dan Peng , Furui Liu , Zhenguo Li , Zhitang Chen , Jiansheng Yang

Deep learning models have achieved state-of-the-art performances in various domains, while they are vulnerable to the inputs with well-crafted but small perturbations, which are named after adversarial examples (AEs). Among many strategies…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Huihui Gong

Domain adversarial training has been ubiquitous for achieving invariant representations and is used widely for various domain adaptation tasks. In recent times, methods converging to smooth optima have shown improved generalization for…

Machine Learning · Computer Science 2022-06-17 Harsh Rangwani , Sumukh K Aithal , Mayank Mishra , Arihant Jain , R. Venkatesh Babu

While deep learning in the form of recurrent neural networks (RNNs) has caused a significant improvement in neural language modeling, the fact that they are extremely prone to overfitting is still a mainly unresolved issue. In this paper we…

Computation and Language · Computer Science 2022-11-18 Sajad Movahedi , Azadeh Shakery

Targeted adversarial attacks are widely used to evaluate the robustness of neural machine translation systems. Unfortunately, this paper first identifies a critical issue in the existing settings of NMT targeted adversarial attacks, where…

Computation and Language · Computer Science 2024-07-09 Junjie Wu , Lemao Liu , Wei Bi , Dit-Yan Yeung

Adversarial training has been considered an imperative component for safely deploying neural network-based applications to the real world. To achieve stronger robustness, existing methods primarily focus on how to generate strong attacks by…

Machine Learning · Computer Science 2023-09-01 Yeachan Kim , Seongyeon Kim , Ihyeok Seo , Bonggun Shin