中文
相关论文

相关论文: SAT: Improving Adversarial Training via Curriculum…

200 篇论文

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

机器学习 · 统计学 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

Adversarial training is extensively utilized to improve the adversarial robustness of deep neural networks. Yet, mitigating the degradation of standard generalization performance in adversarial-trained models remains an open problem. This…

机器学习 · 计算机科学 2024-03-27 Xiangyu Yin , Wenjie Ruan

Adversarial training serves as one of the most popular and effective methods to defend against adversarial perturbations. However, most defense mechanisms only consider a single type of perturbation while various attack methods might be…

计算机视觉与模式识别 · 计算机科学 2023-09-29 Huihui Gong , Minjing Dong , Siqi Ma , Seyit Camtepe , Surya Nepal , Chang Xu

Many adversarial defense methods have been proposed to enhance the adversarial robustness of natural language processing models. However, most of them introduce additional pre-set linguistic knowledge and assume that the synonym candidates…

计算与语言 · 计算机科学 2024-02-28 Yichen Yang , Xin Liu , Kun He

A major drawback of adversarially robust models, in particular for large scale datasets like ImageNet, is the extremely long training time compared to standard ones. Moreover, models should be robust not only to one $l_p$-threat model but…

机器学习 · 计算机科学 2022-08-09 Francesco Croce , Matthias Hein

Adversarial training (AT) is a powerful regularization method for neural networks, aiming to achieve robustness to input perturbations. Yet, the specific effects of the robustness obtained from AT are still unclear in the context of natural…

计算与语言 · 计算机科学 2018-04-23 Michihiro Yasunaga , Jungo Kasai , Dragomir Radev

Beyond the success story of adversarial training (AT) in the recent text domain on top of pre-trained language models (PLMs), our empirical study showcases the inconsistent gains from AT on some tasks, e.g. commonsense reasoning, named…

计算与语言 · 计算机科学 2023-05-09 Hongqiu Wu , Yongxiang Liu , Hanwen Shi , Hai Zhao , Min Zhang

Despite the remarkable progress of deep neural networks (DNNs) in various visual tasks, their vulnerability to adversarial examples raises significant security concerns. Recent adversarial training methods leverage inverse adversarial…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Kejia Zhang , Juanjuan Weng , Shaozi Li , Zhiming Luo

There has been a recent surge in single-step adversarial training as it shows robustness and efficiency. However, a phenomenon referred to as ``catastrophic overfitting" has been observed, which is prevalent in single-step defenses and may…

机器学习 · 计算机科学 2022-10-12 Zhuorong Li , Daiwei Yu

Recent efforts show that neural networks are vulnerable to small but intentional perturbations on input features in visual classification tasks. Due to the additional consideration of connections between examples (\eg articles with citation…

机器学习 · 计算机科学 2019-12-17 Fuli Feng , Xiangnan He , Jie Tang , Tat-Seng Chua

Classical adversarial training (AT) frameworks are designed to achieve high adversarial accuracy against a single attack type, typically $\ell_\infty$ norm-bounded perturbations. Recent extensions in AT have focused on defending against the…

机器学习 · 计算机科学 2021-06-15 Ameya D. Patil , Michael Tuttle , Alexander G. Schwing , Naresh R. Shanbhag

This paper presents GReAT (Graph Regularized Adversarial Training), a novel regularization method designed to enhance the robust classification performance of deep learning models. Adversarial examples, characterized by subtle perturbations…

机器学习 · 计算机科学 2024-05-06 Samet Bayram , Kenneth Barner

To advance the understanding of robust deep learning, we delve into the effects of adversarial training on self-supervised and supervised contrastive learning alongside supervised learning. Our analysis uncovers significant disparities…

机器学习 · 计算机科学 2023-06-08 Fatemeh Ghofrani , Mehdi Yaghouti , Pooyan Jamshidi

Fine-tuning large-scale pre-trained language models has been demonstrated effective for various natural language processing (NLP) tasks. Previous studies have established that incorporating adversarial training during the fine-tuning stage…

计算与语言 · 计算机科学 2023-06-29 Zhehua Zhong , Tianyi Chen , Zhen Wang

Adversarial training (AT) is a popular method for training robust deep neural networks (DNNs) against adversarial attacks. Yet, AT suffers from two shortcomings: (i) the robustness of DNNs trained by AT is highly intertwined with the size…

机器学习 · 计算机科学 2024-05-24 Shayan Mohajer Hamidi , Linfeng Ye

Adversarial training is an effective but time-consuming way to train robust deep neural networks that can withstand strong adversarial attacks. As a response to its inefficiency, we propose Dynamic Efficient Adversarial Training (DEAT),…

机器学习 · 计算机科学 2023-03-15 Fu Wang , Yanghao Zhang , Yanbin Zheng , Wenjie Ruan

AI models are essential in science and engineering, but recent advances are pushing the limits of traditional digital hardware. To address these limitations, physical neural networks (PNNs), which use physical substrates for computation,…

Remarkable successes were made in Medical Image Classification (MIC) recently, mainly due to wide applications of convolutional neural networks (CNNs). However, adversarial examples (AEs) exhibited imperceptible similarity with raw data,…

图像与视频处理 · 电气工程与系统科学 2024-03-12 Shuai Li , Xiaoguang Ma , Shancheng Jiang , Lu Meng

Recently, unsupervised adversarial training (AT) has been highlighted as a means of achieving robustness in models without any label information. Previous studies in unsupervised AT have mostly focused on implementing self-supervised…

机器学习 · 计算机科学 2023-10-27 Minseon Kim , Hyeonjeong Ha , Sooel Son , Sung Ju Hwang

Deep neural networks are susceptible to adversarial examples, posing a significant security risk in critical applications. Adversarial Training (AT) is a well-established technique to enhance adversarial robustness, but it often comes at…

机器学习 · 计算机科学 2023-08-08 Kaijie Zhu , Jindong Wang , Xixu Hu , Xing Xie , Ge Yang