中文
相关论文

相关论文: Regularizers for Single-step Adversarial Training

200 篇论文

Deep neural networks have been shown to be vulnerable to adversarial examples deliberately constructed to misclassify victim models. As most adversarial examples have restricted their perturbations to $L_{p}$-norm, existing defense methods…

计算机视觉与模式识别 · 计算机科学 2021-03-16 Hanieh Naderi , Leili Goli , Shohreh Kasaei

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches to training robust models against…

机器学习 · 计算机科学 2023-08-09 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial training (AT) methods have been found to be effective against adversarial attacks on deep neural networks. Many variants of AT have been proposed to improve its performance. Pang et al. [1] have recently shown that incorporating…

机器学习 · 计算机科学 2023-03-16 Olukorede Fakorede , Ashutosh Nirala , Modeste Atsague , Jin Tian

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

机器学习 · 计算机科学 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna

We propose gradient adversarial training, an auxiliary deep learning framework applicable to different machine learning problems. In gradient adversarial training, we leverage a prior belief that in many contexts, simultaneous gradient…

机器学习 · 计算机科学 2018-06-22 Ayan Sinha , Zhao Chen , Vijay Badrinarayanan , Andrew Rabinovich

Adversarial attacks and defenses are currently active areas of research for the deep learning community. A recent review paper divided the defense approaches into three categories; gradient masking, robust optimization, and adversarial…

机器学习 · 计算机科学 2019-10-24 Leslie N. Smith

Adversarial training is one of the most popular ways to learn robust models but is usually attack-dependent and time costly. In this paper, we propose the MACER algorithm, which learns robust models without using adversarial training but…

机器学习 · 计算机科学 2022-03-15 Runtian Zhai , Chen Dan , Di He , Huan Zhang , Boqing Gong , Pradeep Ravikumar , Cho-Jui Hsieh , Liwei Wang

Discrete adversarial attacks are symbolic perturbations to a language input that preserve the output label but lead to a prediction error. While such attacks have been extensively explored for the purpose of evaluating model robustness,…

机器学习 · 计算机科学 2021-11-02 Maor Ivgi , Jonathan Berant

Adversarial examples are inputs to machine learning models designed to cause the model to make a mistake. They are useful for understanding the shortcomings of machine learning models, interpreting their results, and for regularisation. In…

机器学习 · 计算机科学 2018-08-28 Pasquale Minervini , Sebastian Riedel

Effective regularization techniques are highly desired in deep learning for alleviating overfitting and improving generalization. This work proposes a new regularization scheme, based on the understanding that the flat local minima of the…

机器学习 · 计算机科学 2021-05-10 Yaowei Zheng , Richong Zhang , Yongyi Mao

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making…

机器学习 · 统计学 2021-11-17 Takeru Miyato , Andrew M. Dai , Ian Goodfellow

Adversarial training is a common approach to improving the robustness of deep neural networks against adversarial examples. In this work, we propose a novel regularization approach as an alternative. To derive the regularizer, we formulate…

机器学习 · 计算机科学 2021-02-09 Avery Ma , Fartash Faghri , Nicolas Papernot , Amir-massoud Farahmand

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

机器学习 · 统计学 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Adversarial examples pose a security threat to many critical systems built on neural networks (such as face recognition systems, and self-driving cars). While many methods have been proposed to build robust models, how to build certifiably…

机器学习 · 计算机科学 2023-09-06 Ruihan Zhang , Peixin Zhang , Jun Sun

Research on adversarial robustness in language models is currently fragmented across applications and attacks, obscuring shared vulnerabilities. In this work, we propose unifying the study of adversarial robustness in text scoring models…

计算与语言 · 计算机科学 2026-02-03 Manveer Singh Tamber , Hosna Oyarhoseini , Jimmy Lin

Recent work has proposed several efficient approaches for generating gradient-based adversarial perturbations on embeddings and proved that the model's performance and robustness can be improved when they are trained with these contaminated…

计算与语言 · 计算机科学 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the…

机器学习 · 计算机科学 2023-10-05 Matan Levi , Aryeh Kontorovich

There has been a recent surge in single-step adversarial training as it shows robustness and efficiency. However, a phenomenon referred to as ``catastrophic overfitting" has been observed, which is prevalent in single-step defenses and may…

机器学习 · 计算机科学 2022-10-12 Zhuorong Li , Daiwei Yu

Despite its popularity, deep neural networks are easily fooled. To alleviate this deficiency, researchers are actively developing new training strategies, which encourage models that are robust to small input perturbations. Several…

机器学习 · 计算机科学 2021-10-28 Jingyue Lu , M. Pawan Kumar

Adversarial examples are crafted with imperceptible perturbations with the intent to fool neural networks. Against such attacks, adversarial training and its variants stand as the strongest defense to date. Previous studies have pointed out…

计算机视觉与模式识别 · 计算机科学 2020-01-30 Alvin Chan , Yi Tay , Yew Soon Ong , Jie Fu