中文
相关论文

相关论文: Fast Adversarial Training with Smooth Convergence

200 篇论文

It is commonly believed that networks cannot be both accurate and robust, that gaining robustness means losing accuracy. It is also generally believed that, unless making networks larger, network architectural elements would otherwise…

机器学习 · 计算机科学 2021-07-13 Cihang Xie , Mingxing Tan , Boqing Gong , Alan Yuille , Quoc V. Le

Adversarial training (AT) is proved to reliably improve network's robustness against adversarial data. However, current AT with a pre-specified perturbation budget has limitations in learning a robust network. Firstly, applying a…

机器学习 · 计算机科学 2022-10-05 Chaojian Yu , Dawei Zhou , Li Shen , Jun Yu , Bo Han , Mingming Gong , Nannan Wang , Tongliang Liu

Adversarial training (AT) aims to improve the robustness of deep learning models by mixing clean data and adversarial examples (AEs). Most existing AT approaches can be grouped into restricted and unrestricted approaches. Restricted AT…

机器学习 · 计算机科学 2020-04-14 Haidong Xie , Xueshuang Xiang , Naijin Liu , Bin Dong

Adversarial training has been widely acknowledged as the most effective method to improve the adversarial robustness against adversarial examples for Deep Neural Networks (DNNs). So far, most existing works focus on enhancing the overall…

机器学习 · 计算机科学 2023-03-28 Zeming Wei , Yifei Wang , Yiwen Guo , Yisen Wang

Recent developments in the filed of Deep Learning have demonstrated that Deep Neural Networks(DNNs) are vulnerable to adversarial examples. Specifically, in image classification, an adversarial example can fool the well trained deep neural…

机器学习 · 计算机科学 2021-01-26 Xunguang Wang , Ship Peng Xu , Eric Ke Wang

Adversarial training (AT) has become a popular choice for training robust networks. However, it tends to sacrifice clean accuracy heavily in favor of robustness and suffers from a large generalization error. To address these concerns, we…

机器学习 · 计算机科学 2021-11-09 Chawin Sitawarin , Supriyo Chakraborty , David Wagner

Adversarial training (AT) with projected gradient descent is the most popular method to improve model robustness under adversarial attacks. However, computational overheads become prohibitively large when AT is applied to large backbone…

机器学习 · 计算机科学 2025-08-26 Quanwei Wu , Jun Guo , Wei Wang , Yi Wang

Federated learning (FL) is one of the most important paradigms addressing privacy and data governance issues in machine learning (ML). Adversarial training has emerged, so far, as the most promising approach against evasion threats on ML…

机器学习 · 计算机科学 2020-12-04 Giulio Zizzo , Ambrish Rawat , Mathieu Sinn , Beat Buesser

Adversarial training (AT) is currently one of the most successful methods to obtain the adversarial robustness of deep neural networks. However, the phenomenon of robust overfitting, i.e., the robustness starts to decrease significantly…

机器学习 · 计算机科学 2021-12-23 Jihoon Tack , Sihyun Yu , Jongheon Jeong , Minseon Kim , Sung Ju Hwang , Jinwoo Shin

Adversarial training (AT) with samples generated by Fast Gradient Sign Method (FGSM), also known as FGSM-AT, is a computationally simple method to train robust networks. However, during its training procedure, an unstable mode of…

计算机视觉与模式识别 · 计算机科学 2022-09-07 Zichao Li , Li Liu , Zeyu Wang , Yuyin Zhou , Cihang Xie

Adversarial training (AT) is widely considered the state-of-the-art technique for improving the robustness of deep neural networks (DNNs) against adversarial examples (AE). Nevertheless, recent studies have revealed that adversarially…

机器学习 · 计算机科学 2023-08-04 Chenhao Lin , Xiang Ji , Yulong Yang , Qian Li , Chao Shen , Run Wang , Liming Fang

Adversarial training based on the minimax formulation is necessary for obtaining adversarial robustness of trained models. However, it is conservative or even pessimistic so that it sometimes hurts the natural generalization. In this paper,…

机器学习 · 计算机科学 2020-09-08 Jingfeng Zhang , Xilie Xu , Bo Han , Gang Niu , Lizhen Cui , Masashi Sugiyama , Mohan Kankanhalli

Adversarial training has been considered an imperative component for safely deploying neural network-based applications to the real world. To achieve stronger robustness, existing methods primarily focus on how to generate strong attacks by…

机器学习 · 计算机科学 2023-09-01 Yeachan Kim , Seongyeon Kim , Ihyeok Seo , Bonggun Shin

In response to the threat of adversarial examples, adversarial training provides an attractive option for enhancing the model robustness by training models on online-augmented adversarial examples. However, most of the existing adversarial…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Jia-Li Yin , Lehui Xie , Wanqing Zhu , Ximeng Liu , Bo-Hao Chen

Collaborative Filtering (CF) has been successfully used to help users discover the items of interest. Nevertheless, existing CF methods suffer from noisy data issue, which negatively impacts the quality of recommendation. To tackle this…

信息检索 · 计算机科学 2023-08-29 Huiyuan Chen , Xiaoting Li , Vivian Lai , Chin-Chia Michael Yeh , Yujie Fan , Yan Zheng , Mahashweta Das , Hao Yang

Recently, adversarial training has been incorporated in self-supervised contrastive pre-training to augment label efficiency with exciting adversarial robustness. However, the robustness came at a cost of expensive adversarial training. In…

机器学习 · 计算机科学 2022-11-01 Yijiang Pang , Boyang Liu , Jiayu Zhou

Deep Neural Network (DNN) are vulnerable to adversarial attacks. As a countermeasure, adversarial training aims to achieve robustness based on the min-max optimization problem and it has shown to be one of the most effective defense…

计算机视觉与模式识别 · 计算机科学 2022-05-03 Yaxin Li , Xiaorui Liu , Han Xu , Wentao Wang , Jiliang Tang

In Federated Learning (FL), models are as fragile as centrally trained models against adversarial examples. However, the adversarial robustness of federated learning remains largely unexplored. This paper casts light on the challenge of…

机器学习 · 计算机科学 2023-02-21 Jie Zhang , Bo Li , Chen Chen , Lingjuan Lyu , Shuang Wu , Shouhong Ding , Chao Wu

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

Fast Adversarial Training (FAT) has proven effective in enhancing model robustness by encouraging networks to learn perturbation-invariant representations. However, FAT often suffers from catastrophic overfitting (CO), where the model…

机器学习 · 计算机科学 2026-04-28 Mengnan Zhao , Lihe Zhang , Bo Wang , Tianhang Zheng , Hong Zhong , Geyong Min