中文
相关论文

相关论文: Fast Adversarial Training with Smooth Convergence

200 篇论文

Privacy and security concerns in real-world applications have led to the development of adversarially robust federated models. However, the straightforward combination between adversarial training and federated learning in one framework can…

机器学习 · 计算机科学 2023-03-02 Jianing Zhu , Jiangchao Yao , Tongliang Liu , Quanming Yao , Jianliang Xu , Bo Han

Adversarial training has achieved remarkable advancements in defending against adversarial attacks. Among them, fast adversarial training (FAT) is gaining attention for its ability to achieve competitive robustness with fewer computing…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Chengze Jiang , Junkai Wang , Minjing Dong , Jie Gui , Xinli Shi , Yuan Cao , Yuan Yan Tang , James Tin-Yau Kwok

In the field of adversarial robustness, there is a common practice that adopts the single-step adversarial training for quickly developing adversarially robust models. However, the single-step adversarial training is most likely to cause…

机器学习 · 计算机科学 2021-06-30 Xiaosen Wang , Chuanbiao Song , Liwei Wang , Kun He

Recent studies have shown that, like traditional machine learning, federated learning (FL) is also vulnerable to adversarial attacks. To improve the adversarial robustness of FL, federated adversarial training (FAT) methods have been…

机器学习 · 计算机科学 2023-02-24 Chen Chen , Yuchen Liu , Xingjun Ma , Lingjuan Lyu

A recent line of work focused on making adversarial training computationally efficient for deep learning models. In particular, Wong et al. (2020) showed that $\ell_\infty$-adversarial training with fast gradient sign method (FGSM) can fail…

机器学习 · 计算机科学 2020-10-27 Maksym Andriushchenko , Nicolas Flammarion

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

机器学习 · 计算机科学 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

Adversarial training is so far the most effective strategy in defending against adversarial examples. However, it suffers from high computational costs due to the iterative adversarial attacks in each training step. Recent studies show that…

机器学习 · 计算机科学 2022-01-03 Jinghui Chen , Yu Cheng , Zhe Gan , Quanquan Gu , Jingjing Liu

Despite the fact that adversarial training has become the de facto method for improving the robustness of deep neural networks, it is well-known that vanilla adversarial training suffers from daunting robust overfitting, resulting in…

机器学习 · 计算机科学 2024-02-06 Tianjin Huang , Shiwei Liu , Tianlong Chen , Meng Fang , Li Shen , Vlaod Menkovski , Lu Yin , Yulong Pei , Mykola Pechenizkiy

This paper studies fast adversarial training against sparse adversarial perturbations bounded by $l_0$ norm. We demonstrate the challenges of employing $1$-step attacks on $l_0$ bounded perturbations for fast adversarial training, including…

机器学习 · 计算机科学 2025-11-03 Xuyang Zhong , Yixiao Huang , Chen Liu

Adversarial training enhances neural network robustness but suffers from a tendency to overfit and increased generalization errors on clean data. This work introduces CLAT, an innovative approach that mitigates adversarial overfitting by…

机器学习 · 计算机科学 2024-12-25 Bhavna Gopal , Huanrui Yang , Jingyang Zhang , Mark Horton , Yiran Chen

Adversarial training has been proven to be an effective technique for improving the adversarial robustness of models. However, there seems to be an inherent trade-off between optimizing the model for accuracy and robustness. To this end, we…

计算机视觉与模式识别 · 计算机科学 2020-08-20 Elahe Arani , Fahad Sarfraz , Bahram Zonooz

Adversarial training (AT) has proven to be one of the most effective ways to defend Deep Neural Networks (DNNs) against adversarial attacks. However, the phenomenon of robust overfitting, i.e., the robustness will drop sharply at a certain…

机器学习 · 计算机科学 2022-05-25 Shudong Zhang , Haichang Gao , Tianwei Zhang , Yunyi Zhou , Zihui Wu

Adversarial training and its many variants substantially improve deep network robustness, yet at the cost of compromising standard accuracy. Moreover, the training process is heavy and hence it becomes impractical to thoroughly explore the…

计算机视觉与模式识别 · 计算机科学 2020-11-11 Haotao Wang , Tianlong Chen , Shupeng Gui , Ting-Kuei Hu , Ji Liu , Zhangyang Wang

Adversarial Training (AT) is one of the most effective methods for developing robust deep neural networks (DNNs). However, AT faces a trade-off problem between clean accuracy and adversarial robustness. In this work, we reveal a surprising…

计算机视觉与模式识别 · 计算机科学 2026-04-30 Yanyun Wang , Qingqing Ye , Li Liu , Zi Liang , Haibo Hu

Adversarial training can improve the robustness of neural networks. Previous methods focus on a single adversarial training strategy and do not consider the model property trained by different strategies. By revisiting the previous methods,…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Xingbin Liu , Huafeng Kuang , Xianming Lin , Yongjian Wu , Rongrong Ji

Single-step adversarial training (AT) has received wide attention as it proved to be both efficient and robust. However, a serious problem of catastrophic overfitting exists, i.e., the robust accuracy against projected gradient descent…

机器学习 · 计算机科学 2022-03-23 Tao Li , Yingwen Wu , Sizhe Chen , Kun Fang , Xiaolin Huang

Self-ensemble adversarial training methods improve model robustness by ensembling models at different training epochs, such as model weight averaging (WA). However, previous research has shown that self-ensemble defense methods in…

机器学习 · 计算机科学 2024-06-21 Zhaozhe Hu , Jia-Li Yin , Bin Chen , Luojun Lin , Bo-Hao Chen , Ximeng Liu

Adversarial training for neural networks has been in the limelight in recent years. The advancement in neural network architectures over the last decade has led to significant improvement in their performance. It sparked an interest in…

机器学习 · 计算机科学 2022-06-07 Abhijith Sharma , Apurva Narayan

Deep neural networks are susceptible to adversarial attacks, which can compromise their performance and accuracy. Adversarial Training (AT) has emerged as a popular approach for protecting neural networks against such attacks. However, a…

机器学习 · 计算机科学 2024-02-20 Vijaya Raghavan T Ramkumar , Bahram Zonooz , Elahe Arani

Although fast adversarial training provides an efficient approach for building robust networks, it may suffer from a serious problem known as catastrophic overfitting (CO), where multi-step robust accuracy suddenly collapses to zero. In…

机器学习 · 计算机科学 2023-03-27 Zhengbao He , Tao Li , Sizhe Chen , Xiaolin Huang