中文
相关论文

相关论文: Fast Adversarial Training with Smooth Convergence

200 篇论文

Fast Adversarial Training (FAT) not only improves the model robustness but also reduces the training cost of standard adversarial training. However, fast adversarial training often suffers from Catastrophic Overfitting (CO), which results…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Xiaojun Jia , Yuefeng Chen , Xiaofeng Mao , Ranjie Duan , Jindong Gu , Rong Zhang , Hui Xue , Xiaochun Cao

Fast adversarial training (FAT) is an efficient method to improve robustness. However, the original FAT suffers from catastrophic overfitting, which dramatically and suddenly reduces robustness after a few training epochs. Although various…

机器学习 · 计算机科学 2023-04-07 Xiaojun Jia , Yong Zhang , Xingxing Wei , Baoyuan Wu , Ke Ma , Jue Wang , Xiaochun Cao

Fast Adversarial Training (FAT) has gained increasing attention within the research community owing to its efficacy in improving adversarial robustness. Particularly noteworthy is the challenge posed by catastrophic overfitting (CO) in this…

机器学习 · 计算机科学 2024-02-29 Mengnan Zhao , Lihe Zhang , Yuqiu Kong , Baocai Yin

Many adversarial defense methods have been proposed to enhance the adversarial robustness of natural language processing models. However, most of them introduce additional pre-set linguistic knowledge and assume that the synonym candidates…

计算与语言 · 计算机科学 2024-02-28 Yichen Yang , Xin Liu , Kun He

While adversarial training is an effective defense method against adversarial attacks, it notably increases the training cost. To this end, fast adversarial training (FAT) is presented for efficient training and has become a hot research…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Jie Gui , Chengze Jiang , Minjing Dong , Kun Tong , Xinli Shi , Yuan Yan Tang , Dacheng Tao

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

机器学习 · 计算机科学 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial training (AT) has become an effective defense method against adversarial examples (AEs) and it is typically framed as a bi-level optimization problem. Among various AT methods, fast AT (FAT), which employs a single-step attack…

机器学习 · 计算机科学 2024-07-18 Zhaoxin Wang , Handing Wang , Cong Tian , Yaochu Jin

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of…

机器学习 · 计算机科学 2022-06-07 Zhichao Huang , Yanbo Fan , Chen Liu , Weizhong Zhang , Yong Zhang , Mathieu Salzmann , Sabine Süsstrunk , Jue Wang

There has been a recent surge in single-step adversarial training as it shows robustness and efficiency. However, a phenomenon referred to as ``catastrophic overfitting" has been observed, which is prevalent in single-step defenses and may…

机器学习 · 计算机科学 2022-10-12 Zhuorong Li , Daiwei Yu

Fast Adversarial Training (FAT) has attracted significant attention due to its efficiency in enhancing neural network robustness against adversarial attacks. However, FAT is prone to catastrophic overfitting (CO), wherein models overfit to…

机器学习 · 计算机科学 2026-04-28 Mengnan Zhao , Lihe Zhang , Tianhang Zheng , Bo Wang , Baocai Yin

In adversarial machine learning, deep neural networks can fit the adversarial examples on the training dataset but have poor generalization ability on the test set. This phenomenon is called robust overfitting, and it can be observed when…

机器学习 · 计算机科学 2022-11-01 Jiancong Xiao , Yanbo Fan , Ruoyu Sun , Jue Wang , Zhi-Quan Luo

Although fast adversarial training has demonstrated both robustness and efficiency, the problem of "catastrophic overfitting" has been observed. This is a phenomenon in which, during single-step adversarial training, the robust accuracy…

机器学习 · 计算机科学 2020-12-16 Hoki Kim , Woojin Lee , Jaewook Lee

Current neural-network-based classifiers are susceptible to adversarial examples. The most empirically successful approach to defending against such adversarial examples is adversarial training, which incorporates a strong self-attack…

机器学习 · 计算机科学 2020-06-08 Bai Li , Shiqi Wang , Suman Jana , Lawrence Carin

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique that approximately solves a robust optimization problem to minimize the worst-case loss and is widely…

机器学习 · 计算机科学 2022-03-28 Theodoros Tsiligkaridis , Jay Roberts

Fast adversarial training (FAT) aims to enhance the robustness of models against adversarial attacks with reduced training time, however, FAT often suffers from compromised robustness due to insufficient exploration of adversarial space. In…

机器学习 · 计算机科学 2026-01-21 Euijin You , Hyang-Won Lee

Adversarial Training (AT) has been shown to significantly enhance adversarial robustness via a min-max optimization approach. However, its effectiveness in video recognition tasks is hampered by two main challenges. First, fast adversarial…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Songping Wang , Hanqing Liu , Yueming Lyu , Xiantao Hu , Ziwen He , Wei Wang , Caifeng Shan , Liang Wang

Standard adversarial training approaches suffer from robust overfitting where the robust accuracy decreases when models are adversarially trained for too long. The origin of this problem is still unclear and conflicting explanations have…

机器学习 · 计算机科学 2022-11-28 Muhammad Zaid Hameed , Beat Buesser

Fast adversarial training (FAT) effectively improves the efficiency of standard adversarial training (SAT). However, initial FAT encounters catastrophic overfitting, i.e.,the robust accuracy against adversarial attacks suddenly and…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Xiaojun Jia , Yong Zhang , Xingxing Wei , Baoyuan Wu , Ke Ma , Jue Wang , Xiaochun Cao

Deep neural networks can be easily fooled into making incorrect predictions through corruption of the input by adversarial perturbations: human-imperceptible artificial noise. So far adversarial training has been the most successful defense…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Lin Li , Michael Spratling

Federated Adversarial Training (FAT) can supplement robustness against adversarial examples to Federated Learning (FL), promoting a meaningful step toward trustworthy AI. However, FAT requires large models to preserve high accuracy while…

机器学习 · 计算机科学 2025-04-16 Minxue Tang , Yitu Wang , Jingyang Zhang , Louis DiValentin , Aolin Ding , Amin Hass , Yiran Chen , Hai "Helen" Li
‹ 上一页 1 2 3 10 下一页 ›