中文
相关论文

相关论文: Make Some Noise: Reliable and Efficient Single-Ste…

200 篇论文

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of…

机器学习 · 计算机科学 2022-06-07 Zhichao Huang , Yanbo Fan , Chen Liu , Weizhong Zhang , Yong Zhang , Mathieu Salzmann , Sabine Süsstrunk , Jue Wang

The progress in the last decade has enabled machine learning models to achieve impressive performance across a wide range of tasks in Computer Vision. However, a plethora of works have demonstrated the susceptibility of these models to…

机器学习 · 计算机科学 2020-02-06 B. S. Vivek , R. Venkatesh Babu

Fast adversarial training (FAT) effectively improves the efficiency of standard adversarial training (SAT). However, initial FAT encounters catastrophic overfitting, i.e.,the robust accuracy against adversarial attacks suddenly and…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Xiaojun Jia , Yong Zhang , Xingxing Wei , Baoyuan Wu , Ke Ma , Jue Wang , Xiaochun Cao

Single-step adversarial training (AT) has received wide attention as it proved to be both efficient and robust. However, a serious problem of catastrophic overfitting exists, i.e., the robust accuracy against projected gradient descent…

机器学习 · 计算机科学 2022-03-23 Tao Li , Yingwen Wu , Sizhe Chen , Kun Fang , Xiaolin Huang

Fast Adversarial Training (FAT) has attracted significant attention due to its efficiency in enhancing neural network robustness against adversarial attacks. However, FAT is prone to catastrophic overfitting (CO), wherein models overfit to…

机器学习 · 计算机科学 2026-04-28 Mengnan Zhao , Lihe Zhang , Tianhang Zheng , Bo Wang , Baocai Yin

Fast adversarial training (FAT) is an efficient method to improve robustness. However, the original FAT suffers from catastrophic overfitting, which dramatically and suddenly reduces robustness after a few training epochs. Although various…

机器学习 · 计算机科学 2023-04-07 Xiaojun Jia , Yong Zhang , Xingxing Wei , Baoyuan Wu , Ke Ma , Jue Wang , Xiaochun Cao

Catastrophic overfitting (CO) presents a significant challenge in single-step adversarial training (AT), manifesting as highly distorted deep neural networks (DNNs) that are vulnerable to multi-step adversarial attacks. However, the…

机器学习 · 计算机科学 2024-09-17 Runqi Lin , Chaojian Yu , Bo Han , Hang Su , Tongliang Liu

Up to now, the training processes of typical Generative Adversarial Networks (GANs) are still particularly sensitive to data properties and hyperparameters, which may lead to severe oscillations, difficulties in convergence, or even…

机器学习 · 计算机科学 2025-04-22 Lin Wang , Xiancheng Wang , Rui Wang , Zhibo Zhang , Minghang Zhao

Adversarial training (AT) with samples generated by Fast Gradient Sign Method (FGSM), also known as FGSM-AT, is a computationally simple method to train robust networks. However, during its training procedure, an unstable mode of…

计算机视觉与模式识别 · 计算机科学 2022-09-07 Zichao Li , Li Liu , Zeyu Wang , Yuyin Zhou , Cihang Xie

Adversarial learning has emerged as one of the successful techniques to circumvent the susceptibility of existing methods against adversarial perturbations. However, the majority of existing defense methods are tailored to defend against a…

机器学习 · 计算机科学 2021-06-28 Divyam Madaan , Jinwoo Shin , Sung Ju Hwang

Adversarial noise introduces small perturbations in images, misleading deep learning models into misclassification and significantly impacting recognition accuracy. In this study, we analyzed the effects of Fast Gradient Sign Method (FGSM)…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Manish Kansana , Keyan Alexander Rahimi , Elias Hossain , Iman Dehzangi , Noorbakhsh Amiri Golilarz

Neural retrieval models have acquired significant effectiveness gains over the last few years compared to term-based methods. Nevertheless, those models may be brittle when faced to typos, distribution shifts or vulnerable to malicious…

信息检索 · 计算机科学 2023-01-26 Simon Lupart , Stéphane Clinchant

Even though deep neural networks succeed on many different tasks including semantic segmentation, they lack on robustness against adversarial examples. To counteract this exploit, often adversarial training is used. However, it is known…

计算机视觉与模式识别 · 计算机科学 2021-07-01 Daniel Wiens , Barbara Hammer

Noisy labels (NL) and adversarial examples both undermine trained models, but interestingly they have hitherto been studied independently. A recent adversarial training (AT) study showed that the number of projected gradient descent (PGD)…

机器学习 · 计算机科学 2021-02-10 Jianing Zhu , Jingfeng Zhang , Bo Han , Tongliang Liu , Gang Niu , Hongxia Yang , Mohan Kankanhalli , Masashi Sugiyama

Catastrophic overfitting is a phenomenon observed during Adversarial Training (AT) with the Fast Gradient Sign Method (FGSM) where the test robustness steeply declines over just one epoch in the training stage. Prior work has attributed…

机器学习 · 计算机科学 2021-11-23 Varun Sivashankar , Nikil Selvam

Adversarial examples have become one of the largest challenges that machine learning models, especially neural network classifiers, face. These adversarial examples break the assumption of attack-free scenario and fool state-of-the-art…

机器学习 · 计算机科学 2020-02-28 Guanxiong Liu , Issa Khalil , Abdallah Khreishah

Adversarial attacks in machine learning traditionally focus on global perturbations to input data, yet the potential of localized adversarial noise remains underexplored. This study systematically evaluates localized adversarial attacks…

机器学习 · 计算机科学 2025-09-30 Pavan Reddy , Aditya Sanjay Gujral

Improving the robustness of deep neural networks (DNNs) to adversarial examples is an important yet challenging problem for secure deep learning. Across existing defense techniques, adversarial training with Projected Gradient Decent (PGD)…

机器学习 · 计算机科学 2022-04-26 Yisen Wang , Xingjun Ma , James Bailey , Jinfeng Yi , Bowen Zhou , Quanquan Gu

Adversarial training is arguably the most popular way to provide empirical robustness against specific adversarial examples. While variants based on multi-step attacks incur significant computational overhead, single-step variants are…

机器学习 · 计算机科学 2025-03-25 Alessandro De Palma , Serge Durand , Zakaria Chihani , François Terrier , Caterina Urban

Consistency training regularizes a model by enforcing predictions of original and perturbed inputs to be similar. Previous studies have proposed various augmentation methods for the perturbation but are limited in that they are agnostic to…

计算与语言 · 计算机科学 2022-04-29 Jungsoo Park , Gyuwan Kim , Jaewoo Kang