English
Related papers

Related papers: Mitigating Error Amplification in Fast Adversarial…

200 papers

Adversarial training (AT) has been demonstrated to be effective in improving model robustness by leveraging adversarial examples for training. However, most AT methods are in face of expensive time and computational cost for calculating…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xiaojun Jia , Yong Zhang , Baoyuan Wu , Jue Wang , Xiaochun Cao

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of…

Machine Learning · Computer Science 2022-06-07 Zhichao Huang , Yanbo Fan , Chen Liu , Weizhong Zhang , Yong Zhang , Mathieu Salzmann , Sabine Süsstrunk , Jue Wang

The robustness of Deep Neural Network models is crucial for defending models against adversarial attacks. Recent defense methods have employed collaborative learning frameworks to enhance model robustness. Two key limitations of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zhenyu Liu , Huizhi Liang , Rajiv Ranjan , Zhanxing Zhu , Vaclav Snasel , Varun Ojha

Although fast adversarial training has demonstrated both robustness and efficiency, the problem of "catastrophic overfitting" has been observed. This is a phenomenon in which, during single-step adversarial training, the robust accuracy…

Machine Learning · Computer Science 2020-12-16 Hoki Kim , Woojin Lee , Jaewook Lee

Despite the remarkable progress of deep neural networks (DNNs) in various visual tasks, their vulnerability to adversarial examples raises significant security concerns. Recent adversarial training methods leverage inverse adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kejia Zhang , Juanjuan Weng , Shaozi Li , Zhiming Luo

Adversarial training (AT) is currently one of the most successful methods to obtain the adversarial robustness of deep neural networks. However, the phenomenon of robust overfitting, i.e., the robustness starts to decrease significantly…

Machine Learning · Computer Science 2021-12-23 Jihoon Tack , Sihyun Yu , Jongheon Jeong , Minseon Kim , Sung Ju Hwang , Jinwoo Shin

Federated Adversarial Training (FAT) can supplement robustness against adversarial examples to Federated Learning (FL), promoting a meaningful step toward trustworthy AI. However, FAT requires large models to preserve high accuracy while…

Machine Learning · Computer Science 2025-04-16 Minxue Tang , Yitu Wang , Jingyang Zhang , Louis DiValentin , Aolin Ding , Amin Hass , Yiran Chen , Hai "Helen" Li

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Deep neural networks are vulnerable to adversarial examples. Adversarial training (AT) is an effective defense against adversarial examples. However, AT is prone to overfitting which degrades robustness substantially. Recently, data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Lin Li , Jianing Qiu , Michael Spratling

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Diffusion Probabilistic Models (DPMs) have achieved significant success in generative tasks. However, their training and sampling processes suffer from the issue of distribution mismatch. During the denoising process, the input data…

Machine Learning · Computer Science 2025-02-25 Zekun Wang , Mingyang Yi , Shuchen Xue , Zhenguo Li , Ming Liu , Bing Qin , Zhi-Ming Ma

Recent studies have shown that robustness to adversarial attacks can be transferred across networks. In other words, we can make a weak model more robust with the help of a strong teacher model. We ask if instead of learning from a static…

Machine Learning · Computer Science 2023-02-13 Jiang Liu , Chun Pong Lau , Hossein Souri , Soheil Feizi , Rama Chellappa

Fault-Aware Training (FAT) has emerged as a highly effective technique for addressing permanent faults in DNN accelerators, as it offers fault mitigation without significant performance or accuracy loss, specifically at low and moderate…

Hardware Architecture · Computer Science 2023-04-26 Muhammad Abdullah Hanif , Muhammad Shafique

Recent studies have shown that, like traditional machine learning, federated learning (FL) is also vulnerable to adversarial attacks. To improve the adversarial robustness of FL, federated adversarial training (FAT) methods have been…

Machine Learning · Computer Science 2023-02-24 Chen Chen , Yuchen Liu , Xingjun Ma , Lingjuan Lyu

The disparity in accuracy between classes in standard training is amplified during adversarial training, a phenomenon termed the robust fairness problem. Existing methodologies aimed to enhance robust fairness by sacrificing the model's…

Machine Learning · Computer Science 2024-01-24 Hyungyu Lee , Saehyung Lee , Hyemi Jang , Junsung Park , Ho Bae , Sungroh Yoon

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on both heuristics-driven and data-driven augmentations as a means to reduce…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Sylvestre-Alvise Rebuffi , Sven Gowal , Dan A. Calian , Florian Stimberg , Olivia Wiles , Timothy Mann

Adversarial training (AT) aims to improve the robustness of deep learning models by mixing clean data and adversarial examples (AEs). Most existing AT approaches can be grouped into restricted and unrestricted approaches. Restricted AT…

Machine Learning · Computer Science 2020-04-14 Haidong Xie , Xueshuang Xiang , Naijin Liu , Bin Dong

Achieving robustness to distributional shift is a longstanding and challenging goal of computer vision. Data augmentation is a commonly used approach for improving robustness, however robustness gains are typically not uniform across…

Machine Learning · Computer Science 2020-09-18 Dong Yin , Raphael Gontijo Lopes , Jonathon Shlens , Ekin D. Cubuk , Justin Gilmer

Adversarial training (AT) has become an effective defense method against adversarial examples (AEs) and it is typically framed as a bi-level optimization problem. Among various AT methods, fast AT (FAT), which employs a single-step attack…

Machine Learning · Computer Science 2024-07-18 Zhaoxin Wang , Handing Wang , Cong Tian , Yaochu Jin

Adversarial training is an effective but time-consuming way to train robust deep neural networks that can withstand strong adversarial attacks. As a response to its inefficiency, we propose Dynamic Efficient Adversarial Training (DEAT),…

Machine Learning · Computer Science 2023-03-15 Fu Wang , Yanghao Zhang , Yanbin Zheng , Wenjie Ruan