中文
相关论文

相关论文: Fast Adversarial Training against Sparse Attacks R…

200 篇论文

While multi-step adversarial training is widely popular as an effective defense method against strong adversarial attacks, its computational cost is notoriously expensive, compared to standard training. Several single-step adversarial…

机器学习 · 计算机科学 2021-11-30 Geon Yeong Park , Sang Wan Lee

Adversarial training (AT) has become an effective defense method against adversarial examples (AEs) and it is typically framed as a bi-level optimization problem. Among various AT methods, fast AT (FAT), which employs a single-step attack…

机器学习 · 计算机科学 2024-07-18 Zhaoxin Wang , Handing Wang , Cong Tian , Yaochu Jin

This paper investigates a family of methods for defending against adversarial attacks that owe part of their success to creating a noisy, discontinuous, or otherwise rugged loss landscape that adversaries find difficult to navigate. A…

机器学习 · 计算机科学 2022-08-08 Panagiotis Eustratiadis , Henry Gouk , Da Li , Timothy Hospedales

Deep neural networks can be easily fooled into making incorrect predictions through corruption of the input by adversarial perturbations: human-imperceptible artificial noise. So far adversarial training has been the most successful defense…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Lin Li , Michael Spratling

Up to now, the training processes of typical Generative Adversarial Networks (GANs) are still particularly sensitive to data properties and hyperparameters, which may lead to severe oscillations, difficulties in convergence, or even…

机器学习 · 计算机科学 2025-04-22 Lin Wang , Xiancheng Wang , Rui Wang , Zhibo Zhang , Minghang Zhao

Neural networks have been proven to be vulnerable to a variety of adversarial attacks. From a safety perspective, highly sparse adversarial attacks are particularly dangerous. On the other hand the pixelwise perturbations of sparse attacks…

机器学习 · 计算机科学 2019-09-12 Francesco Croce , Matthias Hein

Overfitting widely exists in adversarial robust training of deep networks. An effective remedy is adversarial weight perturbation, which injects the worst-case weight perturbation during network training by maximizing the classification…

机器学习 · 计算机科学 2022-05-31 Chaojian Yu , Bo Han , Mingming Gong , Li Shen , Shiming Ge , Bo Du , Tongliang Liu

In the field of adversarial robustness, there is a common practice that adopts the single-step adversarial training for quickly developing adversarially robust models. However, the single-step adversarial training is most likely to cause…

机器学习 · 计算机科学 2021-06-30 Xiaosen Wang , Chuanbiao Song , Liwei Wang , Kun He

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique that approximately solves a robust optimization problem to minimize the worst-case loss and is widely…

机器学习 · 计算机科学 2022-03-28 Theodoros Tsiligkaridis , Jay Roberts

Adversarial training has shown promise in building robust models against adversarial examples. A major drawback of adversarial training is the computational overhead introduced by the generation of adversarial examples. To overcome this…

计算机视觉与模式识别 · 计算机科学 2023-10-25 Xiaojun Jia , Jianshu Li , Jindong Gu , Yang Bai , Xiaochun Cao

Deep Neural Networks have demonstrated remarkable success in various domains but remain susceptible to adversarial examples, which are slightly altered inputs designed to induce misclassification. While adversarial attacks typically…

机器学习 · 计算机科学 2024-08-29 Weiyou Liu , Zhenyang Li , Weitong Chen

Adversarial training is wildly considered as one of the most effective way to defend against adversarial examples. However, existing adversarial training methods consume unbearable time, due to the fact that they need to generate…

机器学习 · 计算机科学 2021-03-10 Yaguan Qian , Qiqi Shao , Tengteng Yao , Bin Wang , Shouling Ji , Shaoning Zeng , Zhaoquan Gu , Wassim Swaileh

Catastrophic overfitting (CO) in single-step adversarial training (AT) results in abrupt drops in the adversarial test accuracy (even down to 0%). For models trained with multi-step AT, it has been observed that the loss function behaves…

机器学习 · 计算机科学 2024-02-29 Elias Abad Rocamora , Fanghui Liu , Grigorios G. Chrysos , Pablo M. Olmos , Volkan Cevher

We show that label noise exists in adversarial training. Such label noise is due to the mismatch between the true label distribution of adversarial examples and the label inherited from clean examples - the true label distribution is…

机器学习 · 计算机科学 2023-10-17 Chengyu Dong , Liyuan Liu , Jingbo Shang

Many adversarial defense methods have been proposed to enhance the adversarial robustness of natural language processing models. However, most of them introduce additional pre-set linguistic knowledge and assume that the synonym candidates…

计算与语言 · 计算机科学 2024-02-28 Yichen Yang , Xin Liu , Kun He

While adversarial training is an effective defense method against adversarial attacks, it notably increases the training cost. To this end, fast adversarial training (FAT) is presented for efficient training and has become a hot research…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Jie Gui , Chengze Jiang , Minjing Dong , Kun Tong , Xinli Shi , Yuan Yan Tang , Dacheng Tao

Recent studies demonstrate that deep networks, even robustified by the state-of-the-art adversarial training (AT), still suffer from large robust generalization gaps, in addition to the much more expensive training costs than standard…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Tianlong Chen , Zhenyu Zhang , Pengjun Wang , Santosh Balachandra , Haoyu Ma , Zehao Wang , Zhangyang Wang

Despite the remarkable success achieved by deep learning algorithms in various domains, such as computer vision, they remain vulnerable to adversarial perturbations. Adversarial Training (AT) stands out as one of the most effective…

Reinforcement learning (RL) training is inherently unstable due to factors such as moving targets and high gradient variance. Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning from AI Feedback (RLAIF) can…

机器学习 · 计算机科学 2025-06-24 Ju-Seung Byun , Andrew Perrault

Adversarial training is actively studied for learning robust models against adversarial examples. A recent study finds that adversarially trained models degenerate generalization performance on adversarial examples when their weight loss…