中文
相关论文

相关论文: Revisiting the Relationship between Adversarial an…

200 篇论文

Adversarial training has been empirically proven to be one of the most effective and reliable defense methods against adversarial attacks. However, almost all existing studies about adversarial training are focused on balanced datasets,…

机器学习 · 计算机科学 2021-07-30 Wentao Wang , Han Xu , Xiaorui Liu , Yaxin Li , Bhavani Thuraisingham , Jiliang Tang

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

机器学习 · 计算机科学 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial training (AT) is one of the most reliable methods for defending against adversarial attacks in machine learning. Variants of this method have been used as regularization mechanisms to achieve SOTA results on NLP benchmarks, and…

计算与语言 · 计算机科学 2021-09-30 Javid Ebrahimi , Hao Yang , Wei Zhang

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

机器学习 · 计算机科学 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

We introduce a feature scattering-based adversarial training approach for improving model robustness against adversarial attacks. Conventional adversarial training approaches leverage a supervised scheme (either targeted or non-targeted) in…

计算机视觉与模式识别 · 计算机科学 2019-11-25 Haichao Zhang , Jianyu Wang

Adversarial training is the most effective method to obtain adversarial robustness for deep neural networks by directly involving adversarial samples in the training procedure. To obtain an accurate and robust model, the weighted-average…

机器学习 · 计算机科学 2024-10-23 Zhiyu Xue , Haohan Wang , Yao Qin , Ramtin Pedarsani

In this paper, we investigate on improving the adversarial robustness obtained in adversarial training (AT) via reducing the difficulty of optimization. To better study this problem, we build a novel Bregman divergence perspective for AT,…

机器学习 · 计算机科学 2024-01-08 Zihui Wu , Haichang Gao , Bingqian Zhou , Xiaoyan Guo , Shudong Zhang

Adversarial training (AT) has become the de-facto standard to obtain models robust against adversarial examples. However, AT exhibits severe robust overfitting: cross-entropy loss on adversarial examples, so-called robust loss, decreases…

机器学习 · 计算机科学 2021-10-07 David Stutz , Matthias Hein , Bernt Schiele

In the future, powerful AI systems may be deployed in high-stakes settings, where a single failure could be catastrophic. One technique for improving AI safety in high-stakes settings is adversarial training, which uses an adversary to…

Adversarial training yields robust models against a specific threat model, e.g., $L_\infty$ adversarial examples. Typically robustness does not generalize to previously unseen threat models, e.g., other $L_p$ norms, or larger perturbations.…

机器学习 · 计算机科学 2020-07-01 David Stutz , Matthias Hein , Bernt Schiele

Adversarial training is an important topic in robust deep learning, but the community lacks attention to its practical usage. In this paper, we aim to resolve a real-world challenge, i.e., training a model on an imbalanced and noisy dataset…

机器学习 · 计算机科学 2023-12-05 Guanlin Li , Kangjie Chen , Yuan Xu , Han Qiu , Tianwei Zhang

Adversarial training and its many variants substantially improve deep network robustness, yet at the cost of compromising standard accuracy. Moreover, the training process is heavy and hence it becomes impractical to thoroughly explore the…

计算机视觉与模式识别 · 计算机科学 2020-11-11 Haotao Wang , Tianlong Chen , Shupeng Gui , Ting-Kuei Hu , Ji Liu , Zhangyang Wang

The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the…

机器学习 · 计算机科学 2023-10-05 Matan Levi , Aryeh Kontorovich

Vision Transformers (ViTs) have recently achieved competitive performance in broad vision tasks. Unfortunately, on popular threat models, naturally trained ViTs are shown to provide no more adversarial robustness than convolutional neural…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Yichuan Mo , Dongxian Wu , Yifei Wang , Yiwen Guo , Yisen Wang

Meta-learning model can quickly adapt to new tasks using few-shot labeled data. However, despite achieving good generalization on few-shot classification tasks, it is still challenging to improve the adversarial robustness of the…

机器学习 · 计算机科学 2021-07-02 Fan Liu , Shuyu Zhao , Xuelong Dai , Bin Xiao

Vision Transformer (ViT) models have achieved remarkable performance across various vision tasks, with scalability being a key advantage when applied to large datasets. This scalability enables ViT models to exhibit strong generalization…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Wenyun Li , Zheng Zhang , Dongmei Jiang , Yaowei Wang , Xiangyuan Lan

Although adversarial training (AT) has proven effective in enhancing the model's robustness, the recently revealed issue of fairness in robustness has not been well addressed, i.e. the robust accuracy varies significantly among different…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Yanghao Zhang , Tianle Zhang , Ronghui Mu , Xiaowei Huang , Wenjie Ruan

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

机器学习 · 计算机科学 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Adversarial training is a training scheme designed to counter adversarial attacks by augmenting the training dataset with adversarial examples. Surprisingly, several studies have observed that loss gradients from adversarially trained DNNs…

机器学习 · 计算机科学 2019-04-22 Beomsu Kim , Junghoon Seo , Taegyun Jeon

Sharpness-Aware Minimization (SAM) is an effective method for improving generalization ability by regularizing loss sharpness. In this paper, we explore SAM in the context of adversarial robustness. We find that using only SAM can achieve…

机器学习 · 计算机科学 2023-07-04 Zeming Wei , Jingyu Zhu , Yihao Zhang