中文
相关论文

相关论文: Lower Difficulty and Better Robustness: A Bregman …

200 篇论文

Adversarial Training (AT) is proposed to alleviate the adversarial vulnerability of machine learning models by extracting only robust features from the input, which, however, inevitably leads to severe accuracy reduction as it discards the…

机器学习 · 统计学 2020-07-06 Yifei Wang , Dan Peng , Furui Liu , Zhenguo Li , Zhitang Chen , Jiansheng Yang

Efforts to address declining accuracy as a result of data shifts often involve various data-augmentation strategies. Adversarial training is one such method, designed to improve robustness to worst-case distribution shifts caused by…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Fatemeh Amerehi , Patrick Healy

Adversarial training based on the minimax formulation is necessary for obtaining adversarial robustness of trained models. However, it is conservative or even pessimistic so that it sometimes hurts the natural generalization. In this paper,…

机器学习 · 计算机科学 2020-09-08 Jingfeng Zhang , Xilie Xu , Bo Han , Gang Niu , Lizhen Cui , Masashi Sugiyama , Mohan Kankanhalli

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique aimed at learning features robust to such attacks and is widely regarded as a very effective defense.…

机器学习 · 计算机科学 2020-09-11 Theodoros Tsiligkaridis , Jay Roberts

Despite the fundamental distinction between adversarial and natural training (AT and NT), AT methods generally adopt momentum SGD (MSGD) for the outer optimization. This paper aims to analyze this choice by investigating the overlooked role…

机器学习 · 计算机科学 2022-09-05 Ali Dabouei , Fariborz Taherkhani , Sobhan Soleymani , Nasser M. Nasrabadi

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches to training robust models against…

机器学习 · 计算机科学 2023-08-09 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Neural retrieval models have acquired significant effectiveness gains over the last few years compared to term-based methods. Nevertheless, those models may be brittle when faced to typos, distribution shifts or vulnerable to malicious…

信息检索 · 计算机科学 2023-01-26 Simon Lupart , Stéphane Clinchant

Noisy labels (NL) and adversarial examples both undermine trained models, but interestingly they have hitherto been studied independently. A recent adversarial training (AT) study showed that the number of projected gradient descent (PGD)…

机器学习 · 计算机科学 2021-02-10 Jianing Zhu , Jingfeng Zhang , Bo Han , Tongliang Liu , Gang Niu , Hongxia Yang , Mohan Kankanhalli , Masashi Sugiyama

Adversarial training (AT) is currently one of the most effective ways to obtain the robustness of deep neural networks against adversarial attacks. However, most AT methods suffer from robust overfitting, i.e., a significant generalization…

机器学习 · 计算机科学 2024-03-15 Daiwei Yu , Zhuorong Li , Lina Wei , Canghong Jin , Yun Zhang , Sixian Chan

Deep networks are well-known to be fragile to adversarial attacks. We conduct an empirical analysis of deep representations under the state-of-the-art attack method called PGD, and find that the attack causes the internal representation to…

机器学习 · 计算机科学 2019-10-29 Chengzhi Mao , Ziyuan Zhong , Junfeng Yang , Carl Vondrick , Baishakhi Ray

While leveraging additional training data is well established to improve adversarial robustness, it incurs the unavoidable cost of data collection and the heavy computation to train models. To mitigate the costs, we propose Guided…

计算机视觉与模式识别 · 计算机科学 2023-05-26 Salah Ghamizi , Jingfeng Zhang , Maxime Cordy , Mike Papadakis , Masashi Sugiyama , Yves Le Traon

Deep Neural Network (DNN) are vulnerable to adversarial attacks. As a countermeasure, adversarial training aims to achieve robustness based on the min-max optimization problem and it has shown to be one of the most effective defense…

计算机视觉与模式识别 · 计算机科学 2022-05-03 Yaxin Li , Xiaorui Liu , Han Xu , Wentao Wang , Jiliang Tang

Deep Neural Networks (DNNs) have shown substantial success in various applications but remain vulnerable to adversarial attacks. This study aims to identify and isolate the components of two different adversarial training techniques that…

机器学习 · 计算机科学 2025-08-26 William Brooks , Marelie H. Davel , Coenraad Mouton

Adversarial training is so far the most effective strategy in defending against adversarial examples. However, it suffers from high computational costs due to the iterative adversarial attacks in each training step. Recent studies show that…

机器学习 · 计算机科学 2022-01-03 Jinghui Chen , Yu Cheng , Zhe Gan , Quanquan Gu , Jingjing Liu

Deep learning achieves state-of-the-art performance in many tasks but exposes to the underlying vulnerability against adversarial examples. Across existing defense techniques, adversarial training with the projected gradient decent attack…

密码学与安全 · 计算机科学 2022-10-04 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

Although adversarial training (AT) has proven effective in enhancing the model's robustness, the recently revealed issue of fairness in robustness has not been well addressed, i.e. the robust accuracy varies significantly among different…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Yanghao Zhang , Tianle Zhang , Ronghui Mu , Xiaowei Huang , Wenjie Ruan

Adversarial Training (AT) is widely recognized as an effective approach to enhance the adversarial robustness of Deep Neural Networks. As a variant of AT, Adversarial Robustness Distillation (ARD) has shown outstanding performance in…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Shiji Zhao , Chi Chen , Ranjie Duan , Xizhe Wang , Xingxing Wei

Adversarial training is a widely-applied approach to training deep neural networks to be robust against adversarial perturbation. However, although adversarial training has achieved empirical success in practice, it still remains unclear…

机器学习 · 计算机科学 2025-02-10 Binghui Li , Yuanzhi Li

Deep learning models are vulnerable to adversarial examples, posing critical security challenges in real-world applications. While Adversarial Training (AT ) is a widely adopted defense mechanism to enhance robustness, it often incurs a…

机器学习 · 计算机科学 2025-09-16 Jing Zou , Shungeng Zhang , Meikang Qiu , Chong Li

Despite the fact that adversarial training has become the de facto method for improving the robustness of deep neural networks, it is well-known that vanilla adversarial training suffers from daunting robust overfitting, resulting in…

机器学习 · 计算机科学 2024-02-06 Tianjin Huang , Shiwei Liu , Tianlong Chen , Meng Fang , Li Shen , Vlaod Menkovski , Lu Yin , Yulong Pei , Mykola Pechenizkiy