中文
相关论文

相关论文: Understanding Robust Overfitting of Adversarial Tr…

200 篇论文

Training machine learning models that are robust against adversarial inputs poses seemingly insurmountable challenges. To better understand adversarial robustness, we consider the underlying problem of learning robust representations. We…

机器学习 · 计算机科学 2020-07-07 Sicheng Zhu , Xiao Zhang , David Evans

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

机器学习 · 计算机科学 2020-08-13 Alex Serban , Erik Poll , Joost Visser

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

机器学习 · 计算机科学 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Adversarial training has become the primary method to defend against adversarial samples. However, it is hard to practically apply due to many shortcomings. One of the shortcomings of adversarial training is that it will reduce the…

机器学习 · 计算机科学 2021-08-31 Zhishen Nie , Ying Lin , Sp Ren , Lan Zhang

Despite their impressive capabilities, Multimodal Large Language Models (MLLMs) exhibit perceptual fragility when confronted with visually complex scenes. This weakness stems from a reliance on finite training datasets, which are…

机器学习 · 计算机科学 2026-03-05 Yicheng Bao , Xuhong Wang , Qiaosheng Zhang , Chaochao Lu , Xia Hu , Xin Tan

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

Adversarial training has been widely studied in recent years due to its role in improving model robustness against adversarial attacks. This paper focuses on comparing different distributed adversarial training algorithms--including…

机器学习 · 计算机科学 2025-09-16 Ying Cao , Kun Yuan , Ali H. Sayed

Despite the remarkable progress of deep neural networks (DNNs) in various visual tasks, their vulnerability to adversarial examples raises significant security concerns. Recent adversarial training methods leverage inverse adversarial…

计算机视觉与模式识别 · 计算机科学 2025-07-10 Kejia Zhang , Juanjuan Weng , Shaozi Li , Zhiming Luo

While deep learning has led to remarkable results on a number of challenging problems, researchers have discovered a vulnerability of neural networks in adversarial settings, where small but carefully chosen perturbations to the input can…

神经与进化计算 · 计算机科学 2018-11-26 Edward Grefenstette , Robert Stanforth , Brendan O'Donoghue , Jonathan Uesato , Grzegorz Swirszcz , Pushmeet Kohli

Machine learning classifiers with high test accuracy often perform poorly under adversarial attacks. It is commonly believed that adversarial training alleviates this issue. In this paper, we demonstrate that, surprisingly, the opposite may…

机器学习 · 计算机科学 2022-03-30 Jacob Clarysse , Julia Hörrmann , Fanny Yang

Historically, machine learning methods have not been designed with security in mind. In turn, this has given rise to adversarial examples, carefully perturbed input samples aimed to mislead detection at test time, which have been applied to…

机器学习 · 计算机科学 2022-01-11 Jamie Hayes

Adversarial training (AT) with projected gradient descent is the most popular method to improve model robustness under adversarial attacks. However, computational overheads become prohibitively large when AT is applied to large backbone…

机器学习 · 计算机科学 2025-08-26 Quanwei Wu , Jun Guo , Wei Wang , Yi Wang

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

机器学习 · 计算机科学 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

The easiness at which adversarial instances can be generated in deep neural networks raises some fundamental questions on their functioning and concerns on their use in critical systems. In this paper, we draw a connection between…

机器学习 · 计算机科学 2018-03-02 Mahdieh Abbasi , Christian Gagné

Existing works have shown that fine-tuned textual transformer models achieve state-of-the-art prediction performances but are also vulnerable to adversarial text perturbations. Traditional adversarial evaluation is often done \textit{only…

机器学习 · 计算机科学 2024-07-03 Cuong Dang , Dung D. Le , Thai Le

Recent studies demonstrate that deep networks, even robustified by the state-of-the-art adversarial training (AT), still suffer from large robust generalization gaps, in addition to the much more expensive training costs than standard…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Tianlong Chen , Zhenyu Zhang , Pengjun Wang , Santosh Balachandra , Haoyu Ma , Zehao Wang , Zhangyang Wang

The vulnerability of deep neural networks (DNNs) to adversarial attack, which is an attack that can mislead state-of-the-art classifiers into making an incorrect classification with high confidence by deliberately perturbing the original…

机器学习 · 计算机科学 2021-06-18 Lina Wang , Rui Tang , Yawei Yue , Xingshu Chen , Wei Wang , Yi Zhu , Xuemei Zeng

Recent works have shown theoretically and empirically that redundant data dimensions are a source of adversarial vulnerability. However, the inverse doesn't seem to hold in practice; employing dimension-reduction techniques doesn't exhibit…

机器学习 · 统计学 2024-10-10 Rajdeep Haldar , Yue Xing , Qifan Song , Guang Lin

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

机器学习 · 计算机科学 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…