中文
相关论文

相关论文: The Effectiveness of Random Forgetting for Robust …

200 篇论文

Although Deep Neural Networks (DNNs) achieve excellent performance on many real-world tasks, they are highly vulnerable to adversarial attacks. A leading defense against such attacks is adversarial training, a technique in which a DNN is…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Gilad Cohen , Raja Giryes

Collective learning methods exploit relations among data points to enhance classification performance. However, such relations, represented as edges in the underlying graphical model, expose an extra attack surface to the adversaries. We…

机器学习 · 计算机科学 2020-07-28 Kai Zhou , Yevgeniy Vorobeychik

Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which…

机器学习 · 计算机科学 2020-06-17 Yiming Li , Baoyuan Wu , Yan Feng , Yanbo Fan , Yong Jiang , Zhifeng Li , Shutao Xia

Adversarial Training (AT), which adversarially perturb the input samples during training, has been acknowledged as one of the most effective defenses against adversarial attacks, yet suffers from inevitably decreased clean accuracy. Instead…

机器学习 · 计算机科学 2024-06-06 Yihao Zhang , Hangzhou He , Jingyu Zhu , Huanran Chen , Yifei Wang , Zeming Wei

Forgetting is often seen as an unwanted characteristic in both human and machine learning. However, we propose that forgetting can in fact be favorable to learning. We introduce "forget-and-relearn" as a powerful paradigm for shaping the…

机器学习 · 计算机科学 2022-02-02 Hattie Zhou , Ankit Vani , Hugo Larochelle , Aaron Courville

The study on improving the robustness of deep neural networks against adversarial examples grows rapidly in recent years. Among them, adversarial training is the most promising one, which flattens the input loss landscape (loss change with…

机器学习 · 计算机科学 2020-10-14 Dongxian Wu , Shu-tao Xia , Yisen Wang

Adversarial Training (AT) has become arguably the state-of-the-art algorithm for extracting robust features. However, researchers recently notice that AT suffers from severe robust overfitting problems, particularly after learning rate (LR)…

机器学习 · 计算机科学 2023-10-31 Yifei Wang , Liangchen Li , Jiansheng Yang , Zhouchen Lin , Yisen Wang

Federated Adversarial Training (FAT) can supplement robustness against adversarial examples to Federated Learning (FL), promoting a meaningful step toward trustworthy AI. However, FAT requires large models to preserve high accuracy while…

机器学习 · 计算机科学 2025-04-16 Minxue Tang , Yitu Wang , Jingyang Zhang , Louis DiValentin , Aolin Ding , Amin Hass , Yiran Chen , Hai "Helen" Li

Despite being widely adopted as a canonical framework for learning robust models, adversarial training suffers from robust overfitting. Existing empirical measures and theoretical explorations are insufficient to provide satisfying…

机器学习 · 计算机科学 2026-03-10 Yuelin Xu , Xiao Zhang

Deep State Space Models (SSMs) have proven effective in numerous task scenarios but face significant security challenges due to Adversarial Perturbations (APs) in real-world deployments. Adversarial Training (AT) is a mainstream approach to…

机器学习 · 计算机科学 2024-10-10 Biqing Qi , Yang Luo , Junqi Gao , Pengfei Li , Kai Tian , Zhiyuan Ma , Bowen Zhou

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

计算与语言 · 计算机科学 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

Though deep neural networks exhibit superior performance on various tasks, they are still plagued by adversarial examples. Adversarial training has been demonstrated to be the most effective method to defend against adversarial attacks.…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Xin Liu , Yichen Yang , Kun He , John E. Hopcroft

Adversarial training (AT) has been considered one of the most effective methods for making deep neural networks robust against adversarial attacks, while the training mechanisms and dynamics of AT remain open research problems. In this…

机器学习 · 计算机科学 2025-06-06 Zeming Wei , Yiwen Guo , Yisen Wang

Human beings are able to master a variety of knowledge and skills with ongoing learning. By contrast, dramatic performance degradation is observed when new tasks are added to an existing neural network model. This phenomenon, termed as…

机器学习 · 计算机科学 2019-10-25 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Artificial neural networks encounter a notable challenge known as continual learning, which involves acquiring knowledge of multiple tasks over an extended period. This challenge arises due to the tendency of previously learned weights to…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Yonatan Sverdlov , Shimon Ullman

Despite significant advancements in active learning and adversarial attacks, the intersection of these two fields remains underexplored, particularly in developing robust active learning frameworks against dynamic adversarial threats. The…

机器学习 · 计算机科学 2024-08-16 Ricky Maulana Fajri , Yulong Pei , Lu Yin , Mykola Pechenizkiy

Fast Adversarial Training (FAT) has proven effective in enhancing model robustness by encouraging networks to learn perturbation-invariant representations. However, FAT often suffers from catastrophic overfitting (CO), where the model…

机器学习 · 计算机科学 2026-04-28 Mengnan Zhao , Lihe Zhang , Bo Wang , Tianhang Zheng , Hong Zhong , Geyong Min

Current deep neural networks (DNNs) are vulnerable to adversarial attacks, where adversarial perturbations to the inputs can change or manipulate classification. To defend against such attacks, an effective and popular approach, known as…

机器学习 · 计算机科学 2022-09-08 Gaoyuan Zhang , Songtao Lu , Yihua Zhang , Xiangyi Chen , Pin-Yu Chen , Quanfu Fan , Lee Martie , Lior Horesh , Mingyi Hong , Sijia Liu

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

机器学习 · 计算机科学 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on both heuristics-driven and data-driven augmentations as a means to reduce…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Sylvestre-Alvise Rebuffi , Sven Gowal , Dan A. Calian , Florian Stimberg , Olivia Wiles , Timothy Mann