中文
相关论文

相关论文: Consistency Regularization for Adversarial Robustn…

200 篇论文

Data augmentation has been widely used to improve generalization in training deep neural networks. Recent works show that using worst-case transformations or adversarial augmentation strategies can significantly improve the accuracy and…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Liang Xiao , Jiaolong Xu , Dawei Zhao , Erke Shang , Qi Zhu , Bin Dai

Adversarial data augmentation has shown promise for training robust deep neural networks against unforeseen data shifts or corruptions. However, it is difficult to define heuristics to generate effective fictitious target distributions…

机器学习 · 计算机科学 2020-12-21 Long Zhao , Ting Liu , Xi Peng , Dimitris Metaxas

Recent efforts show that neural networks are vulnerable to small but intentional perturbations on input features in visual classification tasks. Due to the additional consideration of connections between examples (\eg articles with citation…

机器学习 · 计算机科学 2019-12-17 Fuli Feng , Xiangnan He , Jie Tang , Tat-Seng Chua

It is broadly known that deep neural networks are susceptible to being fooled by adversarial examples with perturbations imperceptible by humans. Various defenses have been proposed to improve adversarial robustness, among which adversarial…

机器学习 · 计算机科学 2023-03-30 Wei Wei , Jiahuan Zhou , Ying Wu

Self-ensemble adversarial training methods improve model robustness by ensembling models at different training epochs, such as model weight averaging (WA). However, previous research has shown that self-ensemble defense methods in…

机器学习 · 计算机科学 2024-06-21 Zhaozhe Hu , Jia-Li Yin , Bin Chen , Luojun Lin , Bo-Hao Chen , Ximeng Liu

The vulnerability of neural network classifiers to adversarial attacks is a major obstacle to their deployment in safety-critical applications. Regularization of network parameters during training can be used to improve adversarial…

机器学习 · 计算机科学 2024-05-28 Sheng Yang , Jacob A. Zavatone-Veth , Cengiz Pehlevan

Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which…

机器学习 · 计算机科学 2020-06-17 Yiming Li , Baoyuan Wu , Yan Feng , Yanbo Fan , Yong Jiang , Zhifeng Li , Shutao Xia

Deep neural networks are vulnerable to adversarial noise. Adversarial Training (AT) has been demonstrated to be the most effective defense strategy to protect neural networks from being fooled. However, we find AT omits to learning robust…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Nuoyan Zhou , Nannan Wang , Decheng Liu , Dawei Zhou , Xinbo Gao

Regularization, whether explicit in terms of a penalty in the loss or implicit in the choice of algorithm, is a cornerstone of modern machine learning. Indeed, controlling the complexity of the model class is particularly important when…

机器学习 · 统计学 2024-10-22 Matteo Vilucchio , Nikolaos Tsilivis , Bruno Loureiro , Julia Kempe

Adversarial training is a popular method to robustify models against adversarial attacks. However, it exhibits much more severe overfitting than training on clean inputs. In this work, we investigate this phenomenon from the perspective of…

机器学习 · 计算机科学 2024-12-18 Chen Liu , Zhichao Huang , Mathieu Salzmann , Tong Zhang , Sabine Süsstrunk

We propose a general framework for increasing local stability of Artificial Neural Nets (ANNs) using Robust Optimization (RO). We achieve this through an alternating minimization-maximization procedure, in which the loss of the network is…

机器学习 · 统计学 2018-05-07 Uri Shaham , Yutaro Yamada , Sahand Negahban

Recent studies demonstrate that deep networks, even robustified by the state-of-the-art adversarial training (AT), still suffer from large robust generalization gaps, in addition to the much more expensive training costs than standard…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Tianlong Chen , Zhenyu Zhang , Pengjun Wang , Santosh Balachandra , Haoyu Ma , Zehao Wang , Zhangyang Wang

Adversarial training (AT) is a canonical method for enhancing the robustness of deep neural networks (DNNs). However, recent studies empirically demonstrated that it suffers from robust overfitting, i.e., a long time AT can be detrimental…

机器学习 · 计算机科学 2024-02-06 Shaopeng Fu , Di Wang

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Adversarial training (AT) is an effective technique for enhancing adversarial robustness, but it usually comes at the cost of a decline in generalization ability. Recent studies have attempted to use clean training to assist adversarial…

机器学习 · 计算机科学 2025-04-02 MingWei Zhou , Xiaobing Pei

Adversarial training (AT) has been demonstrated as one of the most promising defense methods against various adversarial attacks. To our knowledge, existing AT-based methods usually train with the locally most adversarial perturbed points…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Chuanbiao Song , Yanbo Fan , Yichen Yang , Baoyuan Wu , Yiming Li , Zhifeng Li , Kun He

Recent works have shown that self-supervised learning can achieve remarkable robustness when integrated with adversarial training (AT). However, the robustness gap between supervised AT (sup-AT) and self-supervised AT (self-AT) remains…

机器学习 · 计算机科学 2023-03-06 Rundong Luo , Yifei Wang , Yisen Wang

Single-step adversarial training (AT) has received wide attention as it proved to be both efficient and robust. However, a serious problem of catastrophic overfitting exists, i.e., the robust accuracy against projected gradient descent…

机器学习 · 计算机科学 2022-03-23 Tao Li , Yingwen Wu , Sizhe Chen , Kun Fang , Xiaolin Huang

Adversarial training (AT) defends deep neural networks against adversarial attacks. One challenge that limits its practical application is the performance degradation on clean samples. A major bottleneck identified by previous works is the…

机器学习 · 计算机科学 2022-07-05 Haotao Wang , Aston Zhang , Shuai Zheng , Xingjian Shi , Mu Li , Zhangyang Wang

Convolutional neural networks are currently the state-of-the-art algorithms for many remote sensing applications such as semantic segmentation or object detection. However, these algorithms are extremely sensitive to over-fitting, domain…

计算机视觉与模式识别 · 计算机科学 2021-05-31 Adrien Chan-Hon-Tong , Gaston Lenczner , Aurelien Plyer