中文
相关论文

相关论文: RUSH: Robust Contrastive Learning via Randomized S…

200 篇论文

In this paper, we study fast training of adversarially robust models. From the analyses of the state-of-the-art defense method, i.e., the multi-step adversarial training, we hypothesize that the gradient magnitude links to the model…

计算机视觉与模式识别 · 计算机科学 2019-08-02 Jianyu Wang , Haichao Zhang

We show how to turn any classifier that classifies well under Gaussian noise into a new classifier that is certifiably robust to adversarial perturbations under the $\ell_2$ norm. This "randomized smoothing" technique has been proposed…

机器学习 · 计算机科学 2019-06-18 Jeremy M Cohen , Elan Rosenfeld , J. Zico Kolter

We study the problem of adversarially robust self-supervised learning on graphs. In the contrastive learning framework, we introduce a new method that increases the adversarial robustness of the learned representations through i)…

机器学习 · 计算机科学 2021-02-26 Nikola Jovanović , Zhao Meng , Lukas Faber , Roger Wattenhofer

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Neural networks have changed the way machines interpret the world. At their core, they learn by following gradients, adjusting their parameters step by step until they identify the most discriminant patterns in the data. This process gives…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Samarup Bhattacharya , Anubhab Bhattacharya , Abir Chakraborty

Many state-of-the-art adversarial training methods for deep learning leverage upper bounds of the adversarial loss to provide security guarantees against adversarial attacks. Yet, these methods rely on convex relaxations to propagate lower…

机器学习 · 计算机科学 2023-04-07 Dimitris Bertsimas , Xavier Boix , Kimberly Villalobos Carballo , Dick den Hertog

Deep neural networks are vulnerable to adversarial noise. Adversarial Training (AT) has been demonstrated to be the most effective defense strategy to protect neural networks from being fooled. However, we find AT omits to learning robust…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Nuoyan Zhou , Nannan Wang , Decheng Liu , Dawei Zhou , Xinbo Gao

Adversarial training (AT) is currently one of the most effective ways to obtain the robustness of deep neural networks against adversarial attacks. However, most AT methods suffer from robust overfitting, i.e., a significant generalization…

机器学习 · 计算机科学 2024-03-15 Daiwei Yu , Zhuorong Li , Lina Wei , Canghong Jin , Yun Zhang , Sixian Chan

Adversarial training can considerably robustify deep neural networks to resist adversarial attacks. However, some works suggested that adversarial training might comprise the privacy-preserving and generalization abilities. This paper…

机器学习 · 计算机科学 2020-12-29 Fengxiang He , Shaopeng Fu , Bohan Wang , Dacheng Tao

The robustness of deep neural networks is usually lacking under adversarial examples, common corruptions, and distribution shifts, which becomes an important research problem in the development of deep learning. Although new deep learning…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Chang Liu , Yinpeng Dong , Wenzhao Xiang , Xiao Yang , Hang Su , Jun Zhu , Yuefeng Chen , Yuan He , Hui Xue , Shibao Zheng

It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to…

机器学习 · 计算机科学 2019-12-23 Jinyuan Jia , Xiaoyu Cao , Binghui Wang , Neil Zhenqiang Gong

Fast adversarial training (FAT) is beneficial for improving the adversarial robustness of neural networks. However, previous FAT work has encountered a significant issue known as catastrophic overfitting when dealing with large perturbation…

机器学习 · 计算机科学 2023-08-25 Mengnan Zhao , Lihe Zhang , Yuqiu Kong , Baocai Yin

Recent work has developed methods for learning deep network classifiers that are provably robust to norm-bounded adversarial perturbation; however, these methods are currently only possible for relatively small feedforward networks. In this…

机器学习 · 计算机科学 2018-11-26 Eric Wong , Frank R. Schmidt , Jan Hendrik Metzen , J. Zico Kolter

Adversarially robust learning aims to design algorithms that are robust to small adversarial perturbations on input variables. Beyond the existing studies on the predictive performance to adversarial samples, our goal is to understand…

机器学习 · 统计学 2020-12-21 Yue Xing , Ruizhi Zhang , Guang Cheng

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

Adversarial Training (AT) is one of the most effective methods to train robust Deep Neural Networks (DNNs). However, AT creates an inherent trade-off between clean accuracy and adversarial robustness, which is commonly attributed to the…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Yanyun Wang , Li Liu

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

机器学习 · 计算机科学 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

Efforts to address declining accuracy as a result of data shifts often involve various data-augmentation strategies. Adversarial training is one such method, designed to improve robustness to worst-case distribution shifts caused by…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Fatemeh Amerehi , Patrick Healy

Classical adversarial training (AT) frameworks are designed to achieve high adversarial accuracy against a single attack type, typically $\ell_\infty$ norm-bounded perturbations. Recent extensions in AT have focused on defending against the…

机器学习 · 计算机科学 2021-06-15 Ameya D. Patil , Michael Tuttle , Alexander G. Schwing , Naresh R. Shanbhag

We propose a principled framework that combines adversarial training and provable robustness verification for training certifiably robust neural networks. We formulate the training problem as a joint optimization problem with both empirical…

机器学习 · 计算机科学 2021-06-08 Jiameng Fan , Wenchao Li