中文
相关论文

相关论文: Understanding and Mitigating the Tradeoff Between …

200 篇论文

Adversarial training has been proven to be an effective technique for improving the adversarial robustness of models. However, there seems to be an inherent trade-off between optimizing the model for accuracy and robustness. To this end, we…

计算机视觉与模式识别 · 计算机科学 2020-08-20 Elahe Arani , Fahad Sarfraz , Bahram Zonooz

Deep neural networks can be easily fooled into making incorrect predictions through corruption of the input by adversarial perturbations: human-imperceptible artificial noise. So far adversarial training has been the most successful defense…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Lin Li , Michael Spratling

Recent self-supervision methods have found success in learning feature representations that could rival ones from full supervision, and have been shown to be beneficial to the model in several ways: for example improving models robustness…

计算机视觉与模式识别 · 计算机科学 2021-12-09 Michal Kucer , Diane Oyen , Garrett Kenyon

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

机器学习 · 计算机科学 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Adversarial training is an effective learning technique to improve the robustness of deep neural networks. In this study, the influence of adversarial training on deep learning models in terms of fairness, robustness, and generalization is…

机器学习 · 计算机科学 2023-05-19 Xiaoling Zhou , Nan Yang , Ou Wu

We focus on the robustness of neural networks for classification. To permit a fair comparison between methods to achieve robustness, we first introduce a standard based on the mensuration of a classifier's degradation. Then, we propose…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Sadaf Gulshad , Arnold Smeulders

We introduce a Noise-based prior Learning (NoL) approach for training neural networks that are intrinsically robust to adversarial attacks. We find that the implicit generative modeling of random noise with the same loss function used…

机器学习 · 计算机科学 2019-06-04 Priyadarshini Panda , Kaushik Roy

In adversarial machine learning, deep neural networks can fit the adversarial examples on the training dataset but have poor generalization ability on the test set. This phenomenon is called robust overfitting, and it can be observed when…

机器学习 · 计算机科学 2022-11-01 Jiancong Xiao , Yanbo Fan , Ruoyu Sun , Jue Wang , Zhi-Quan Luo

Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial…

机器学习 · 计算机科学 2024-03-25 André Bertolace , Konstatinos Gatsis , Kostas Margellos

We provide a general framework for characterizing the trade-off between accuracy and robustness in supervised learning. We propose a method and define quantities to characterize the trade-off between accuracy and robustness for a given…

机器学习 · 计算机科学 2025-05-26 Zhun Deng , Cynthia Dwork , Jialiang Wang , Yao Zhao

We study the implicit bias of optimization in robust empirical risk minimization (robust ERM) and its connection with robust generalization. In classification settings under adversarial perturbations with linear models, we study what type…

机器学习 · 计算机科学 2024-06-10 Nikolaos Tsilivis , Natalie Frank , Nathan Srebro , Julia Kempe

Lifted neural networks (i.e. neural architectures explicitly optimizing over respective network potentials to determine the neural activities) can be combined with a type of adversarial training to gain robustness for internal as well as…

机器学习 · 计算机科学 2025-03-12 Christopher Zach

Robust machine learning formulations have emerged to address the prevalent vulnerability of deep neural networks to adversarial examples. Our work draws the connection between optimal robust learning and the privacy-utility tradeoff…

机器学习 · 计算机科学 2021-05-20 Ye Wang , Shuchin Aeron , Adnan Siraj Rakin , Toshiaki Koike-Akino , Pierre Moulin

We analyze the properties of adversarial training for learning adversarially robust halfspaces in the presence of agnostic label noise. Denoting $\mathsf{OPT}_{p,r}$ as the best robust classification error achieved by a halfspace that is…

机器学习 · 计算机科学 2021-04-20 Difan Zou , Spencer Frei , Quanquan Gu

Despite the wide empirical success of modern machine learning algorithms and models in a multitude of applications, they are known to be highly susceptible to seemingly small indiscernible perturbations to the input data known as…

机器学习 · 统计学 2022-04-05 Adel Javanmard , Mahdi Soltanolkotabi

Adversarial training is widely used to improve the robustness of deep neural networks to adversarial attack. However, adversarial training is prone to overfitting, and the cause is far from clear. This work sheds light on the mechanisms…

机器学习 · 计算机科学 2022-12-12 Lin Li , Michael Spratling

Deep neural networks are highly vulnerable to adversarial examples, i.e.,small perturbations that can significantly degrade model performance. While adversarial training has become the primary defense strategy, most studies focus on…

机器学习 · 计算机科学 2026-05-14 Lilin Zhang , Yimo Guo , Yue Li , Jiancheng Shi , Xianggen Liu

Current SOTA adversarially robust models are mostly based on adversarial training (AT) and differ only by some regularizers either at inner maximization or outer minimization steps. Being repetitive in nature during the inner maximization…

机器学习 · 计算机科学 2021-11-02 Anindya Sarkar , Anirban Sarkar , Sowrya Gali , Vineeth N Balasubramanian

Neural Networks have been shown to be sensitive to common perturbations such as blur, Gaussian noise, rotations, etc. They are also vulnerable to some artificial malicious corruptions called adversarial examples. The adversarial examples…

机器学习 · 计算机科学 2019-10-10 Alfred Laugros , Alice Caplier , Matthieu Ospici

Adversarial training may be regarded as standard training with a modified loss function. But its generalization error appears much larger than standard training under standard loss. This phenomenon, known as robust overfitting, has…

机器学习 · 计算机科学 2024-02-13 Runzhi Tian , Yongyi Mao