中文
相关论文

相关论文: Explicit Tradeoffs between Adversarial and Natural…

200 篇论文

We study the difficulties in learning that arise from robust and differentially private optimization. We first study convergence of gradient descent based adversarial training with differential privacy, taking a simple binary classification…

机器学习 · 计算机科学 2022-01-10 Jamie Hayes , Borja Balle , M. Pawan Kumar

This work investigates adversarial training in the context of margin-based linear classifiers in the high-dimensional regime where the dimension $d$ and the number of data points $n$ diverge with a fixed ratio $\alpha = n / d$. We introduce…

机器学习 · 统计学 2026-01-13 Kasimir Tanner , Matteo Vilucchio , Bruno Loureiro , Florent Krzakala

Deep neural networks have been demonstrated to be vulnerable to adversarial noise, promoting the development of defense against adversarial attacks. Motivated by the fact that adversarial noise contains well-generalizing features and that…

机器学习 · 计算机科学 2022-07-19 Dawei Zhou , Nannan Wang , Bo Han , Tongliang Liu

Neural Networks have been shown to be sensitive to common perturbations such as blur, Gaussian noise, rotations, etc. They are also vulnerable to some artificial malicious corruptions called adversarial examples. The adversarial examples…

机器学习 · 计算机科学 2019-10-10 Alfred Laugros , Alice Caplier , Matthieu Ospici

Deep neural classifiers tend to rely on spurious correlations between spurious attributes of inputs and targets to make predictions, which could jeopardize their generalization capability. Training classifiers robust to spurious…

机器学习 · 计算机科学 2024-05-07 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Recent works have shown theoretically and empirically that redundant data dimensions are a source of adversarial vulnerability. However, the inverse doesn't seem to hold in practice; employing dimension-reduction techniques doesn't exhibit…

机器学习 · 统计学 2024-10-10 Rajdeep Haldar , Yue Xing , Qifan Song , Guang Lin

While it has long been empirically observed that adversarial robustness may be at odds with standard accuracy and may have further disparate impacts on different classes, it remains an open question to what extent such observations hold and…

机器学习 · 计算机科学 2023-05-30 Yuzheng Hu , Fan Wu , Hongyang Zhang , Han Zhao

We introduce a Noise-based prior Learning (NoL) approach for training neural networks that are intrinsically robust to adversarial attacks. We find that the implicit generative modeling of random noise with the same loss function used…

机器学习 · 计算机科学 2019-06-04 Priyadarshini Panda , Kaushik Roy

Adversarial attacks have been proven to be potential threats to Deep Neural Networks (DNNs), and many methods are proposed to defend against adversarial attacks. However, while enhancing the robustness, the clean accuracy will decline to a…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Xingxing Wei , Shiji Zhao , Bo li

Adversarial robustness measures the susceptibility of a classifier to imperceptible perturbations made to the inputs at test time. In this work we highlight the benefits of natural low rank representations that often exist for real data…

机器学习 · 计算机科学 2020-08-04 Pranjal Awasthi , Himanshu Jain , Ankit Singh Rawat , Aravindan Vijayaraghavan

Adversarial training is a powerful type of defense against adversarial examples. Previous empirical results suggest that adversarial training requires wider networks for better performances. However, it remains elusive how neural network…

机器学习 · 计算机科学 2021-08-17 Boxi Wu , Jinghui Chen , Deng Cai , Xiaofei He , Quanquan Gu

Recent studies on the adversarial vulnerability of neural networks have shown that models trained to be more robust to adversarial attacks exhibit more interpretable saliency maps than their non-robust counterparts. We aim to quantify this…

机器学习 · 统计学 2019-05-13 Christian Etmann , Sebastian Lunz , Peter Maass , Carola-Bibiane Schönlieb

Adversarial training can improve the robustness of neural networks. Previous methods focus on a single adversarial training strategy and do not consider the model property trained by different strategies. By revisiting the previous methods,…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Xingbin Liu , Huafeng Kuang , Xianming Lin , Yongjian Wu , Rongrong Ji

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

机器学习 · 计算机科学 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

As machine learning models are increasingly being employed in various high-stakes settings, it becomes important to ensure that predictions of these models are not only adversarially robust, but also readily explainable to relevant…

机器学习 · 计算机科学 2024-07-25 Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

Adversarial training is by far the most successful strategy for improving robustness of neural networks to adversarial attacks. Despite its success as a defense mechanism, adversarial training fails to generalize well to unperturbed test…

机器学习 · 计算机科学 2019-10-18 Yogesh Balaji , Tom Goldstein , Judy Hoffman

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Adversarial attacks have received increasing attention and it has been widely recognized that classical DNNs have weak adversarial robustness. The most commonly used adversarial defense method, adversarial training, improves the adversarial…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Nuolin Sun , Linyuan Wang , Dongyang Li , Bin Yan , Lei Li

Neural network robustness has recently been highlighted by the existence of adversarial examples. Many previous works show that the learned networks do not perform well on perturbed test data, and significantly more labeled data is required…

机器学习 · 计算机科学 2019-09-27 Runtian Zhai , Tianle Cai , Di He , Chen Dan , Kun He , John Hopcroft , Liwei Wang

Pre-training is known to generate universal representations for downstream tasks in large-scale deep learning such as large language models. Existing literature, e.g., \cite{kim2020adversarial}, empirically observe that the downstream tasks…

机器学习 · 计算机科学 2024-01-30 Yue Xing , Xiaofeng Lin , Qifan Song , Yi Xu , Belinda Zeng , Guang Cheng