中文
相关论文

相关论文: Adversarially robust generalization theory via Jac…

200 篇论文

Neural networks have been shown to be vulnerable against minor adversarial perturbations of their inputs, especially for high dimensional data under $\ell_\infty$ attacks. To combat this problem, techniques like adversarial training have…

机器学习 · 计算机科学 2019-06-04 Emilio Rafael Balda , Arash Behboodi , Niklas Koep , Rudolf Mathar

Deep neural networks are vulnerable to adversarial attacks. Ideally, a robust model shall perform well on both the perturbed training data and the unseen perturbed test data. It is found empirically that fitting perturbed training data is…

机器学习 · 计算机科学 2022-11-29 Jiancong Xiao , Yanbo Fan , Ruoyu Sun , Zhi-Quan Luo

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

机器学习 · 计算机科学 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

We consider a model of robust learning in an adversarial environment. The learner gets uncorrupted training data with access to possible corruptions that may be affected by the adversary during testing. The learner's goal is to build a…

机器学习 · 计算机科学 2022-07-04 Idan Attias , Aryeh Kontorovich , Yishay Mansour

Recently, there has been an abundance of works on designing Deep Neural Networks (DNNs) that are robust to adversarial examples. In particular, a central question is which features of DNNs influence adversarial robustness and, therefore,…

机器学习 · 计算机科学 2021-10-07 Peter Langenberg , Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

The adversarial vulnerability of deep neural networks (DNNs) has been actively investigated in the past several years. This paper investigates the scale-variant property of cross-entropy loss, which is the most commonly used loss function…

机器学习 · 计算机科学 2022-10-12 Ziquan Liu , Antoni B. Chan

Recent work have demonstrated that robustness (to "corruption") can be at odds with generalization. Adversarial training, for instance, aims to reduce the problematic susceptibility of modern neural networks to small data perturbations.…

机器学习 · 统计学 2023-05-19 Amine Bennouna , Ryan Lucas , Bart Van Parys

We address the problem of enhancing model robustness through regularization. Specifically, we focus on methods that regularize the model posterior difference between clean and noisy inputs. Theoretically, we provide a connection of two…

计算与语言 · 计算机科学 2021-04-13 Hao Cheng , Xiaodong Liu , Lis Pereira , Yaoliang Yu , Jianfeng Gao

Despite remarkable success in practice, modern machine learning models have been found to be susceptible to adversarial attacks that make human-imperceptible perturbations to the data, but result in serious and potentially dangerous…

机器学习 · 计算机科学 2020-08-18 Lin Chen , Yifei Min , Mingrui Zhang , Amin Karbasi

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

机器学习 · 计算机科学 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

Adversarial training is a common approach to improving the robustness of deep neural networks against adversarial examples. In this work, we propose a novel regularization approach as an alternative. To derive the regularizer, we formulate…

机器学习 · 计算机科学 2021-02-09 Avery Ma , Fartash Faghri , Nicolas Papernot , Amir-massoud Farahmand

This paper investigates the theory of robustness against adversarial attacks. It focuses on the family of randomization techniques that consist in injecting noise in the network at inference time. These techniques have proven effective in…

Adversarial attacks against neural networks in a regression setting are a critical yet understudied problem. In this work, we advance the state of the art by investigating adversarial attacks against regression networks and by formulating a…

机器学习 · 计算机科学 2018-12-10 Andre T. Nguyen , Edward Raff

While adversarial training can improve robust accuracy (against an adversary), it sometimes hurts standard accuracy (when there is no adversary). Previous work has studied this tradeoff between standard and robust accuracy, but only in the…

机器学习 · 计算机科学 2019-08-28 Aditi Raghunathan , Sang Michael Xie , Fanny Yang , John C. Duchi , Percy Liang

As Large Language Models (LLMs) transition into autonomous multi-agent ecosystems, robust minimax training becomes essential yet remains prone to instability when highly non-linear policies induce extreme local curvature in the inner…

机器学习 · 计算机科学 2026-03-05 Furkan Mumcu , Yasin Yilmaz

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Stability analysis is an essential aspect of studying the generalization ability of deep learning, as it involves deriving generalization bounds for stochastic gradient descent-based training algorithms. Adversarial training is the most…

机器学习 · 计算机科学 2024-01-09 Yihan Wang , Shuang Liu , Xiao-Shan Gao

Many state-of-the-art adversarial training methods for deep learning leverage upper bounds of the adversarial loss to provide security guarantees against adversarial attacks. Yet, these methods rely on convex relaxations to propagate lower…

机器学习 · 计算机科学 2023-04-07 Dimitris Bertsimas , Xavier Boix , Kimberly Villalobos Carballo , Dick den Hertog

Neural network robustness has recently been highlighted by the existence of adversarial examples. Many previous works show that the learned networks do not perform well on perturbed test data, and significantly more labeled data is required…

机器学习 · 计算机科学 2019-09-27 Runtian Zhai , Tianle Cai , Di He , Chen Dan , Kun He , John Hopcroft , Liwei Wang