中文
相关论文

相关论文: Benign Overfitting in Adversarially Robust Linear …

200 篇论文

Well-known (non-malicious) sources of overfitting in deep neural net (DNN) classifiers include: i) large class imbalances; ii) insufficient training-set diversity; and iii) over-training. In recent work, it was shown that backdoor…

机器学习 · 计算机科学 2023-10-02 Hang Wang , David J. Miller , George Kesidis

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

机器学习 · 计算机科学 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

A central concern in classification is the vulnerability of machine learning models to adversarial attacks. Adversarial training is one of the most popular techniques for training robust classifiers, which involves minimizing an adversarial…

机器学习 · 计算机科学 2025-10-09 Natalie S. Frank

Despite the enormous success of machine learning models in various applications, most of these models lack resilience to (even small) perturbations in their input data. Hence, new methods to robustify machine learning models seem very…

机器学习 · 计算机科学 2020-10-30 Fariborz Salehi , Babak Hassibi

The phenomenon of adversarial examples in deep learning models has caused substantial concern over their reliability. While many deep neural networks have shown impressive performance in terms of predictive accuracy, it has been shown that…

机器学习 · 计算机科学 2021-06-28 Sadia Chowdhury , Ruth Urner

Transformers have the capacity to act as supervised learning algorithms: by properly encoding a set of labeled training ("in-context") examples and an unlabeled test example into an input sequence of vectors of the same dimension, the…

机器学习 · 计算机科学 2024-12-16 Spencer Frei , Gal Vardi

State-of-the-art machine learning models can be vulnerable to very small input perturbations that are adversarially constructed. Adversarial training is an effective approach to defend against such examples. It is formulated as a min-max…

机器学习 · 统计学 2022-10-21 Antônio H. Ribeiro , Dave Zachariah , Thomas B. Schön

We study benign overfitting in two-layer ReLU networks trained using gradient descent and hinge loss on noisy data for binary classification. In particular, we consider linearly separable data for which a relatively small proportion of…

机器学习 · 计算机科学 2023-11-10 Erin George , Michael Murray , William Swartworth , Deanna Needell

It is becoming increasingly clear that many machine learning classifiers are vulnerable to adversarial examples. In attempting to explain the origin of adversarial examples, previous studies have typically focused on the fact that neural…

机器学习 · 统计学 2017-11-09 Ekin D. Cubuk , Barret Zoph , Samuel S. Schoenholz , Quoc V. Le

It is not fully understood why adversarial examples can deceive neural networks and transfer between different networks. To elucidate this, several studies have hypothesized that adversarial perturbations, while appearing as noises, contain…

机器学习 · 计算机科学 2024-02-19 Soichiro Kumano , Hiroshi Kera , Toshihiko Yamasaki

Recent years have witnessed significant progresses in deep Reinforcement Learning (RL). Empowered with large scale neural networks, carefully designed architectures, novel training algorithms and massively parallel computing devices,…

机器学习 · 计算机科学 2018-04-23 Chiyuan Zhang , Oriol Vinyals , Remi Munos , Samy Bengio

Recent research in neural networks and machine learning suggests that using many more parameters than strictly required by the initial complexity of a regression problem can result in more accurate or faster-converging models -- contrary to…

机器学习 · 计算机科学 2023-05-18 Arthur Castello B. de Oliveira , Milad Siami , Eduardo D. Sontag

Defenses against adversarial examples, such as adversarial training, are typically tailored to a single perturbation type (e.g., small $\ell_\infty$-noise). For other perturbations, these defenses offer no guarantees and, at times, even…

机器学习 · 计算机科学 2019-10-21 Florian Tramèr , Dan Boneh

Traditional (fickle) adversarial examples involve finding a small perturbation that does not change an input's true label but confuses the classifier into outputting a different prediction. Conversely, obstinate adversarial examples occur…

计算与语言 · 计算机科学 2022-11-01 Hannah Chen , Yangfeng Ji , David Evans

Deep Learning models are vulnerable to adversarial examples, i.e.\ images obtained via deliberate imperceptible perturbations, such that the model misclassifies them with high confidence. However, class confidence by itself is an incomplete…

机器学习 · 统计学 2017-11-23 Ambrish Rawat , Martin Wistuba , Maria-Irina Nicolae

Bias in classifiers is a severe issue of modern deep learning methods, especially for their application in safety- and security-critical areas. Often, the bias of a classifier is a direct consequence of a bias in the training dataset,…

计算机视觉与模式识别 · 计算机科学 2021-03-11 Christian Reimers , Paul Bodesheim , Jakob Runge , Joachim Denzler

Adversarial examples are carefully perturbed in-puts for fooling machine learning models. A well-acknowledged defense method against such examples is adversarial training, where adversarial examples are injected into training data to…

机器学习 · 计算机科学 2019-05-17 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

It is well known that adversarial attacks can fool deep neural networks with imperceptible perturbations. Although adversarial training significantly improves model robustness, failure cases of defense still broadly exist. In this work, we…

机器学习 · 计算机科学 2021-06-10 Boxi Wu , Heng Pan , Li Shen , Jindong Gu , Shuai Zhao , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Quantum classifiers are vulnerable to adversarial attacks that manipulate their input classical or quantum data. A promising countermeasure is adversarial training, where quantum classifiers are trained by using an attack-aware, adversarial…

量子物理 · 物理学 2025-04-25 Petros Georgiou , Aaron Mark Thomas , Sharu Theresa Jose , Osvaldo Simeone

The ability to fool deep learning classifiers with tiny perturbations of the input has lead to the development of adversarial training in which the loss with respect to adversarial examples is minimized in addition to the training examples.…

机器学习 · 计算机科学 2024-07-30 Amir Hagai , Yair Weiss