English
Related papers

Related papers: Reducing Adversarially Robust Learning to Non-Robu…

200 papers

We develop a framework using Hilbert spaces as a proxy to analyze PAC learning problems with structural properties. We consider a joint Hilbert space incorporating the relation between the true label and the predictor under a joint…

Machine Learning · Computer Science 2021-02-15 Mohsen Heidari , Wojciech Szpankowski

Recently, there is an emerging interest in adversarially training a classifier with a rejection option (also known as a selective classifier) for boosting adversarial robustness. While rejection can incur a cost in many applications,…

Machine Learning · Computer Science 2023-05-15 Jiefeng Chen , Jayaram Raghuram , Jihye Choi , Xi Wu , Yingyu Liang , Somesh Jha

The existence of adversarial examples has been a mystery for years and attracted much interest. A well-known theory by \citet{ilyas2019adversarial} explains adversarial vulnerability from a data perspective by showing that one can extract…

Machine Learning · Computer Science 2024-05-07 Ang Li , Yifei Wang , Yiwen Guo , Yisen Wang

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

Machine Learning · Computer Science 2023-02-09 Boqi Li , Weiwei Liu

Deep neural networks are vulnerable to adversarial examples, which becomes one of the most important research problems in the development of deep learning. While a lot of efforts have been made in recent years, it is of great significance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yinpeng Dong , Qi-An Fu , Xiao Yang , Tianyu Pang , Hang Su , Zihao Xiao , Jun Zhu

Adversarial training aims to defend against adversaries: malicious opponents whose sole aim is to harm predictive performance in any way possible. This presents a rather harsh perspective, which we assert results in unnecessarily…

Machine Learning · Computer Science 2025-06-10 Maayan Ehrenberg , Roy Ganz , Nir Rosenfeld

Adversarial training is a widely-applied approach to training deep neural networks to be robust against adversarial perturbation. However, although adversarial training has achieved empirical success in practice, it still remains unclear…

Machine Learning · Computer Science 2025-02-10 Binghui Li , Yuanzhi Li

Neural networks lack adversarial robustness, i.e., they are vulnerable to adversarial examples that through small perturbations to inputs cause incorrect predictions. Further, trust is undermined when models give miscalibrated predictions,…

Machine Learning · Computer Science 2021-12-15 Yao Qin , Xuezhi Wang , Alex Beutel , Ed H. Chi

Constraint-based learning reduces the burden of collecting labels by having users specify general properties of structured outputs, such as constraints imposed by physical laws. We propose a novel framework for simultaneously learning these…

Machine Learning · Computer Science 2018-06-01 Hongyu Ren , Russell Stewart , Jiaming Song , Volodymyr Kuleshov , Stefano Ermon

We consider the relationship between learnability of a "base class" of functions on a set $X$, and learnability of a class of statistical functions derived from the base class. For example, we refine results showing that learnability of a…

Logic in Computer Science · Computer Science 2025-05-28 Aaron Anderson , Michael Benedikt

There has been great interest in enhancing the robustness of neural network classifiers to defend against adversarial perturbations through adversarial training, while balancing the trade-off between robust accuracy and standard accuracy.…

Machine Learning · Computer Science 2022-10-24 Chester Holtz , Tsui-Wei Weng , Gal Mishne

There has been emerging interest to use transductive learning for adversarial robustness (Goldwasser et al., NeurIPS 2020; Wu et al., ICML 2020). Compared to traditional "test-time" defenses, these defense mechanisms "dynamically retrain"…

Machine Learning · Computer Science 2021-06-17 Jiefeng Chen , Yang Guo , Xi Wu , Tianqi Li , Qicheng Lao , Yingyu Liang , Somesh Jha

Recent breakthroughs in the field of deep learning have led to advancements in a broad spectrum of tasks in computer vision, audio processing, natural language processing and other areas. In most instances where these tasks are deployed in…

Machine Learning · Computer Science 2019-05-28 Daanish Ali Khan , Linhong Li , Ninghao Sha , Zhuoran Liu , Abelino Jimenez , Bhiksha Raj , Rita Singh

Deep computer vision systems being vulnerable to imperceptible and carefully crafted noise have raised questions regarding the robustness of their decisions. We take a step back and approach this problem from an orthogonal direction. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders , Zeynep Akata

Adversarial Training (AT) is proposed to alleviate the adversarial vulnerability of machine learning models by extracting only robust features from the input, which, however, inevitably leads to severe accuracy reduction as it discards the…

Machine Learning · Statistics 2020-07-06 Yifei Wang , Dan Peng , Furui Liu , Zhenguo Li , Zhitang Chen , Jiansheng Yang

This paper proposes an attack-independent (non-adversarial training) technique for improving adversarial robustness of neural network models, with minimal loss of standard accuracy. We suggest creating a neighborhood around each training…

Machine Learning · Computer Science 2021-07-28 Bronya Roni Chernyak , Bhiksha Raj , Tamir Hazan , Joseph Keshet

In communication systems, there are many tasks, like modulation recognition, which rely on Deep Neural Networks (DNNs) models. However, these models have been shown to be susceptible to adversarial perturbations, namely imperceptible…

Signal Processing · Electrical Eng. & Systems 2021-05-31 Javier Maroto , Gérôme Bovet , Pascal Frossard

In this work, we consider a binary classification problem and cast it into a binary hypothesis testing framework, where the observations can be perturbed by an adversary. To improve the adversarial robustness of a classifier, we include an…

Machine Learning · Computer Science 2021-10-01 Abed AlRahman Al Makdah , Vaibhav Katewa , Fabio Pasqualetti

We analyze the properties of adversarial training for learning adversarially robust halfspaces in the presence of agnostic label noise. Denoting $\mathsf{OPT}_{p,r}$ as the best robust classification error achieved by a halfspace that is…

Machine Learning · Computer Science 2021-04-20 Difan Zou , Spencer Frei , Quanquan Gu

Adversarial training, in which a network is trained on both adversarial and clean examples, is one of the most trusted defense methods against adversarial attacks. However, there are three major practical difficulties in implementing and…

Machine Learning · Computer Science 2019-10-11 Shixian Wen , Laurent Itti