English
Related papers

Related papers: Learning with a Strong Adversary

200 papers

We study the design of computationally efficient algorithms with provable guarantees, that are robust to adversarial (test time) perturbations. While there has been an proliferation of recent work on this topic due to its connections to…

Machine Learning · Computer Science 2019-11-13 Pranjal Awasthi , Abhratanu Dutta , Aravindan Vijayaraghavan

In this paper we provide an approach for deep learning that protects against adversarial examples in image classification-type networks. The approach relies on two mechanisms:1) a mechanism that increases robustness at the expense of…

Machine Learning · Computer Science 2021-01-07 Yuting Liang , Reza Samavi

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

Machine Learning · Computer Science 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

The ability to fool deep learning classifiers with tiny perturbations of the input has lead to the development of adversarial training in which the loss with respect to adversarial examples is minimized in addition to the training examples.…

Machine Learning · Computer Science 2024-07-30 Amir Hagai , Yair Weiss

Training machine learning models that are robust against adversarial inputs poses seemingly insurmountable challenges. To better understand adversarial robustness, we consider the underlying problem of learning robust representations. We…

Machine Learning · Computer Science 2020-07-07 Sicheng Zhu , Xiao Zhang , David Evans

Transfer learning, in which a network is trained on one task and re-purposed on another, is often used to produce neural network classifiers when data is scarce or full-scale training is too costly. When the goal is to produce a model that…

Machine Learning · Computer Science 2020-02-24 Ali Shafahi , Parsa Saadatpanah , Chen Zhu , Amin Ghiasi , Christoph Studer , David Jacobs , Tom Goldstein

Deep learning has emerged as a strong and efficient framework that can be applied to a broad spectrum of complex learning problems which were difficult to solve using the traditional machine learning techniques in the past. In the last few…

Machine Learning · Computer Science 2018-10-02 Anirban Chakraborty , Manaar Alam , Vishal Dey , Anupam Chattopadhyay , Debdeep Mukhopadhyay

Deep neural networks are vulnerable to adversarial examples - small input perturbations that result in incorrect predictions. We study this problem for models of source code, where we want the network to be robust to source-code…

Machine Learning · Computer Science 2022-08-23 Goutham Ramakrishnan , Jordan Henkel , Zi Wang , Aws Albarghouthi , Somesh Jha , Thomas Reps

The field of adversarial robustness has attracted significant attention in machine learning. Contrary to the common approach of training models that are accurate in average case, it aims at training models that are accurate for worst case…

Machine Learning · Computer Science 2020-10-12 Oriol Barbany Mayor

Why are classifiers in high dimension vulnerable to "adversarial" perturbations? We show that it is likely not due to information theoretic limitations, but rather it could be due to computational constraints. First we prove that, for a…

Machine Learning · Statistics 2018-05-28 Sébastien Bubeck , Eric Price , Ilya Razenshteyn

Adversarial robustness has proven to be a required property of machine learning algorithms. A key and often overlooked aspect of this problem is to try to make the adversarial noise magnitude as large as possible to enhance the benefits of…

Machine Learning · Statistics 2020-03-31 Amirreza Shaeiri , Rozhin Nobahari , Mohammad Hossein Rohban

We study the problem of learning predictors that are robust to adversarial examples with respect to an unknown perturbation set, relying instead on interaction with an adversarial attacker or access to attack oracles, examining different…

Machine Learning · Computer Science 2021-02-04 Omar Montasser , Steve Hanneke , Nathan Srebro

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

Machine Learning · Computer Science 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

Machine Learning · Computer Science 2023-02-09 Boqi Li , Weiwei Liu

A new understanding of adversarial examples and adversarial robustness is proposed by decoupling the data generator and the label generator (which we call the teacher). In our framework, adversarial robustness is a conditional concept---the…

Machine Learning · Computer Science 2020-12-15 Chao Ma , Lexing Ying

There has been a recent paradigm shift in robotics to data-driven learning for planning and control. Due to large number of experiences required for training, most of these approaches use a self-supervised paradigm: using sensors to measure…

Robotics · Computer Science 2016-10-07 Lerrel Pinto , James Davidson , Abhinav Gupta

This paper investigates the theory of robustness against adversarial attacks. We focus on randomized classifiers (\emph{i.e.} classifiers that output random variables) and provide a thorough analysis of their behavior through the lens of…

Machine Learning · Computer Science 2021-02-23 Rafael Pinot , Laurent Meunier , Florian Yger , Cédric Gouy-Pailler , Yann Chevaleyre , Jamal Atif

Making classifiers robust to adversarial examples is hard. Thus, many defenses tackle the seemingly easier task of detecting perturbed inputs. We show a barrier towards this goal. We prove a general hardness reduction between detection and…

Machine Learning · Computer Science 2022-06-17 Florian Tramèr

The last few years have seen a staggering number of empirical studies of the robustness of neural networks in a model of adversarial perturbations of their inputs. Most rely on an adversary which carries out local modifications within…

Machine Learning · Computer Science 2019-05-09 Zac Cranko , Aditya Krishna Menon , Richard Nock , Cheng Soon Ong , Zhan Shi , Christian Walder