English
Related papers

Related papers: Adversarial Robustness Curves

200 papers

Short answer: Yes, Long answer: No! Indeed, research on adversarial robustness has led to invaluable insights helping us understand and explore different aspects of the problem. Many attacks and defenses have been proposed over the last…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Ali Borji

A new understanding of adversarial examples and adversarial robustness is proposed by decoupling the data generator and the label generator (which we call the teacher). In our framework, adversarial robustness is a conditional concept---the…

Machine Learning · Computer Science 2020-12-15 Chao Ma , Lexing Ying

While $\mathcal{H}_\infty$ methods can introduce robustness against worst-case perturbations, their nominal performance under conventional stochastic disturbances is often drastically reduced. Though this fundamental tradeoff between…

Systems and Control · Electrical Eng. & Systems 2023-05-29 Bruce D. Lee , Thomas T. C. K. Zhang , Hamed Hassani , Nikolai Matni

A wide range of defenses have been proposed to harden neural networks against adversarial attacks. However, a pattern has emerged in which the majority of adversarial defenses are quickly broken by new attacks. Given the lack of success at…

Machine Learning · Computer Science 2020-02-05 Ali Shafahi , W. Ronny Huang , Christoph Studer , Soheil Feizi , Tom Goldstein

To ensure trust in AI models, it is becoming increasingly apparent that evaluation of models must be extended beyond traditional performance metrics, like accuracy, to other dimensions, such as fairness, explainability, adversarial…

Machine Learning · Computer Science 2021-10-01 Moninder Singh , Gevorg Ghalachyan , Kush R. Varshney , Reginald E. Bryant

In this paper, we investigate the impact of test-time adversarial attacks on linear regression models and determine the optimal level of robustness that any model can reach while maintaining a given level of standard predictive performance…

Machine Learning · Statistics 2023-08-02 Elvis Dohmatob , Meyer Scetbon

This paper investigates recently proposed approaches for defending against adversarial examples and evaluating adversarial robustness. We motivate 'adversarial risk' as an objective for achieving models robust to worst-case inputs. We then…

Machine Learning · Computer Science 2018-06-13 Jonathan Uesato , Brendan O'Donoghue , Aaron van den Oord , Pushmeet Kohli

Neural networks are very successful at detecting patterns in noisy data, and have become the technology of choice in many fields. However, their usefulness is hampered by their susceptibility to adversarial attacks. Recently, many methods…

Machine Learning · Computer Science 2022-07-14 Marco Casadio , Ekaterina Komendantskaya , Matthew L. Daggitt , Wen Kokke , Guy Katz , Guy Amir , Idan Refaeli

The reliability of a learning model is key to the successful deployment of machine learning in various industries. Creating a robust model, particularly one unaffected by adversarial attacks, requires a comprehensive understanding of the…

Machine Learning · Computer Science 2022-08-16 Ramin Barati , Reza Safabakhsh , Mohammad Rahmati

Adversarial robustness refers to a model's ability to resist perturbation of inputs, while distribution robustness evaluates the performance of the model under data shifts. Although both aim to ensure reliable performance, prior work has…

Machine Learning · Computer Science 2026-01-26 Yipei Wang , Zhaoying Pan , Xiaoqian Wang

Obtaining deep networks that are robust against adversarial examples and generalize well is an open problem. A recent hypothesis even states that both robust and accurate models are impossible, i.e., adversarial robustness and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 David Stutz , Matthias Hein , Bernt Schiele

Adversarially robust learning aims to design algorithms that are robust to small adversarial perturbations on input variables. Beyond the existing studies on the predictive performance to adversarial samples, our goal is to understand…

Machine Learning · Statistics 2020-12-21 Yue Xing , Ruizhi Zhang , Guang Cheng

Driven by massive amounts of data and important advances in computational resources, new deep learning systems have achieved outstanding results in a large spectrum of applications. Nevertheless, our current theoretical understanding on the…

Machine Learning · Computer Science 2021-01-29 Guillermo Ortiz-Jimenez , Apostolos Modas , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard

We study the model robustness against adversarial examples, referred to as small perturbed input data that may however fool many state-of-the-art deep learning models. Unlike previous research, we establish a novel theory addressing the…

Machine Learning · Computer Science 2020-06-11 Shufei Zhang , Kaizhu Huang , Zenglin Xu

The robustness of neural networks is challenged by adversarial examples that contain almost imperceptible perturbations to inputs, which mislead a classifier to incorrect outputs in high confidence. Limited by the extreme difficulty in…

Machine Learning · Computer Science 2020-10-20 Honglin Li , Yifei Fan , Frieder Ganz , Anthony Yezzi , Payam Barnaghi

This paper revisits the robust overfitting phenomenon of adversarial training. Observing that models with better robust generalization performance are less certain in predicting adversarially generated training inputs, we argue that…

Machine Learning · Computer Science 2025-01-15 Minxing Zhang , Michael Backes , Xiao Zhang

We explore rigorous, systematic, and controlled experimental evaluation of adversarial examples in the real world and propose a testing regimen for evaluation of real world adversarial objects. We show that for small scene/ environmental…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Brett Jefferson , Carlos Ortiz Marrero

Most previous works usually explained adversarial examples from several specific perspectives, lacking relatively integral comprehension about this problem. In this paper, we present a systematic study on adversarial examples from three…

Machine Learning · Computer Science 2019-03-01 Ke Sun , Zhanxing Zhu , Zhouchen Lin

Evaluating the robustness of automated driving planners is a critical and challenging task. Although methodologies to evaluate vehicles are well established, they do not yet account for a reality in which vehicles with autonomous components…

Cryptography and Security · Computer Science 2022-05-31 Andres Molina-Markham , Silvia G. Ionescu , Erin Lanus , Derek Ng , Sam Sommerer , Joseph J. Rushanan

Over the past decade, numerous theories have been proposed to explain the widespread vulnerability of deep neural networks to adversarial evasion attacks. Among these, the theory of non-robust features proposed by Ilyas et al. has been…

Machine Learning · Computer Science 2026-01-05 Jennifer Crawford , Amol Khanna , Fred Lu , Amy R. Wagoner , Stella Biderman , Andre T. Nguyen , Edward Raff