English
Related papers

Related papers: Linking average- and worst-case perturbation robus…

200 papers

The goal of this paper is to analyze an intriguing phenomenon recently discovered in deep networks, namely their instability to adversarial perturbations (Szegedy et. al., 2014). We provide a theoretical framework for analyzing the…

Machine Learning · Computer Science 2016-03-30 Alhussein Fawzi , Omar Fawzi , Pascal Frossard

In this paper, we uniquely study the adversarial robustness of deep neural networks (NN) for classification tasks against that of optimal classifiers. We look at the smallest magnitude of possible additive perturbations that can change a…

Machine Learning · Computer Science 2025-11-05 Jingchao Gao , Ziqing Lu , Raghu Mudumbai , Xiaodong Wu , Jirong Yi , Myung Cho , Catherine Xu , Hui Xie , Weiyu Xu

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham

Deep neural networks are vulnerable to adversarial attacks, which can fool them by adding minuscule perturbations to the input images. The robustness of existing defenses suffers greatly under white-box attack settings, where an adversary…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Aamir Mustafa , Salman Khan , Munawar Hayat , Roland Goecke , Jianbing Shen , Ling Shao

Recent work has extensively shown that randomized perturbations of neural networks can improve robustness to adversarial attacks. The literature is, however, lacking a detailed compare-and-contrast of the latest proposals to understand what…

Machine Learning · Computer Science 2020-06-09 Adam Dziedzic , Sanjay Krishnan

Artificial and biological agents cannon learn given completely random and unstructured data. The structure of data is encoded in the metric relationships between data points. In the context of neural networks, neuronal activity within a…

Machine Learning · Computer Science 2022-11-03 Kosio Beshkov , Jonas Verhellen , Mikkel Elle Lepperød

Recent studies have shown that modern deep neural network classifiers are easy to fool, assuming that an adversary is able to slightly modify their inputs. Many papers have proposed adversarial attacks, defenses and methods to measure…

Machine Learning · Computer Science 2020-03-17 Igor Buzhinsky , Arseny Nerinovsky , Stavros Tripakis

The vulnerability of neural network classifiers to adversarial attacks is a major obstacle to their deployment in safety-critical applications. Regularization of network parameters during training can be used to improve adversarial…

Machine Learning · Computer Science 2024-05-28 Sheng Yang , Jacob A. Zavatone-Veth , Cengiz Pehlevan

Robustness in deep neural networks and machine learning algorithms in general is an open research challenge. In particular, it is difficult to ensure algorithmic performance is maintained on out-of-distribution inputs or anomalous instances…

Machine Learning · Computer Science 2022-11-23 Natalie Abreu , Nathan Vaska , Victoria Helus

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

While generalizing well over natural inputs, neural networks are vulnerable to adversarial inputs. Existing defenses against adversarial inputs have largely been detached from the real world. These defenses also come at a cost to accuracy.…

Machine Learning · Computer Science 2019-12-05 Varun Chandrasekaran , Brian Tang , Nicolas Papernot , Kassem Fawaz , Somesh Jha , Xi Wu

Deep neural networks (DNN) are increasingly being used to perform algorithm-selection in combinatorial optimisation domains, particularly as they accommodate input representations which avoid designing and calculating features. Mounting…

Neural and Evolutionary Computing · Computer Science 2024-06-25 Emma Hart , Quentin Renau , Kevin Sim , Mohamad Alissa

In this paper we aim to explore the general robustness of neural network classifiers by utilizing adversarial as well as natural perturbations. Different from previous works which mainly focus on studying the robustness of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders

Machine learning models are often susceptible to adversarial perturbations of their inputs. Even small perturbations can cause state-of-the-art classifiers with high "standard" accuracy to produce an incorrect prediction with high…

Machine Learning · Computer Science 2018-05-03 Ludwig Schmidt , Shibani Santurkar , Dimitris Tsipras , Kunal Talwar , Aleksander Mądry

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

Machine Learning · Computer Science 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

Adversarial training is a powerful type of defense against adversarial examples. Previous empirical results suggest that adversarial training requires wider networks for better performances. However, it remains elusive how neural network…

Machine Learning · Computer Science 2021-08-17 Boxi Wu , Jinghui Chen , Deng Cai , Xiaofei He , Quanquan Gu

Recently, there has been an abundance of works on designing Deep Neural Networks (DNNs) that are robust to adversarial examples. In particular, a central question is which features of DNNs influence adversarial robustness and, therefore,…

Machine Learning · Computer Science 2021-10-07 Peter Langenberg , Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

This paper examines the impact of static sparsity on the robustness of a trained network to weight perturbations, data corruption, and adversarial examples. We show that, up to a certain sparsity achieved by increasing network width and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Lukas Timpl , Rahim Entezari , Hanie Sedghi , Behnam Neyshabur , Olga Saukh

Most artificial networks today rely on dense representations, whereas biological networks rely on sparse representations. In this paper we show how sparse representations can be more robust to noise and interference, as long as the…

Machine Learning · Computer Science 2019-04-03 Subutai Ahmad , Luiz Scheinkman

Shift invariance is a critical property of CNNs that improves performance on classification. However, we show that invariance to circular shifts can also lead to greater sensitivity to adversarial attacks. We first characterize the margin…

Machine Learning · Computer Science 2021-11-23 Songwei Ge , Vasu Singla , Ronen Basri , David Jacobs