English
Related papers

Related papers: Theoretical evidence for adversarial robustness th…

200 papers

Randomized smoothing is a defensive technique to achieve enhanced robustness against adversarial examples which are small input perturbations that degrade the performance of neural network models. Conventional randomized smoothing adds…

Machine Learning · Computer Science 2024-07-17 Ryo Hase , Ye Wang , Toshiaki Koike-Akino , Jing Liu , Kieran Parsons

Adversarial training is by far the most successful strategy for improving robustness of neural networks to adversarial attacks. Despite its success as a defense mechanism, adversarial training fails to generalize well to unperturbed test…

Machine Learning · Computer Science 2019-10-18 Yogesh Balaji , Tom Goldstein , Judy Hoffman

As machine learning techniques become increasingly prevalent in data analysis, the threat of adversarial attacks has surged, necessitating robust defense mechanisms. Among these defenses, methods exploiting low-rank approximations for input…

Machine Learning · Computer Science 2023-09-06 Manish Bhattarai , Mehmet Cagri Kaymak , Ryan Barron , Ben Nebgen , Kim Rasmussen , Boian Alexandrov

Despite their unmatched performance, deep neural networks remain susceptible to targeted attacks by nearly imperceptible levels of adversarial noise. While the underlying cause of this sensitivity is not well understood, theoretical…

Machine Learning · Computer Science 2020-12-01 George Cazenavette , Calvin Murdock , Simon Lucey

The goal of this paper is to analyze an intriguing phenomenon recently discovered in deep networks, namely their instability to adversarial perturbations (Szegedy et. al., 2014). We provide a theoretical framework for analyzing the…

Machine Learning · Computer Science 2016-03-30 Alhussein Fawzi , Omar Fawzi , Pascal Frossard

Though deep neural networks have achieved significant progress on various tasks, often enhanced by model ensemble, existing high-performance models can be vulnerable to adversarial attacks. Many efforts have been devoted to enhancing the…

Machine Learning · Computer Science 2019-05-30 Tianyu Pang , Kun Xu , Chao Du , Ning Chen , Jun Zhu

We identify three common cases that lead to overestimation of adversarial accuracy against bounded first-order attack methods, which is popularly used as a proxy for adversarial robustness in empirical studies. For each case, we propose…

Machine Learning · Computer Science 2020-06-03 Kyungmi Lee , Anantha P. Chandrakasan

Several techniques for domain adaptation have been proposed to account for differences in the distribution of the data used for training and testing. The majority of this work focuses on a binary domain label. Similar problems occur in a…

Machine Learning · Statistics 2020-02-18 Gilles Louppe , Michael Kagan , Kyle Cranmer

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model and to the opposite "black box" setting. Black box attacks are particularly…

Machine Learning · Computer Science 2019-05-27 Haidar Khan , Daniel Park , Azer Khan , Bülent Yener

Strong theoretical guarantees of robustness can be given for ensembles of classifiers generated by input randomization. Specifically, an $\ell_2$ bounded adversary cannot alter the ensemble prediction generated by an additive isotropic…

Machine Learning · Computer Science 2020-02-28 Guang-He Lee , Yang Yuan , Shiyu Chang , Tommi S. Jaakkola

Batch Normalization (BatchNorm) is effective for improving the performance and accelerating the training of deep neural networks. However, it has also shown to be a cause of adversarial vulnerability, i.e., networks without it are more…

Machine Learning · Computer Science 2020-06-22 Muhammad Awais , Fahad Shamshad , Sung-Ho Bae

Deep neural networks are easily misled by adversarial examples. Although lots of defense methods are proposed, many of them are demonstrated to lose effectiveness when against properly performed adaptive attacks. How to evaluate the…

Cryptography and Security · Computer Science 2021-01-08 Pengfei Xia , Ziqiang Li , Hongjing Niu , Bin Li

Is there a classifier that ensures optimal robustness against all adversarial attacks? This paper answers this question by adopting a game-theoretic point of view. We show that adversarial attacks and defenses form an infinite zero-sum game…

Machine Learning · Computer Science 2021-01-07 Rafael Pinot , Raphael Ettedgui , Geovani Rizk , Yann Chevaleyre , Jamal Atif

Recent progress in empirical and certified robustness promises to deliver reliable and deployable Deep Neural Networks (DNNs). Despite that success, most existing evaluations of DNN robustness have been done on images sampled from the same…

Machine Learning · Computer Science 2023-11-08 Kumail Alhamoud , Hasan Abed Al Kader Hammoud , Motasem Alfarra , Bernard Ghanem

We study the design of computationally efficient algorithms with provable guarantees, that are robust to adversarial (test time) perturbations. While there has been an proliferation of recent work on this topic due to its connections to…

Machine Learning · Computer Science 2019-11-13 Pranjal Awasthi , Abhratanu Dutta , Aravindan Vijayaraghavan

Adversarial examples have been shown to cause neural networks to fail on a wide range of vision and language tasks, but recent work has claimed that Bayesian neural networks (BNNs) are inherently robust to adversarial perturbations. In this…

Machine Learning · Computer Science 2024-05-01 Yunzhen Feng , Tim G. J. Rudner , Nikolaos Tsilivis , Julia Kempe

We propose two training techniques for improving the robustness of Neural Networks to adversarial attacks, i.e. manipulations of the inputs that are maliciously crafted to fool networks into incorrect predictions. Both methods are…

Machine Learning · Computer Science 2021-04-28 Ginevra Carbone , Guido Sanguinetti , Luca Bortolussi

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

Machine Learning · Computer Science 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

Despite the growing prevalence of artificial neural networks in real-world applications, their vulnerability to adversarial attacks remains a significant concern, which motivates us to investigate the robustness of machine learning models.…

Machine Learning · Computer Science 2024-08-23 Jie Wang , Rui Gao , Yao Xie

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham