English
Related papers

Related papers: Adversarial Smoothed Analysis

200 papers

We investigate conditions under which test statistics exist that can reliably detect examples, which have been adversarially manipulated in a white-box attack. These statistics can be easily computed and calibrated by randomly corrupting…

Machine Learning · Computer Science 2019-05-10 Kevin Roth , Yannic Kilcher , Thomas Hofmann

We perform a smoothed analysis of the componentwise condition numbers for determinant computation, matrix inversion, and linear equations solving for sparse n times n matrices. The bounds we obtain for the ex- pectations of the logarithm of…

Numerical Analysis · Mathematics 2013-02-26 Dennis Cheung , Felipe Cucker

Persistence of spatial analyticity is studied for solution of the beam equation $ u_{tt} + \left(m+\Delta^2\right) u + |u|^{p-1}u = 0$ on $\mathbb R^n \times \mathbb R$. In particular, for a class of analytic initial data with a uniform…

Analysis of PDEs · Mathematics 2022-03-17 Tamirat T. Dufera , Sileshi Mebrate , Achenef Tesfahun

Adversarial training is a technique for training robust machine learning models. To encourage robustness, it iteratively computes adversarial examples for the model, and then re-trains on these examples via some update rule. This work…

Machine Learning · Computer Science 2019-05-23 Zachary Charles , Shashank Rajput , Stephen Wright , Dimitris Papailiopoulos

The nonuniform and growing impact of adversarial noise across the layers of deep neural networks has been used in the literature, without a formal mathematical justification, to detect adversarial inputs and improve robustness. In this…

Machine Learning · Computer Science 2026-05-05 Furkan Mumcu , Yasin Yilmaz

In this paper, we investigate the adversarial robustness of nonparametric regression, a fundamental problem in machine learning, under the setting where an adversary can arbitrarily corrupt a subset of the input data. While the robustness…

Machine Learning · Computer Science 2025-10-28 Parsa Moradi , Hanzaleh Akabrinodehi , Mohammad Ali Maddah-Ali

In recent years, diffusion models (DMs) have drawn significant attention for their success in approximating data distributions, yielding state-of-the-art generative results. Nevertheless, the versatility of these models extends beyond their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Peter Lorenz , Ricard Durall , Janis Keuper

Adversarial examples mainly exploit changes to input pixels to which humans are not sensitive to, and arise from the fact that models make decisions based on uninterpretable features. Interestingly, cognitive science reports that the…

Making classifiers robust to adversarial examples is hard. Thus, many defenses tackle the seemingly easier task of detecting perturbed inputs. We show a barrier towards this goal. We prove a general hardness reduction between detection and…

Machine Learning · Computer Science 2022-06-17 Florian Tramèr

The method to derive uniform bounds with Gaussian and Rademacher complexities is extended to the case where the sample average is replaced by a nonlinear statistic. Tight bounds are obtained for U-statistics, smoothened L-statistics and…

Statistics Theory · Mathematics 2019-05-13 Andreas Maurer , Massimiliano Pontil

Covariate distribution shifts and adversarial perturbations present robustness challenges to the conventional statistical learning framework: mild shifts in the test covariate distribution can significantly affect the performance of the…

Machine Learning · Statistics 2024-05-21 Tengyuan Liang

Several existing works study either adversarial or natural distributional robustness of deep neural networks separately. In practice, however, models need to enjoy both types of robustness to ensure reliability. In this work, we bridge this…

Machine Learning · Computer Science 2022-09-19 Mazda Moayeri , Kiarash Banihashem , Soheil Feizi

State of the art computer vision models have been shown to be vulnerable to small adversarial perturbations of the input. In other words, most images in the data distribution are both correctly classified by the model and are very close to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Justin Gilmer , Luke Metz , Fartash Faghri , Samuel S. Schoenholz , Maithra Raghu , Martin Wattenberg , Ian Goodfellow

We prove a general theorem providing smoothed analysis estimates for conic condition numbers of problems of numerical analysis. Our probability estimates depend only on geometric invariants of the corresponding sets of ill-posed inputs.…

Numerical Analysis · Mathematics 2015-06-26 Peter Buergisser , Felipe Cucker , Martin Lotz

Adversarial examples are input examples that are specifically crafted to deceive machine learning classifiers. State-of-the-art adversarial example detection methods characterize an input example as adversarial either by quantifying the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yuhang Wu , Sunpreet S. Arora , Yanhong Wu , Hao Yang

Adversarial robustness, which primarily comprises sensitivity-based robustness and spatial robustness, plays an integral part in achieving robust generalization. In this paper, we endeavor to design strategies to achieve universal…

Machine Learning · Computer Science 2024-06-25 Ke Sun , Mingjie Li , Zhouchen Lin

We prove an exponential separation for the sample complexity between the standard PAC-learning model and a version of the Equivalence-Query-learning model. We then show that this separation has interesting implications for adversarial…

Machine Learning · Computer Science 2021-02-19 Grzegorz Głuch , Rüdiger Urbanke

We explore rigorous, systematic, and controlled experimental evaluation of adversarial examples in the real world and propose a testing regimen for evaluation of real world adversarial objects. We show that for small scene/ environmental…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Brett Jefferson , Carlos Ortiz Marrero

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

Recent studies on the adversarial vulnerability of neural networks have shown that models trained to be more robust to adversarial attacks exhibit more interpretable saliency maps than their non-robust counterparts. We aim to quantify this…

Machine Learning · Statistics 2019-05-13 Christian Etmann , Sebastian Lunz , Peter Maass , Carola-Bibiane Schönlieb