English
Related papers

Related papers: Adversarial Smoothed Analysis

200 papers

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

In this note, we consider the problem of aggregation of estimators in order to denoise a signal. The main contribution is a short proof of the fact that the exponentially weighted aggregate satisfies a sharp oracle inequality. While this…

Statistics Theory · Mathematics 2022-12-27 Arnak S. Dalalyan

We study the expanding properties of random perturbations of regular interval maps satisfying the summability condition of exponent one. Under very general conditions on the interval maps and perturbation types, we prove strong stochastic…

Dynamical Systems · Mathematics 2014-02-26 Weixiao Shen

Precision matrix estimation is a fundamental topic in multivariate statistics and modern machine learning. This paper proposes an adversarially perturbed precision matrix estimation framework, motivated by recent developments in adversarial…

Methodology · Statistics 2026-03-25 Yiling Xie

In this article, after recalling and discussing the conventional extremality, local extremality, stationarity and approximate stationarity properties of collections of sets and the corresponding (extended) extremal principle, we focus on…

Optimization and Control · Mathematics 2018-05-15 Hoa T. Bui , Alexander Y. Kruger

Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial…

Machine Learning · Computer Science 2024-03-25 André Bertolace , Konstatinos Gatsis , Kostas Margellos

The robustness of deep neural networks (DNNs) against adversarial example attacks has raised wide attention. For smoothed classifiers, we propose the worst-case adversarial loss over input distributions as a robustness certificate. Compared…

Machine Learning · Computer Science 2021-05-03 Jungang Yang , Liyao Xiang , Ruidong Chen , Yukun Wang , Wei Wang , Xinbing Wang

In (Istrate, Marathe, Ravi SODA 2001) we advocated the investigation of robustness of results in the theory of learning in games under adversarial scheduling models. We provide evidence that such an analysis is feasible and can lead to…

Computer Science and Game Theory · Computer Science 2008-11-04 Gabriel Istrate , Madhav V. Marathe , S. S. Ravi

We consider the problem of mean estimation assuming only finite variance. We study a new class of mean estimators constructed by integrating over random noise applied to a soft-truncated empirical mean estimator. For appropriate choices of…

Statistics Theory · Mathematics 2019-06-26 Matthew J. Holland

The purpose of this paper is to establish bounds on the rate of convergence of the conjugate gradient algorithm when the underlying matrix is a random positive definite perturbation of a deterministic positive definite matrix. We estimate…

Numerical Analysis · Mathematics 2016-11-08 Govind Menon , Thomas Trogdon

It is by now well-known that one can recover a potential in the wave equation from the knowledge of the initial waves, the boundary data and the flux on a part of the boundary satisfying the Gamma-conditions of J.-L. Lions. We are…

Analysis of PDEs · Mathematics 2011-10-21 Lucie Baudouin , Sylvain Ervedoza

Modern neural networks are expected to simultaneously satisfy a host of desirable properties: accurate fitting to training data, generalization to unseen inputs, parameter and computational efficiency, and robustness to adversarial…

Machine Learning · Computer Science 2025-10-20 Melih Barsbey , Antônio H. Ribeiro , Umut Şimşekli , Tolga Birdal

Despite the great success achieved in machine learning (ML), adversarial examples have caused concerns with regards to its trustworthiness: A small perturbation of an input results in an arbitrary failure of an otherwise seemingly…

Machine Learning · Computer Science 2018-10-24 Jingkang Wang , Ruoxi Jia , Gerald Friedland , Bo Li , Costas Spanos

The intriguing phenomenon of adversarial examples has attracted significant attention in machine learning and what might be more surprising to the community is the existence of universal adversarial perturbations (UAPs), i.e. a single…

Machine Learning · Computer Science 2022-04-20 Chaoning Zhang , Philipp Benz , Chenguo Lin , Adil Karjauv , Jing Wu , In So Kweon

We study the problem of robustly estimating the posterior distribution for the setting where observed data can be contaminated with potentially adversarial outliers. We propose Rob-ULA, a robust variant of the Unadjusted Langevin Algorithm…

Machine Learning · Statistics 2019-07-30 Kush Bhatia , Yi-An Ma , Anca D. Dragan , Peter L. Bartlett , Michael I. Jordan

We study random points on the real line generated by the eigenvalues in unitary invariant random matrix ensembles or by more general repulsive particle systems. As the number of points tends to infinity, we prove convergence of the…

Probability · Mathematics 2015-11-11 Kristina Schubert , Martin Venker

Deep Neural Networks (DNNs) have been widely applied in various recognition tasks. However, recently DNNs have been shown to be vulnerable against adversarial examples, which can mislead DNNs to make arbitrary incorrect predictions. While…

Cryptography and Security · Computer Science 2018-10-15 Chaowei Xiao , Ruizhi Deng , Bo Li , Fisher Yu , Mingyan Liu , Dawn Song

When approximating the joint distribution of the component counts of a decomposable combinatorial structure that is `almost' in the logarithmic class, but nonetheless has irregular structure, it is useful to be able first to establish that…

Probability · Mathematics 2010-11-02 A. D. Barbour , Anna Pósfai

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

Machine Learning · Computer Science 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

Regularization, whether explicit in terms of a penalty in the loss or implicit in the choice of algorithm, is a cornerstone of modern machine learning. Indeed, controlling the complexity of the model class is particularly important when…

Machine Learning · Statistics 2024-10-22 Matteo Vilucchio , Nikolaos Tsilivis , Bruno Loureiro , Julia Kempe