English
Related papers

Related papers: On strict sub-Gaussianity, optimal proxy variance …

200 papers

The sum of $N$ sufficiently strongly correlated random variables will not in general be Gaussian distributed in the limit N\to\infty. We revisit examples of sums x that have recently been put forward as instances of variables obeying a…

Statistical Mechanics · Physics 2009-11-13 H. J. Hilhorst , G. Schehr

For a sample of absolutely bounded i.i.d. random variables with a continuous density the cumulative distribution function of the sample variance is represented by a univariate integral over a Fourier series. If the density is a polynomial…

Statistics Theory · Mathematics 2008-10-10 T. Royen

High-probability guarantees in stochastic optimization are often obtained only under strong noise assumptions such as sub-Gaussian tails. We show that such guarantees can also be achieved under the weaker assumption of bounded variance by…

Optimization and Control · Mathematics 2025-12-23 Jiaming Liang

Uncovering genuine relationships between a response variable of interest and a large collection of covariates is a fundamental and practically important problem. In the context of Gaussian linear models, both the Bayesian and non-Bayesian…

Statistics Theory · Mathematics 2025-04-11 Jeyong Lee , Minwoo Chae , Ryan Martin

The total variation distance is a core statistical distance between probability measures that satisfies the metric axioms, with value always falling in $[0,1]$. This distance plays a fundamental role in machine learning and signal…

Machine Learning · Computer Science 2018-07-02 Frank Nielsen , Ke Sun

This paper derives a new strong Gaussian approximation bound for the sum of independent random vectors. The approach relies on the optimal transport theory and yields \textit{explicit} dependence on the dimension size $p$ and the sample…

Statistics Theory · Mathematics 2021-09-06 Nazar Buzun , Nikolay Shvetsov , Dmitry V. Dylov

We investigate the zero set of a stationary Gaussian process on the real line, and in particular give lower bounds for the variance of the number of points on a large interval, in all generality. We prove that this point process is never…

Probability · Mathematics 2020-07-28 Raphaël Lachièze-Rey

We investigate the frequentist guarantees of the variational sparse Gaussian process regression model. In the theoretical analysis, we focus on the variational approach with spectral features as inducing variables. We derive guarantees and…

Statistics Theory · Mathematics 2023-09-29 Dennis Nieman , Botond Szabo , Harry van Zanten

Minimizing divergence measures under a constraint is an important problem. We derive a sufficient condition that binary divergence measures provide lower bounds for symmetric divergence measures under a given triangular discrimination or…

Information Theory · Computer Science 2022-11-11 Tomohiro Nishiyama

We study the regularity of densities of distributions that are polynomial images of the standard Gaussian measure on $\mathbb{R}^n$. We assume that the degree of a polynomial is fixed and that each variable enters to a power bounded by…

Probability · Mathematics 2020-07-28 Egor Kosov

Random linear mappings are widely used in modern signal processing, compressed sensing and machine learning. These mappings may be used to embed the data into a significantly lower dimension while at the same time preserving useful…

Information Theory · Computer Science 2021-01-22 Halyun Jeong , Xiaowei Li , Yaniv Plan , Özgür Yılmaz

We derive a Gaussian approximation result for the maximum of a sum of high-dimensional random vectors. Specifically, we establish conditions under which the distribution of the maximum is approximated by that of the maximum of a sum of the…

Statistics Theory · Mathematics 2018-01-24 Victor Chernozhukov , Denis Chetverikov , Kengo Kato

In this expository note, we give a modern proof of Hanson-Wright inequality for quadratic forms in sub-gaussian random variables. We deduce a useful concentration inequality for sub-gaussian random vectors. Two examples are given to…

Probability · Mathematics 2013-10-02 Mark Rudelson , Roman Vershynin

We quantify the parameter stability of a spherical Gaussian Mixture Model (sGMM) under small perturbations in distribution space. Namely, we derive the first explicit bound to show that for a mixture of spherical Gaussian $P$ (sGMM) in a…

Machine Learning · Statistics 2023-02-02 Hanyu Zhang , Marina Meila

A continuous-time regression model with a jointly strictly sub-Gaussian random noise is considered in the paper. Upper exponential bounds for probabilities of large deviations of the least squares estimator for the regression parameter are…

Probability · Mathematics 2018-06-12 Alexander V. Ivanov , Igor V. Orlovskyi

Gaussian random number generators attract a widespread interest due to their applications in several fields. Important requirements include easy implementation, tail accuracy, and, finally, a flat spectrum. In this work, we study the…

Information Theory · Computer Science 2024-04-04 Francisco-Javier Soto , Ana I. Gómez , Domingo Gómez-Pérez

Gaussian universality results assert that the properties of many estimators remain unchanged when the input data are replaced by Gaussians. Such results have gained popularity in high-dimensional statistics and machine learning, as…

Probability · Mathematics 2025-12-03 Kevin Han Huang , Morgane Austern , Peter Orbanz

A symmetric random variable is called a Gaussian mixture if it has the same distribution as the product of two independent random variables, one being positive and the other a standard Gaussian random variable. Examples of Gaussian mixtures…

Probability · Mathematics 2019-04-18 Alexandros Eskenazis , Piotr Nayar , Tomasz Tkocz

The goal of this research is to derive an approach to assess uncertainty in an arbitrary volume conditioned by sampling data, without using geostatistical simulation. We have accomplished this goal by deriving an numerical tool suitable for…

Methodology · Statistics 2019-07-22 Alvaro I. Riquelme , Julian M. Ortiz

We address truncated states of continuous variable systems and analyze their statistical properties numerically by generating random states in finite-dimensional Hilbert spaces. In particular, we focus to the distribution of purity and…

Quantum Physics · Physics 2009-08-25 Marco G. Genoni , Matteo G. A. Paris