English
Related papers

Related papers: Optimal sub-Gaussian variance proxy for 3-mass dis…

200 papers

There is growing interest in improving our algorithmic understanding of fundamental statistical problems such as mean estimation, driven by the goal of understanding the limits of what we can extract from valuable data. The state of the art…

Statistics Theory · Mathematics 2023-11-22 Trung Dang , Jasper C. H. Lee , Maoyuan Song , Paul Valiant

In this paper, we consider the distribution of the supremum of non-stationary Gaussian processes, and present a new theoretical result on the asymptotic behaviour of this distribution. Unlike previously known facts in this field, our main…

Probability · Mathematics 2020-05-25 Valentin Konakov , Vladimir Panov , Vladimir Piterbarg

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

Several proofs of the monotonicity of the non-Gaussianness (divergence with respect to a Gaussian random variable with identical second order statistics) of the sum of n independent and identically distributed (i.i.d.) random variables were…

Information Theory · Computer Science 2007-07-13 Jacob Binia

Many inference problems involving questions of optimality ask for the maximum or the minimum of a finite set of unknown quantities. This technical report derives the first two posterior moments of the maximum of two correlated Gaussian…

Machine Learning · Statistics 2009-10-02 Philipp Hennig

Maximizing high-dimensional, non-convex functions through noisy observations is a notoriously hard problem, but one that arises in many applications. In this paper, we tackle this challenge by modeling the unknown function as a sample from…

Machine Learning · Computer Science 2012-07-03 Bo Chen , Rui Castro , Andreas Krause

Gaussian random processes which variances reach theirs maximum values at unique points are considered. Exact asymptotic behaviors of probabilities of large absolute maximums of theirs trajectories have been evaluated using Double Sum Method…

Probability · Mathematics 2019-01-29 E. Hashorva , S. Kobelkov , V. I. Piterbarg

Variational inference methods for latent variable statistical models have gained popularity because they are relatively fast, can handle large data sets, and have deterministic convergence guarantees. However, in practice it is unclear…

Methodology · Statistics 2017-03-22 Hachem Saddiki , Andrew C. Trapp , Patrick Flaherty

In this paper, we study the asymptotic distribution of the maxima of suprema of dependent Gaussian processes with trend. For different scales of the time horizon we obtain different normalizing functions for the convergence of the maxima.…

Probability · Mathematics 2022-11-09 Lanpeng Ji , Xiaofan Peng

This paper derives a new strong Gaussian approximation bound for the sum of independent random vectors. The approach relies on the optimal transport theory and yields \textit{explicit} dependence on the dimension size $p$ and the sample…

Statistics Theory · Mathematics 2021-09-06 Nazar Buzun , Nikolay Shvetsov , Dmitry V. Dylov

We study distributed estimation of a Gaussian mean under communication constraints in a decision theoretical framework. Minimax rates of convergence, which characterize the tradeoff between the communication costs and statistical accuracy,…

Statistics Theory · Mathematics 2020-02-11 T. Tony Cai , Hongji Wei

We propose a generative model that achieves minimax-optimal convergence rates for estimating probability distributions supported on unknown low-dimensional manifolds. Building on Fefferman's solution to the geometric Whitney problem, our…

Statistics Theory · Mathematics 2025-06-25 Arthur Stéphanovitch

We consider the problem of approximating a general Gaussian location mixture by finite mixtures. The minimum order of finite mixtures that achieve a prescribed accuracy (measured by various $f$-divergences) is determined within constant…

Statistics Theory · Mathematics 2025-04-08 Yun Ma , Yihong Wu , Pengkun Yang

We present a new method for proving the norm concentration inequality of sub-Gaussian variables. Our proof is based on an averaged version of the moment generating function, termed the averaged moment generating function. Our method applies…

Probability · Mathematics 2025-05-12 Zishun Liu , Sam Power , Yongxin Chen

We provide sample complexity upper bounds for agnostically learning multivariate Gaussians under the constraint of approximate differential privacy. These are the first finite sample upper bounds for general Gaussians which do not impose…

Machine Learning · Statistics 2020-10-21 Ishaq Aden-Ali , Hassan Ashtiani , Gautam Kamath

This paper investigates the approximation of Gaussian random variables in Banach spaces, focusing on the high-probability bounds for the approximation of Gaussian random variables using finitely many observations. We derive non-asymptotic…

Statistics Theory · Mathematics 2025-08-28 Daniel Winkle , Ingo Steinwart , Bernard Haasdonk

Supplement 1 to GUM (GUM-S1) recommends the use of maximum entropy principle (MaxEnt) in determining the probability distribution of a quantity having specified properties, e.g., specified central moments. When we only know the mean value…

Data Analysis, Statistics and Probability · Physics 2012-07-20 Stefano Olivares , Matteo G. A. Paris

Computing the distribution of permanents of random matrices has been an outstanding open problem for several decades. In quantum computing, "anti-concentration" of this distribution is an unproven input for the proof of hardness of the task…

Quantum Physics · Physics 2021-04-15 Sepehr Nezami

This paper develops an analytical method of truncating inequality constrained Gaussian distributed variables where the constraints are themselves described by Gaussian distributions. Existing truncation methods either assume hard…

Systems and Control · Computer Science 2016-06-08 Andrew W. Palmer , Andrew J. Hill , Steven J. Scheding

We consider the Gumbel or extreme value statistics describing the distribution function p_G(x_max) of the maximum values of a random field x within patches of fixed size. We present, for smooth Gaussian random fields in two and three…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-27 S. Colombi , O. Davis , J. Devriendt , S. Prunet , J. Silk