English
Related papers

Related papers: A Sharp Lower-tail Bound for Gaussian Maxima with …

200 papers

This article studies bootstrap inference for high dimensional weakly dependent time series in a general framework of approximately linear statistics. The following high dimensional applications are covered: (1) uniform confidence band for…

Statistics Theory · Mathematics 2014-08-12 Xianyang Zhang , Guang Cheng

We present upper and lower bounds for the prediction error of the Lasso. For the case of random Gaussian design, we show that under mild conditions the prediction error of the Lasso is up to smaller order terms dominated by the prediction…

Statistics Theory · Mathematics 2018-04-04 Sara van de Geer

Quadratic variations of Gaussian processes play important role in both stochastic analysis and in applications such as estimation of model parameters, and for this reason the topic has been extensively studied in the literature. In this…

Probability · Mathematics 2015-02-06 Lauri Viitasaari

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

The study of tail behaviour of SGD-induced processes has been attracting a lot of interest, due to offering strong guarantees with respect to individual runs of an algorithm. While many works provide high-probability guarantees, quantifying…

Machine Learning · Computer Science 2026-02-06 Aleksandar Armacki , Dragana Bajović , Dušan Jakovetić , Soummya Kar , Ali H. Sayed

This note describes the concentration phenomenon for a high dimensional sub-gaussian vector \( X \). In the Gaussian case, for any linear operator \( Q \), it holds \( P\bigl( \| Q X \|^{2} - tr (B) > 2 \sqrt{x\, tr(B^{2})} + 2 \| B \| x…

Probability · Mathematics 2024-06-11 Vladimir Spokoiny

Gaussian Process Regression is a popular nonparametric regression method based on Bayesian principles that provides uncertainty estimates for its predictions. However, these estimates are of a Bayesian nature, whereas for some important…

Machine Learning · Computer Science 2023-08-09 Christian Fiedler , Carsten W. Scherer , Sebastian Trimpe

This work derives extremal tail bounds for the Gaussian trace estimator applied to a real symmetric matrix. We define a partial ordering on the eigenvalues, so that when a matrix has greater spectrum under this ordering, its estimator will…

Statistics Theory · Mathematics 2024-11-26 Eric Hallman

Gaussian Processes (GPs) are widely employed in control and learning because of their principled treatment of uncertainty. However, tracking uncertainty for iterative, multi-step predictions in general leads to an analytically intractable…

We study the upper tail of the number of arithmetic progressions of a given length in a random subset of {1,...,n}, establishing exponential bounds which are best possible up to constant factors in the exponent. The proof also extends to…

Combinatorics · Mathematics 2017-12-12 Lutz Warnke

In this paper, we estimate the sparse dependence structure in the tail region of a multivariate random vector, potentially of high dimension. The tail dependence is modeled via a graphical model for extremes embedded in the H\"usler-Reiss…

Methodology · Statistics 2026-04-15 Phyllis Wan , Chen Zhou

We present an efficient algorithm to compute tight upper bounds of collision probability between two objects with positional uncertainties, whose error distributions are represented with non-Gaussian forms. Our approach can handle noisy…

Robotics · Computer Science 2019-12-17 Jae Sung Park , Dinesh Manocha

We prove an exponential probability tail inequality for positive semidefinite quadratic forms in a subgaussian random vector. The bound is analogous to one that holds when the vector has independent Gaussian entries.

Probability · Mathematics 2011-10-14 Daniel Hsu , Sham M. Kakade , Tong Zhang

Let $\{X_1, X_2, ... \}$ be a sequence of dependent heavy-tailed random variables with distributions $F_1, F_2,...$ on $(-\infty,\infty)$, and let $\tau$ be a nonnegative integer-valued random variable independent of the sequence $\{X_k, k…

Probability · Mathematics 2013-02-28 Kam Chuen Yuen , Chuancun Yin

In this paper, we present a new framework to obtain tail inequalities for sums of random matrices. Compared with existing works, our tail inequalities have the following characteristics: 1) high feasibility--they can be used to study the…

Machine Learning · Computer Science 2019-10-10 Chao Zhang , Min-Hsiu Hsieh , Dacheng Tao

We construct examples of degree-two U- and V-statistics of $n$ i.i.d.~heavy-tailed random vectors in $\mathbb{R}^{d(n)}$, whose $\nu$-th moments exist for ${\nu > 2}$, and provide tight bounds on the error of approximating both statistics…

Statistics Theory · Mathematics 2024-06-19 Kevin Han Huang , Peter Orbanz

We establish non-asymptotic bounds on the finite-sample behavior of generalized first-order iterative algorithms -- including gradient-based optimization methods and approximate message passing (AMP) -- with Gaussian data matrices and…

Machine Learning · Statistics 2025-08-15 Galen Reeves

Let $X_1,\dots,X_n$ be independent normal random variables with $X_i\sim N(\mu_i,\sigma_i^2)$, and set $Z=\prod_{i=1}^n X_i$. We derive asymptotic approximations for the right tail probability $\mathbb{P}(Z>x)$ as $x\to\infty$. When at…

Probability · Mathematics 2026-05-08 Džiugas Chvoinikov , Jonas Šiaulys

We derive a scale-free bound on the density of the maximum of a centered Gaussian vector. The basic bound is non-uniform, depends logarithmically on the dimension, and allows any covariance matrix. When the largest marginal variance is…

Statistics Theory · Mathematics 2026-05-29 Suhas Vijaykumar

We consider the problem $(\mathrm{P})$ of fitting $n$ standard Gaussian random vectors in $\mathbb{R}^d$ to the boundary of a centered ellipsoid, as $n, d \to \infty$. This problem is conjectured to have a sharp feasibility transition: for…

Probability · Mathematics 2024-10-03 Afonso S. Bandeira , Antoine Maillard , Shahar Mendelson , Elliot Paquette