English
Related papers

Related papers: Concentration Inequalities for Sample Cross-Covari…

200 papers

The q-Gaussians are discussed from the point of view of variance mixtures of normals and exchangeability. For each q< 3, there is a q-Gaussian distribution that maximizes the Tsallis entropy under suitable constraints. This paper shows that…

Probability · Mathematics 2015-05-14 Marjorie G. Hahn , Xinxin Jiang , Sabir Umarov

We study the detection of a change in the covariance matrix of $n$ independent sub-Gaussian random variables of dimension $p$. Our first contribution is to show that $\log\log(8n)$ is the exact minimax testing rate for a change in variance…

Statistics Theory · Mathematics 2025-02-11 Per August Jarval Moen

This work performs a non-asymptotic analysis of the generalized Lasso under the assumption of sub-exponential data. Our main results continue recent research on the benchmark case of (sub-)Gaussian sample distributions and thereby explore…

Statistics Theory · Mathematics 2023-01-18 Martin Genzel , Christian Kipp

The topics dicussed in this paper take their origin inthe estimation of the Gram matrix of a random vector from a sample made of n independent copies. They comprise the estimation of the covariance matrix and the study of least squares…

Statistics Theory · Mathematics 2016-03-17 Olivier Catoni

We derive Concentration of Measure (CoM) inequalities for randomized Toeplitz matrices. These inequalities show that the norm of a high-dimensional signal mapped by a Toeplitz matrix to a low-dimensional space concentrates around its mean…

Information Theory · Computer Science 2016-11-17 Borhan M. Sanandaji , Tyrone L. Vincent , Michael B. Wakin

We consider the problem of estimating small ball probabilities $\mathbb P\{f(G) \leqslant \delta \mathbb Ef(G)\}$ for sub-additive,positively homogeneous functions $f$ with respect to the Gaussian measure. We establish estimates that depend…

Functional Analysis · Mathematics 2021-07-29 Grigoris Paouris , Konstantin Tikhomirov , Petros Valettas

We study concentration inequalities for structured weighted sums of random data, including (i) tensor inner products and (ii) sequential matrix sums. We are interested in tail bounds and concentration inequalities for those structured…

Statistics Theory · Mathematics 2026-02-11 Chen Cheng , Rina Foygel Barber

We discuss Bayesian inference for a known-mean Gaussian model with a compound symmetric variance-covariance matrix. Since the space of such matrices is a linear subspace of that of positive definite matrices, we utilize the methods of…

Methodology · Statistics 2023-03-20 Zachary M. Pisano

Let $A$ be an isotropic, sub-gaussian $m \times n$ matrix. We prove that the process $Z_x := \|Ax\|_2 - \sqrt m \|x\|_2$ has sub-gaussian increments. Using this, we show that for any bounded set $T \subseteq \mathbb{R}^n$, the deviation of…

Probability · Mathematics 2016-06-08 Christopher Liaw , Abbas Mehrabian , Yaniv Plan , Roman Vershynin

Hanson-Wright inequality provides a powerful tool for bounding the norm $|\xi|$ of a centered stochastic vector $\xi$ with sub-gaussian behavior. This paper extends the bounds to the case when $\xi$ only has bounded exponential moments of…

Probability · Mathematics 2023-09-06 Vladimir Spokoiny

We study the problem of estimating the mean of a random vector $X$ given a sample of $N$ independent, identically distributed points. We introduce a new estimator that achieves a purely sub-Gaussian performance under the only condition that…

Statistics Theory · Mathematics 2017-02-03 Gábor Lugosi , Shahar Mendelson

Let $\mathbf{X} = (X_i)_{1\leq i \leq n}$ be an i.i.d. sample of square-integrable variables in $\mathbb{R}^d$, \GB{with common expectation $\mu$ and covariance matrix $\Sigma$, both unknown.} We consider the problem of testing if $\mu$ is…

Machine Learning · Computer Science 2021-10-11 Gilles Blanchard , Jean-Baptiste Fermanian

We consider Gaussian mixture models in high dimensions and concentrate on the twin tasks of detection and feature selection. Under sparsity assumptions on the difference in means, we derive information bounds and establish the performance…

Statistics Theory · Mathematics 2016-10-04 Nicolas Verzelen , Ery Arias-Castro

Concentration inequalities quantify the deviation of a random variable from a fixed value. In spite of numerous applications, such as opinion surveys or ecological counting procedures, few concentration results are known for the setting of…

Statistics Theory · Mathematics 2015-07-28 Rémi Bardenet , Odalric-Ambrym Maillard

In this note we derive a sharp concentration inequality for the supremum of a smooth random field over a finite dimensional set. It is shown that this supremum can be bounded with high probability by the value of the field at some…

Statistics Theory · Mathematics 2013-07-08 Denis Belomestny , Vladimir Spokoiny

We prove a Chevet type inequality which gives an upper bound for the norm of an isotropic log-concave unconditional random matrix in terms of expectation of the supremum of "symmetric exponential" processes compared to the Gaussian ones in…

We derive tight non-asymptotic bounds for the Kolmogorov distance between the probabilities of two Gaussian elements to hit a ball in a Hilbert space. The key property of these bounds is that they are dimension-free and depend on the…

Probability · Mathematics 2018-03-08 Friedrich Götze , Alexey Naumov , Vladimir Spokoiny , Vladimir Ulyanov

We propose optimal Bayesian two-sample tests for testing equality of high-dimensional mean vectors and covariance matrices between two populations. In many applications including genomics and medical imaging, it is natural to assume that…

Methodology · Statistics 2021-12-07 Kyoungjae Lee , Kisung You , Lizhen Lin

We investigate the accuracy of the two most common estimators for the maximum expected value of a general set of random variables: a generalization of the maximum sample average, and cross validation. No unbiased estimator exists and we…

Machine Learning · Statistics 2013-03-04 Hado van Hasselt

This paper derives exponential tail bounds and polynomial moment inequalities for the spectral norm deviation of a random matrix from its mean value. The argument depends on a matrix extension of Stein's method of exchangeable pairs for…

Probability · Mathematics 2013-05-06 Daniel Paulin , Lester Mackey , Joel A. Tropp