English
Related papers

Related papers: A Simple Note on the Basic Properties of Subgaussi…

200 papers

Motivated by the subordinated Brownian motion, we define a new class of (in general discontinuous) random fields on higher-dimensional parameter domains: the subordinated Gaussian random field. We investigate the pointwise marginal…

Probability · Mathematics 2022-08-26 Andrea Barth , Robin Merkle

We consider the problem of learning a conditional Gaussian graphical model in the presence of latent variables. Building on recent advances in this field, we suggest a method that decomposes the parameters of a conditional Markov random…

Methodology · Statistics 2017-03-07 Benjamin Frot , Luke Jostins , Gil McVean

In this paper we establish lower bounds on information divergence from a distribution to certain important classes of distributions as Gaussian, exponential, Gamma, Poisson, geometric, and binomial. These lower bounds are tight and for…

Information Theory · Computer Science 2011-02-15 Peter Harremoës , Christophe Vignat

High-probability guarantees in stochastic optimization are often obtained only under strong noise assumptions such as sub-Gaussian tails. We show that such guarantees can also be achieved under the weaker assumption of bounded variance by…

Optimization and Control · Mathematics 2025-12-23 Jiaming Liang

This article revisits the fundamental problem of parameter selection for Gaussian process interpolation. By choosing the mean and the covariance functions of a Gaussian process within parametric families, the user obtains a family of…

Methodology · Statistics 2023-08-09 Sébastien Petit , Julien Bect , Paul Feliot , Emmanuel Vazquez

We establish a large deviation principle for the empirical spectral measure of a sample covariance matrix with sub-Gaussian entries, which extends Bordenave and Caputo's result for Wigner matrices having the same type of entries [7]. To…

Probability · Mathematics 2015-05-22 Benjamin Groux

Products of random $2\times 2$ matrices exhibit Gaussian fluctuations around almost surely convergent Lyapunov exponents. In this paper, the distribution of the random matrices is supported by a small neighborhood of order $\lambda>0$ of…

Mathematical Physics · Physics 2016-10-27 Maxim Drabkin , Hermann Schulz-Baldes

Consider estimating a structured signal $\mathbf{x}_0$ from linear, underdetermined and noisy measurements $\mathbf{y}=\mathbf{A}\mathbf{x}_0+\mathbf{z}$, via solving a variant of the lasso algorithm: $\hat{\mathbf{x}}=\arg\min_\mathbf{x}\{…

Optimization and Control · Mathematics 2014-01-28 Christos Thrampoulidis , Samet Oymak , Babak Hassibi

The Bruss-Robertson inequality gives a bound on the maximal number of elements of a random sample whose sum is less than a specified value, and the extension of that inequality which is given here neither requires the independence of the…

Probability · Mathematics 2015-10-06 J. Michael Steele

In this paper, we examine the distribution and convergence properties of the estimation error $W = X - \hat{X}(Y)$, where $\hat{X}(Y)$ is the Bayesian estimator of a random variable $X$ from a noisy observation $Y = X +\sigma Z$ where…

Information Theory · Computer Science 2025-07-11 Luca Barletta , Alex Dytso , Shlomo Shamai

We study a new family of random variables, that each arise as the distribution of the maximum or minimum of a random number $N$ of i.i.d.~random variables $X_1,X_2,\ldots,X_N$, each distributed as a variable $X$ with support on $[0,1]$. The…

Statistics Theory · Mathematics 2014-03-07 Jie Hao , Anant Godbole

Empirical likelihood is a popular nonparametric statistical tool that does not require any distributional assumptions. In this paper, we explore the possibility of conducting variable selection via Bayesian empirical likelihood. We show…

Methodology · Statistics 2022-06-13 Yichen Cheng , Yichuan Zhao

Consider a measure $\mu_\lambda = \sum_x \xi_x \delta_x$ where the sum is over points $x$ of a Poisson point process of intensity $\lambda$ on a bounded region in $d$-space, and $\xi_x$ is a functional determined by the Poisson points near…

Probability · Mathematics 2013-02-05 Mathew D. Penrose , Andrew R. Wade

Let $X$ be a $d$-dimensional Gaussian process in $[0,1]$, where the component are independent copies of a scalar Gaussian process $X_0$ on $[0,1]$ with a given general variance function $\gamma^2(r)=\operatorname{Var}\left(X_0(r)\right)$…

Probability · Mathematics 2023-08-01 Youssef Hakiki , Frederi Viens

This paper provides a detailed introductory description of Subset Simulation, an advanced stochastic simulation method for estimation of small probabilities of rare failure events. A simple and intuitive derivation of the method is given…

Computation · Statistics 2015-05-14 Konstantin Zuev

Let $A$ be an $n\times n$ random matrix with i.i.d. entries of zero mean, unit variance and a bounded subgaussian moment. We show that the condition number $s_{\max}(A)/s_{\min}(A)$ satisfies the small ball probability estimate $${\mathbb…

Probability · Mathematics 2019-06-18 Alexander E. Litvak , Konstantin Tikhomirov , Nicole Tomczak-Jaegermann

While stochastic variational inference is relatively well known for scaling inference in Bayesian probabilistic models, related methods also offer ways to circumnavigate the approximation of analytically intractable expectations. The key…

Machine Learning · Statistics 2015-09-08 David A. Knowles

We consider the least-square linear regression problem with regularization by the $\ell^1$-norm, a problem usually referred to as the Lasso. In this paper, we first present a detailed asymptotic analysis of model consistency of the Lasso in…

Machine Learning · Computer Science 2009-01-22 Francis Bach

The aim of this paper is to give a precise asymptotic description of some eigenvalue statistics stemming from random matrix theory. More precisely, we consider random determinants of the GUE, Laguerre, Uniform Gram and Jacobi beta ensembles…

Probability · Mathematics 2017-07-25 Martina Dal Borgo , Emma Hovhannisyan , Alain Rouault

Median-of-means (MOM) based procedures provide non-asymptotic and strong deviation bounds even when data are heavy-tailed and/or corrupted. This work proposes a new general way to bound the excess risk for MOM estimators. The core technique…

Machine Learning · Statistics 2020-07-09 Jules Depersin