English
Related papers

Related papers: Revisiting Concentration of Missing Mass

200 papers

We introduce a version of Stein's method for proving concentration and moment inequalities in problems with dependence. Simple illustrative examples from combinatorics, physics, and mathematical statistics are provided.

Probability · Mathematics 2007-05-23 Sourav Chatterjee

The problem of missing mass in statistical inference (posed by McAllester and Ortiz, NIPS'02; most recently revisited by Changa and Thangaraj, ISIT'2019) seeks to estimate the weight of symbols that have not been sampled yet from a source.…

Probability · Mathematics 2020-01-15 Maciej Skorski

We obtain a Bernstein type Gaussian concentration inequality for martingales. Our inequality improves the Azuma-Hoeffding inequality for moderate deviations $x$. Following the work of McDiarmid (1989), Talagrand (1996) and Boucheron, Lugosi…

Probability · Mathematics 2017-10-17 Xiequan Fan

A random variable is sampled from a discrete distribution. The missing mass is the probability of the set of points not observed in the sample. We sharpen and simplify McAllester and Ortiz's results (JMLR, 2003) bounding the probability of…

Probability · Mathematics 2012-10-12 Daniel Berend , Aryeh Kontorovich

For a wide class of monotonic functions $f$, we develop a Chernoff-style concentration inequality for quadratic forms $Q_f \sim \sum\limits_{i=1}^n f(\eta_i) (Z_i + \delta_i)^2$, where $Z_i \sim N(0,1)$. The inequality is expressed in terms…

Statistics Theory · Mathematics 2019-11-14 Robert E. Gallagher , Louis J. M. Aslett , David Steinsaltz , Ryan R. Christ

We prove a Bennett-type concentration bound for suprema of empirical processes based on sampling without replacement and a corresponding bound in the case of an arbitrary Hoeffding statistics. We improve on the previous results of such…

Probability · Mathematics 2023-01-10 Bartłomiej Polaczyk

Matrix concentration inequalities provide a direct way to bound the typical spectral norm of a random matrix. The methods for establishing these results often parallel classical arguments, such as the Laplace transform method. This work…

Information Theory · Computer Science 2014-04-29 Joel A. Tropp , Richard Y. Chen

We present Rosenthal-type moment inequalities for matrix-valued U-statistics of order 2. As a corollary, we obtain new matrix concentration inequalities for U-statistics. One of our main technical tools, a version of the non-commutative…

Probability · Mathematics 2019-10-22 Stanislav Minsker , Xiaohan Wei

We obtain optimal moment bounds for Birkhoff sums, and optimal concentration inequalities, for a large class of slowly mixing dynamical systems, including those that admit anomalous diffusion in the form of a stable law or a central limit…

Dynamical Systems · Mathematics 2017-09-01 Sébastien Gouëzel , Ian Melbourne

Concentration inequalities, a major tool in probability theory, quantify how much a random variable deviates from a certain quantity. This paper proposes a systematic convex optimization approach to studying and generating concentration…

Probability · Mathematics 2024-08-30 Celine Moucer , Adrien Taylor , Francis Bach

This is a companion paper of a recent one, entitled {\sl Integral concentration of idempotent trigonometric polynomials with gaps}. New results of the present work concern $L^1$ concentration, while the above mentioned paper deals with…

Classical Analysis and ODEs · Mathematics 2008-12-01 Aline Bonami , Szilárd Gy. Révész

We study the exact constants in the moment inequalities for sums of centered independent random variables: improve their asymptotics, low and upper bounds, calculate more exact asymptotics, elaborate the numerical algorithm for their…

Probability · Mathematics 2007-05-23 B. Naimark , E. Ostrovsky

We give a simple development of the concentration properties of compound Poisson measures on the nonnegative integers. A new modification of the Herbst argument is applied to an appropriate modified logarithmic-Sobolev inequality to derive…

Probability · Mathematics 2024-05-07 I. Kontoyiannis , M. Madiman

This paper first introduces a refined version of the Azuma-Hoeffding inequality for discrete-parameter martingales with uniformly bounded jumps. The refined inequality is used to revisit the large deviations analysis of binary hypothesis…

Information Theory · Computer Science 2012-07-17 Igal Sason

This paper derives exponential concentration inequalities and polynomial moment inequalities for the spectral norm of a random matrix. The analysis requires a matrix extension of the scalar concentration theory developed by Sourav…

Probability · Mathematics 2014-04-29 Lester Mackey , Michael I. Jordan , Richard Y. Chen , Brendan Farrell , Joel A. Tropp

Stein's method for concentration inequalities was introduced to prove concentration of measure in problems involving complex dependencies such as random permutations and Gibbs measures. In this paper, we provide some extensions of the…

Probability · Mathematics 2010-11-11 Sourav Chatterjee , Partha S. Dey

We derive simple concentration inequalities for bounded random vectors, which generalize Hoeffding's inequalities for bounded scalar random variables. As applications, we apply the general results to multinomial and Dirichlet distributions…

Probability · Mathematics 2013-11-05 Xinjia Chen

A general method for obtaining moment inequalities for functions of independent random variables is presented. It is a generalization of the entropy method which has been used to derive concentration inequalities for such functions…

Probability · Mathematics 2007-05-23 Stephane Boucheron , Olivier Bousquet , Gabor Lugosi , Pascal Massart

In this paper, we establish novel concentration inequalities for additive functionals of geometrically ergodic Markov chains similar to Rosenthal inequalities for sums of independent random variables. We pay special attention to the…

Probability · Mathematics 2025-09-26 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Marina Sheshukova

We are interested in the behavior of particular functionals, in a framework where the only source of randomness is a sampling without replacement. More precisely the aim of this short note is to prove an exponential concentration inequality…

Statistics Theory · Mathematics 2018-08-29 P Hodara , Patricia Reynaud-Bouret