English
Related papers

Related papers: Concentration bounds for sampling without replacem…

200 papers

Concentration inequalities quantify the deviation of a random variable from a fixed value. In spite of numerous applications, such as opinion surveys or ecological counting procedures, few concentration results are known for the setting of…

Statistics Theory · Mathematics 2015-07-28 Rémi Bardenet , Odalric-Ambrym Maillard

While effective concentration inequalities for suprema of empirical processes exist under boundedness or strict tail assumptions, no comparable results have been available under considerably weaker assumptions. In this paper, we derive…

Probability · Mathematics 2014-10-23 Johannes Lederer , Sara van de Geer

In this paper, we generalize and improve some fundamental concentration inequalities using information on the random variables' higher moments. In particular, we improve the classical Hoeffding's and Bennett's inequalities for the case…

Probability · Mathematics 2023-04-27 Bar Light

Let $\pa{X_{t}}_{t\in T}$ be a family of real-valued centered random variables indexed by a countable set $T$. In the first part of this paper, we establish exponential bounds for the deviation probabilities of the supremum $Z=\sup_{t\in…

Statistics Theory · Mathematics 2009-09-11 Yannick Baraud

We derive explicit Bernstein-type and Bennett-type concentration inequalities for matrix-valued martingale processes with unbounded observations from the Hermitian space $\mathbb{H}(d)$. Specifically, we assume that the…

Probability · Mathematics 2025-02-21 Alexey Kroshnin , Alexandra Suvorikova

This paper establishes sharp dimension-free concentration inequalities and expectation bounds for the deviation of the sum of simple random tensors from its expectation. As part of our analysis, we use generic chaining techniques to obtain…

Probability · Mathematics 2025-09-30 Omar Al-Ghattas , Jiaheng Chen , Daniel Sanz-Alonso

The well-known Bennett-Hoeffding bound for sums of independent random variables is refined, by taking into account truncated third moments, and at that also improved by using, instead of the class of all increasing exponential functions,…

Probability · Mathematics 2017-01-17 Iosif Pinelis

This paper provides a bound for the supremum of sample averages over a class of functions for a general class of mixing stochastic processes with arbitrary mixing rates. Regardless of the speed of mixing, the bound is comprised of a…

Probability · Mathematics 2026-03-27 Demian Pouzo

Let $\mathcal{F}$ be a class of measurable functions on a measurable space $(S,\mathcal{S})$ with values in $[0,1]$ and let \[P_n=n^{-1}\sum_{i=1}^n\delta_{X_i}\] be the empirical measure based on an i.i.d. sample $(X_1,...,X_n)$ from a…

Probability · Mathematics 2016-08-16 Evarist Giné , Vladimir Koltchinskii

We prove limit theorems for sums of randomly chosen random variables conditioned on the summands. We consider several versions of the corner growth setting, including specific cases of dependence amongst the summands and summands with heavy…

Probability · Mathematics 2022-07-01 David Grzybowski

We obtain non asymptotic concentration bounds for two kinds of stochastic approximations. We first consider the deviations between the expectation of a given function of the Euler scheme of some diffusion process at a fixed deterministic…

Probability · Mathematics 2012-12-12 Noufel Frikha , Stephane Menozzi

Considering a general framework of bootstrap with exchangeable weights, we show some concentration inequalities for the supremum of the bootstrap empirical process. On the one hand, we discuss the concentration of the bootstrap empirical…

Statistics Theory · Mathematics 2026-04-06 Guillaume Maillard , Adrien Saumard

We show two novel concentration inequalities for suprema of empirical processes when sampling without replacement, which both take the variance of the functions into account. While these inequalities may potentially have broad applications…

Machine Learning · Statistics 2014-11-27 Ilya Tolstikhin , Gilles Blanchard , Marius Kloft

We derive new concentration bounds for time averages of measurement outcomes in quantum Markov processes. This generalizes well-known bounds for classical Markov chains which provide constraints on finite time fluctuations of time-additive…

Quantum Physics · Physics 2023-07-19 Federico Girotti , Juan P. Garrahan , Mădălin Guţă

We derive, up to a constant factor, matching lower and upper bounds on the concentration functions of suprema of separable centered Gaussian processes and order statistics of Gaussian random fields. These bounds reveal that suprema of…

Probability · Mathematics 2023-10-19 Alexander Giessing

We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing…

Probability · Mathematics 2025-07-01 Joe Neeman , Bobby Shi , Rachel Ward

We give concentration bounds for martingales that are uniform over finite times and extend classical Hoeffding and Bernstein inequalities. We also demonstrate our concentration bounds to be optimal with a matching anti-concentration…

Probability · Mathematics 2015-12-03 Akshay Balsubramani

Concentration inequalities are widely used for analyzing machine learning algorithms. However, current concentration inequalities cannot be applied to some of the most popular deep neural networks, notably in natural language processing.…

Machine Learning · Statistics 2021-03-22 Rémy Garnier , Raphaël Langhendries

We use a generalization of Hoeffding's inequality to show concentration results for the free energy of disordered pinning models, assuming only that the disorder has a finite exponential moment. We also prove some concentration inequalities…

Probability · Mathematics 2012-06-15 Frederique Watbled

We give a simple development of the concentration properties of compound Poisson measures on the nonnegative integers. A new modification of the Herbst argument is applied to an appropriate modified logarithmic-Sobolev inequality to derive…

Probability · Mathematics 2024-05-07 I. Kontoyiannis , M. Madiman
‹ Prev 1 2 3 10 Next ›