English
Related papers

Related papers: On the method of typical bounded differences

200 papers

We consider a special class of weak dependent random variables with control on covariances of Lipschitz transformations. This class includes, but is not limited to, positively, negatively associated variables and a few other classes of…

Probability · Mathematics 2017-02-06 Idir Arab , Paulo Eduardo Oliveira

For a real-valued measurable function $f$ and a nonnegative, nondecreasing function $\phi$, we first obtain a Chebyshev type inequality which provides an upper bound for $\displaystyle \phi(\lambda_{1}) \mu(\{x \in \Omega : f(x) \geq…

Functional Analysis · Mathematics 2022-09-14 M. Ashraf Bhat , G. Sankara Raju Kosuru

Given $X_1,\cdot ,X_N$ random variables whose joint distribution is given as $\mu$ we will use the Martingale Method to show any Lipshitz Function $f$ over these random variables is subgaussian. The Variance parameter however can have a…

Machine Learning · Computer Science 2023-01-10 Debangshu Banerjee

We establish an Azuma type inequality under a Lipshitz condition for martingales in the framework of noncommutative probability spaces and apply it to deduce a noncommutative Heoffding inequality as well as a noncommutative McDiarmid type…

Operator Algebras · Mathematics 2021-07-23 Ghadir Sadeghi , Mohammad Sal Moslehian

We prove an elementary yet useful inequality bounding the maximal value of certain linear programs. This leads directly to a bound on the martingale difference for arbitrarily dependent random variables, providing a generalization of some…

Functional Analysis · Mathematics 2007-05-23 Leonid Kontorovich

The aim of this short note is to give an alternative proof, which applies to functions of bounded variation in arbitrary domains, of an inequality by Maz'ya that improves Friedrichs inequality. A remarkable feature of such a proof is that…

Analysis of PDEs · Mathematics 2017-12-19 Luca Rondi

We prove an extension of McDiarmid's inequality for metric spaces with unbounded diameter. To this end, we introduce the notion of the {\em subgaussian diameter}, which is a distribution-dependent refinement of the metric diameter. Our…

Probability · Mathematics 2013-09-12 Aryeh Kontorovich

We derive explicit central moment inequalities for random variables that admit a Stein coupling, such as exchangeable pairs, size--bias couplings or local dependence, among others. The bounds are in terms of moments (not necessarily…

Probability · Mathematics 2020-07-07 A. D. Barbour , Nathan Ross , Yuting Wen

We generalize McDiarmid's inequality for functions with bounded differences on a high probability set, using an extension argument. Those functions concentrate around their conditional expectations. We further extend the results to…

Machine Learning · Computer Science 2024-05-03 Richard Combes

For a map of the unit interval with an indifferent fixed point, we prove an upper bound for the variance of all observables of $n$ variables $K:[0,1]^n\to\R$ which are componentwise Lipschitz. The proof is based on coupling and decay of…

Dynamical Systems · Mathematics 2009-08-27 J. -R. Chazottes , P. Collet , F. Redig , E. Verbitskiy

We establish Hoeffding-type concentration inequalities for the low and high tail bounds of sums of exchangeable random variables. Our results exhibit an anti-symmetry in such tail bounds due to the assumption of exchangeability, a…

Optimization and Control · Mathematics 2026-03-12 Nina Maria Gottschling , Michele Caprio

A bound uniform over various loss-classes is given for data generated by stationary and phi-mixing processes, where the mixing time (the time needed to obtain approximate independence) enters the sample complexity only in an additive way.…

Machine Learning · Computer Science 2023-06-02 Andreas Maurer

Score-based diffusion models have demonstrated outstanding empirical performance in machine learning and artificial intelligence, particularly in generating high-quality new samples from complex probability distributions. Improving the…

Machine Learning · Statistics 2025-05-30 Yuchen Jiao , Gen Li

Azuma's inequality is a tool for proving concentration bounds on random variables. The inequality can be thought of as a natural generalization of additive Chernoff bounds. On the other hand, the analogous generalization of multiplicative…

Data Structures and Algorithms · Computer Science 2025-01-07 William Kuszmaul , Qi Qi

The classical Gaussian concentration inequality for Lipschitz functions is adapted to a setting where the classical assumptions (i.e. Lipschitz and Gaussian) are not met. The theory is more direct than much of the existing theory designed…

Probability · Mathematics 2022-05-16 Daniel J. Fresen

A metric probability space $(\Omega,d)$ obeys the ${\it concentration\; of\; measure\; phenomenon}$ if subsets of measure $1/2$ enlarge to subsets of measure close to 1 as a transition parameter $\epsilon$ approaches a limit. In this paper…

Probability · Mathematics 2024-08-07 Jonathan Root , Mark Kon

Concentration inequalities for the sample mean, like those due to Bernstein, Hoeffding, and Bentkus, are valid for any sample size but overly conservative, yielding confidence intervals that are unnecessarily wide. The central limit theorem…

Probability · Mathematics 2025-12-23 Morgane Austern , Lester Mackey

We develop a new technique for proving concentration inequalities which relate between the variance and influences of Boolean functions. Using this technique, we 1. Settle a conjecture of Talagrand [Tal97] proving that $$\int_{\left\{…

Probability · Mathematics 2020-03-13 Ronen Eldan , Renan Gross

Let $\boldsymbol{X}$ be a $d$-dimensional random array on $[n]$ whose entries take values in a finite set $\mathcal{X}$, that is, $\boldsymbol{X}=\langle X_s:s\in \binom{[n]}{d}\rangle$ is an $\mathcal{X}$-valued stochastic process indexed…

Probability · Mathematics 2023-10-26 Pandelis Dodos , Konstantinos Tyros , Petros Valettas

Slow mixing is the central hurdle when working with Markov chains, especially those used for Monte Carlo approximations (MCMC). In many applications, it is only of interest to estimate the stationary expectations of a small set of…

Statistics Theory · Mathematics 2016-10-04 Maxim Rabinovich , Aaditya Ramdas , Michael I. Jordan , Martin J. Wainwright