English

Efficient Concentration with Gaussian Approximation

Probability 2025-12-23 v8 Statistics Theory Statistics Theory

Abstract

Concentration inequalities for the sample mean, like those due to Bernstein, Hoeffding, and Bentkus, are valid for any sample size but overly conservative, yielding confidence intervals that are unnecessarily wide. The central limit theorem (CLT) provides asymptotic confidence intervals with optimal width, but these are invalid for all sample sizes. To resolve this tension, we develop new computable concentration inequalities for bounded variables with asymptotically optimal size, finite-sample validity, and sub-Gaussian decay. These bounds enable the construction of efficient confidence intervals with correct coverage for any sample size and efficient empirical Berry-Esseen bounds that require no prior knowledge of the population variance. We derive our inequalities by tightly bounding non-uniform Kolmogorov and Wasserstein distances to a Gaussian using zero-bias couplings and Stein's method of exchangeable pairs and demonstrate practical improvements over the Bernstein, Hoeffding, Bentkus, Berry-Esseen, Feller-Cram\'er, Romano-Wolf, empirical Bernstein, empirical Bentkus, and coin-betting inequalities.

Keywords

Cite

@article{arxiv.2208.09922,
  title  = {Efficient Concentration with Gaussian Approximation},
  author = {Morgane Austern and Lester Mackey},
  journal= {arXiv preprint arXiv:2208.09922},
  year   = {2025}
}