English
Related papers

Related papers: Normal approximation for nonlinear statistics usin…

200 papers

Using Stein's method techniques, we develop a framework which allows one to bound the error terms arising from approximation by the Laplace distribution and apply it to the study of random sums of mean zero random variables. As a corollary,…

Probability · Mathematics 2014-10-29 John Pike , Haining Ren

This note describes non-asymptotic variance and tail bounds for order statistics of samples of independent identically distributed random variables. Those bounds are checked to be asymptotically tight when the sampling distribution belongs…

Probability · Mathematics 2012-11-05 Stephane Boucheron , Maud Thomas

We obtain non asymptotic concentration bounds for two kinds of stochastic approximations. We first consider the deviations between the expectation of a given function of the Euler scheme of some diffusion process at a fixed deterministic…

Probability · Mathematics 2012-12-12 Noufel Frikha , Stephane Menozzi

This article is a survey of results concerning an inequality, which may be seen as a versatile tool to solve problems in the domain of Applied Probability. The inequality, which we call BRS-inequality, gives a convenient upper bound for the…

Probability · Mathematics 2020-07-13 F. Thomas Bruss

We derive novel concentration inequalities that bound the statistical error for a large class of stochastic optimization problems, focusing on the case of unbounded objective functions. Our derivations utilize the following key tools: 1) A…

Machine Learning · Statistics 2026-01-01 Jeremiah Birrell

Central limit theorems (CLTs) have a long history in probability and statistics. They play a fundamental role in constructing valid statistical inference procedures. Over the last century, various techniques have been developed in…

Statistics Theory · Mathematics 2023-06-27 Arisina Banerjee , Arun K Kuchibhotla

Linear regression is arguably the most widely used statistical method. With fixed regressors and correlated errors, the conventional wisdom is to modify the variance-covariance estimator to accommodate the known correlation structure of the…

Statistics Theory · Mathematics 2024-10-11 Zifeng Zhang , Peng Ding , Wen Zhou , Haonan Wang

Concentration inequalities for the sample mean, like those due to Bernstein, Hoeffding, and Bentkus, are valid for any sample size but overly conservative, yielding confidence intervals that are unnecessarily wide. The central limit theorem…

Probability · Mathematics 2025-12-23 Morgane Austern , Lester Mackey

We provide a Lyapunov type bound in the multivariate central limit theorem for sums of independent, but not necessarily identically distributed random vectors. The error in the normal approximation is estimated for certain classes of sets,…

Probability · Mathematics 2019-07-24 Martin Raič

Bootstrap for nonlinear statistics like U-statistics of dependent data has been studied by several authors. This is typically done by producing a bootstrap version of the sample and plugging it into the statistic. We suggest an alternative…

Statistics Theory · Mathematics 2015-05-28 Olimjon Sh. Sharipov , Johannes Tewes , Martin Wendler

We consider a random variable $X$ that takes values in a (possibly infinite-dimensional) topological vector space $\mathcal{X}$. We show that, with respect to an appropriate "normal distance" on $\mathcal{X}$, concentration inequalities for…

Probability · Mathematics 2010-09-27 Timothy John Sullivan , Houman Owhadi

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

This paper proves a Berry--Esseen theorem for sample quantiles of strongly-mixing random variables under a polynomial mixing rate. The rate of normal approximation is shown to be $O(n^{-1/2})$ as $n\to\infty$, where $n$ denotes the sample…

Probability · Mathematics 2009-03-02 S. N. Lahiri , S. Sun

Using a modification of Stein's method, we generalize the results of Bentkus, G{\"o}tze, and Tikhomirov \cite{bentkus1997berry} to obtain Berry-Esseen bounds for a broad class of statistics of sequences of $\phi$-mixing, non-stationary…

Probability · Mathematics 2026-04-07 Brendan Williams , Yeor Hafouta

Let $X_n=\sum_{i=1}^{\infty}a_i\epsilon_{n-i}$, where the $\epsilon_i$ are i.i.d. with mean 0 and at least finite second moment, and the $a_i$ are assumed to satisfy $|a_i|=O(i^{-\beta})$ with $\beta >1/2$. When $1/2<\beta<1$, $X_n$ is…

Statistics Theory · Mathematics 2008-12-18 Tsung-Lin Cheng , Hwai-Chung Ho

A distributional symmetry is invariance of a distribution under a group of transformations. Exchangeability and stationarity are examples. We explain that a result of ergodic theory provides a law of large numbers: If the group satisfies…

Statistics Theory · Mathematics 2021-11-30 Morgane Austern , Peter Orbanz

We derive tight and computable bounds on the bias of statistical estimators, or more generally of quantities of interest, when evaluated on a baseline model P rather than on the typically unknown true model Q. Our proposed method combines…

Information Theory · Computer Science 2017-07-04 Konstantinos Gourgoulias , Markos A. Katsoulakis , Luc Rey-Bellet , Jie Wang

The $T$-test is probably the most popular statistical test; it is routinely recommended by the textbooks. The applicability of the test relies upon the validity of normal or Student's approximation to the distribution of Student's statistic…

Statistics Theory · Mathematics 2021-01-01 S. Y. Novak

We derive Berry-Esseen approximation bounds for general functionals of independent random variables, based on chaos expansions methods. Our results apply to $U$-statistics satisfying the weak assumption of decomposability in the Hoeffding…

Probability · Mathematics 2020-10-12 Nicolas Privault , Grzegorz Serafin

In this paper we obtain non-uniform Berry-Esseen bounds for normal approximations by the Malliavin-Stein method. The techniques rely on a detailed analysis of the solutions of Stein's equations and will be applied to functionals of a…

Probability · Mathematics 2024-09-17 Marius Butzek , Peter Eichelsbacher