English
Related papers

Related papers: Improved Central Limit Theorem and Bootstrap Appro…

200 papers

Given an ODE and its perturbation, the Alekseev formula expresses the solutions of the latter in terms related to the former. By exploiting this formula and a new concentration inequality for martingale-differences, we develop a novel…

Optimization and Control · Mathematics 2019-04-02 Gugan Thoppe , Vivek S. Borkar

Inference for functional linear models in the presence of heteroscedastic errors has received insufficient attention given its practical importance; in fact, even a central limit theorem has not been studied in this case. At issue,…

Statistics Theory · Mathematics 2024-05-27 Hyemin Yeon , Xiongtao Dai , Daniel John Nordman

Let $X_1,\ldots,X_n$ be a random sample from an unknown probability distribution $P$ on the sample space ${\cal X}$, and let $\theta=\theta(P)$ be a parameter of interest. The present paper proposes a nonparametric `Bayesian bootstrap'…

Statistics Theory · Mathematics 2026-05-13 Nils Lid Hjort

We study the finite-time convergence of projected linear two-time-scale stochastic approximation with constant step sizes and Polyak--Ruppert averaging. We establish an explicit mean-square error bound, decomposing it into two interpretable…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Yitao Bai , Thinh T. Doan , Justin Romberg

We consider the problem of Gaussian multiplier bootstrap procedures for the $k$th largest statistics and functions of the top $k$ order statistics, which are commonly encountered in high-dimensional statistical inference. Such a problem has…

Statistics Theory · Mathematics 2026-03-04 Yixi Ding , Qizhai Li , Yuke Shi , Liuquan Sun , Luobin Zhang

In this article, we are interested in the high dimensional normal approximation of $T_n =\Big(\sum_{i=1}^{n}X_{i1}/\Big(\sqrt{\sum_{i=1}^{n}X_{i1}^2}\Big),\dots,$ $\sum_{i=1}^{n}X_{ip}/\Big(\sqrt{\sum_{i=1}^{n}X_{ip}^2}\Big)\Big)$ in…

Probability · Mathematics 2025-12-29 Debraj Das

Approximating the solution of the nonlinear filtering problem with Gaussian mixtures has been a very popular method since the 1970s. However, the vast majority of such approximations are introduced in an ad-hoc manner without theoretical…

Probability · Mathematics 2014-01-28 Dan Crisan , Kai Li

Using the subordination approach, we provide a new Berry-Esseen-type estimate in the free central limit theorem in terms of the fourth Lyapunov fraction. In the special case of identical distributions, our result implies a rate of order…

Probability · Mathematics 2025-04-01 Leonie Neufeld

In this work, we study the normal approximation and almost sure central limit theorems for some functionals of an independent sequence of Rademacher random variables. In particular, we provide a new chain rule that improves the one derived…

Probability · Mathematics 2018-10-16 Guangqu Zheng

Federated Learning has gained traction in privacy-sensitive collaborative environments, with local SGD emerging as a key optimization method in decentralized settings. While its convergence properties are well-studied, asymptotic…

Machine Learning · Statistics 2026-05-08 Soham Bonnerjee , Sayar Karmakar , Wei Biao Wu

In the context of principal components analysis (PCA), the bootstrap is commonly applied to solve a variety of inference problems, such as constructing confidence intervals for the eigenvalues of the population covariance matrix $\Sigma$.…

Statistics Theory · Mathematics 2022-02-17 Junwen Yao , Miles E. Lopes

We generalize the Brezzi-Rappaz-Raviart approximation theorem, which allows to obtain existence and a priori error estimates for approximations of solutions to some nonlinear partial differential equations. Our contribution lies in the fact…

Numerical Analysis · Mathematics 2026-05-08 Jules Berry , Olivier Ley , Francisco José Silva

In their seminal work, Polyak and Juditsky showed that stochastic approximation algorithms for solving smooth equations enjoy a central limit theorem. Moreover, it has since been argued that the asymptotic covariance of the method is best…

Optimization and Control · Mathematics 2023-01-18 Damek Davis , Dmitriy Drusvyatskiy , Liwei Jiang

We provide finite sample bounds on the Normal approximation to the law of the least squares estimator of the projection parameters normalized by the sandwich-based standard errors. Our results hold in the increasing dimension setting and…

Statistics Theory · Mathematics 2021-10-25 Arun Kumar Kuchibhotla , Alessandro Rinaldo , Larry Wasserman

Motivated by the widespread use of temporal-difference (TD-) and Q-learning algorithms in reinforcement learning, this paper studies a class of biased stochastic approximation (SA) procedures under a mild "ergodic-like" assumption on the…

Machine Learning · Statistics 2020-09-02 Gang Wang , Bingcong Li , Georgios B. Giannakis

We study the statistical and computational complexities of the Polyak step size gradient descent algorithm under generalized smoothness and Lojasiewicz conditions of the population loss function, namely, the limit of the empirical loss…

Machine Learning · Computer Science 2021-10-18 Tongzheng Ren , Fuheng Cui , Alexia Atsidakou , Sujay Sanghavi , Nhat Ho

We consider the first serial correlation coefficient under an AR(1) model where errors are not assumed to be Gaussian. In this case it is necessary to consider bootstrap approximations for tests based on the statistic since the distribution…

Statistics Theory · Mathematics 2013-06-07 Chris Field , John Robinson

We establish higher-order nonasymptotic expansions for a difference between probability distributions of sums of i.i.d. random vectors in a Euclidean space. The derived bounds are uniform over two classes of sets: the set of all Euclidean…

Statistics Theory · Mathematics 2022-11-30 Mayya Zhilova

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when…

Methodology · Statistics 2018-02-14 Daniela Calvetti , Matthew M. Dunlop , Erkki Somersalo , Andrew M. Stuart

The Bonferroni adjustment, or the union bound, is commonly used to study rate optimality properties of statistical methods in high-dimensional problems. However, in practice, the Bonferroni adjustment is overly conservative. The extreme…

Methodology · Statistics 2020-01-13 Hang Deng , Cun-Hui Zhang