English
Related papers

Related papers: Nonasymptotic CLT and Error Bounds for Two-Time-Sc…

200 papers

In two-time-scale stochastic approximation (SA), two iterates are updated at different rates, governed by distinct step sizes, with each update influencing the other. Previous studies have demonstrated that the convergence rates of the…

Probability · Mathematics 2026-02-12 Yuze Han , Xiang Li , Jiadong Liang , Zhihua Zhang

We investigate the statistical properties of Temporal Difference (TD) learning with Polyak-Ruppert averaging, arguably one of the most widely used algorithms in reinforcement learning, for the task of estimating the parameters of the…

Machine Learning · Statistics 2026-02-25 Weichen Wu , Gen Li , Yuting Wei , Alessandro Rinaldo

Recent work in dynamic causal inference introduced a class of discrete-time stochastic processes that generalize martingale difference sequences and arrays as follows: the random variates in each sequence have expectation zero given certain…

Statistics Theory · Mathematics 2025-12-05 Walter Dempsey , Easton Huch

In these notes, we obtain new stability estimates for centered non-degenerate selfdecomposable probability measures on $\mathbb{R}^d$ with finite second moment and for non-degenerate symmetric $\alpha$-stable probability measures on…

Probability · Mathematics 2024-10-01 Benjamin Arras

This paper is concerned with normal approximation under relaxed moment conditions using Stein's method. We obtain the explicit rates of convergence in the central limit theorem for (i) nonlinear statistics with finite absolute moment of…

Probability · Mathematics 2021-06-16 Nguyen Tien Dung

We study the asymptotic shape of the trajectory of the stochastic gradient descent algorithm applied to a convex objective function. Under mild regularity assumptions, we prove a functional central limit theorem for the properly rescaled…

Machine Learning · Statistics 2026-02-18 Kessang Flamand , Victor-Emmanuel Brunel

We establish central limit theorems for the Sample Average Approximation (SAA) method in discrete-time, finite-horizon stochastic optimal control. Our analysis is based on an abstract limit theorem for stochastic backward recursions, which…

Optimization and Control · Mathematics 2026-04-21 Johannes Milz , Alexander Shapiro

In this paper, we study the spatial averages of the solution to the parabolic Anderson model driven by a space-time Gaussian homogeneous noise that is colored in time and space. We establish quantitative central limit theorems (CLT) of this…

Probability · Mathematics 2022-10-13 David Nualart , Panqiu Xia , Guangqu Zheng

This paper investigates the asymptotic properties of quantile regression estimators in linear models, with a particular focus on polynomial regressors and robustness to heavy-tailed noise. Under independent and identically distributed…

Statistics Theory · Mathematics 2025-06-09 Saïd Maanan , Azzouz Dermoune , Ahmed El Ghini

Dynamical systems with $\epsilon$ small random perturbations appear in both continuous mechanical motions and discrete stochastic chemical kinetics. The present work provides a detailed analysis of the central limit theorem (CLT), with a…

Mathematical Physics · Physics 2021-03-17 Yu-Chen Cheng , Hong Qian

Several issues in machine learning and inverse problems require to generate discrete data, as if sampled from a model probability distribution. A common way to do so relies on the construction of a uniform probability distribution over a…

Optimization and Control · Mathematics 2021-06-16 Quentin Merigot , Filippo Santambrogio , Clément Sarrazin

This paper provides a finite-time analysis of linear stochastic approximation (LSA) algorithms with fixed step size, a core method in statistics and machine learning. LSA is used to compute approximate solutions of a $d$-dimensional linear…

Machine Learning · Statistics 2023-03-30 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov

Cr\'epey, Frikha, and Louzi (2025) introduced a nested stochastic approximation algorithm and its multilevel acceleration to compute the value-at-risk and expected shortfall of a random financial loss. We hereby establish central limit…

Risk Management · Quantitative Finance 2026-04-14 Stéphane Crépey , Noufel Frikha , Azar Louzi , Gilles Pagès

In this paper we propose a new approach to the central limit theorem (CLT), based on functions of bounded F\'echet variation for the continuously differentiable linear statistics of random matrix ensembles which relies on: a weaker form of…

Probability · Mathematics 2022-01-12 Mario Diaz , James A. Mingo

We study stochastic nonconvex optimization under heavy-tailed noise. In this setting, the stochastic gradients only have bounded $p$-th central moment ($p$-BCM) for some $p \in (1,2]$. Building on the foundational work of Arjevani et al.…

Optimization and Control · Mathematics 2026-04-01 Adrien Fradin , Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

We study the convergence rate of randomly truncated stochastic algorithms, which consist in the truncation of the standard Robbins-Monro procedure on an increasing sequence of compact sets. Such a truncation is often required in practice to…

Probability · Mathematics 2010-04-08 Jérôme Lelong

We study the convergence rate of randomly truncated stochastic algorithms, which consist in the truncation of the standard Robbins-Monro procedure on an increasing sequence of compact sets. Such a truncation is often required in practice to…

Probability · Mathematics 2010-03-23 Jérôme Lelong

Stochastic approximation algorithms have been the subject of an enormous body of literature, both theoretical and applied. Recently, Laruelle and Pag\`es (2013) presented a link between the stochastic approximation and response-adaptive…

Probability · Mathematics 2017-03-21 Li-Xin Zhang

We use martingale embeddings to prove a central limit theorem (CLT) for one-dimensional projections of high-dimensional random vectors in $\{-1,1\}^n$ satisfying a Poincar\'e inequality. We obtain a non-asymptotic error bound involving…

Probability · Mathematics 2026-04-29 Xiao Fang , Yang Xie , Yi-Kun Zhao

In this paper, a distributed stochastic approximation algorithm is studied. Applications of such algorithms include decentralized estimation, optimization, control or computing. The algorithm consists in two steps: a local step, where each…

Optimization and Control · Mathematics 2013-12-03 Pascal Bianchi , Gersende Fort , Walid Hachem