English
Related papers

Related papers: Central Limit Theorems for Stochastic Approximatio…

200 papers

We prove the central limit theorem (CLT) for a sequence of independent zero-mean random variables $\xi_j$, perturbed by predictable multiplicative factors $\lambda_j$ with values in intervals $[\underline\lambda_j,\overline\lambda_j]$. It…

Probability · Mathematics 2015-08-31 Dmitry B. Rokhlin

Adaptive and interacting Markov Chains Monte Carlo (MCMC) algorithms are a novel class of non-Markovian algorithms aimed at improving the simulation efficiency for complicated target distributions. In this paper, we study a general…

Statistics Theory · Mathematics 2011-07-15 Gersende Fort , Eric Moulines , Pierre Priouret , Pierre Vandekerkhove

In this paper, we establish a spatial central limit theorem for a large class of supercritical branching, not necessarily symmetric, Markov processes with spatially dependent branching mechanisms satisfying a second moment condition. This…

Probability · Mathematics 2014-04-02 Yan-Xia Ren , Renming Song , Rui Zhang

Recent theoretical works have characterized the dynamics of wide shallow neural networks trained via gradient descent in an asymptotic mean-field limit when the width tends towards infinity. At initialization, the random sampling of the…

Probability · Mathematics 2022-03-29 Zhengdao Chen , Grant M. Rotskoff , Joan Bruna , Eric Vanden-Eijnden

We establish central limit theorems (CLTs) for the linear spectral statistics of the adjacency matrix of inhomogeneous random graphs across all sparsity regimes, providing explicit covariance formulas under the assumption that the variance…

Probability · Mathematics 2025-04-09 Xiangyi Zhu , Yizhe Zhu

We give a closer look at the Central Limit Theorem (CLT) behavior in quasi-stationary states of the Hamiltonian Mean Field model, a paradigmatic one for long-range-interacting classical many-body systems. We present new calculations which…

Statistical Mechanics · Physics 2008-03-17 A. Pluchino , A. Rapisarda , C. Tsallis

This paper is devoted to the convergence analysis of stochastic approximation algorithms of the form $\theta\_{n+1} = \theta\_n + \gamma\_{n+1} H\_{\theta\_n}(X\_{n+1})$ where $\{\theta\_nn, n \geq 0\}$ is a $R^d$-valued sequence,…

Statistics Theory · Mathematics 2016-01-27 Gersende Fort , Eric Moulines , Amandine Schreck , Matti Vihola

In this paper, we develop a general law of large numbers and central limit theorem for cumulative reward processes associated with finite state Markov jump processes with non-stationary transition rates. Such models commonly arise in…

Probability · Mathematics 2025-10-15 Monte Fischer , Peter W. Glynn

We study the mixing properties of an important optimization algorithm of machine learning: the stochastic gradient Langevin dynamics (SGLD) with a fixed step size. The data stream is not assumed to be independent hence the SGLD is not a…

Probability · Mathematics 2023-08-01 Attila Lovas , Miklós Rásonyi

Ordinary differential equations obtained as limits of Markov processes appear in many settings. They may arise by scaling large systems, or by averaging rapidly fluctuating systems, or in systems involving multiple time-scales, by a…

Probability · Mathematics 2014-03-24 Hye-Won Kang , Thomas G. Kurtz , Lea Popovic

This paper studies the central limit theorems (CLTs) for linear spectral statistics (LSSs) of general sample covariance matrices, when the test functions belong to $C^3$, the class of functions with continuous third order derivatives. We…

Statistics Theory · Mathematics 2026-03-16 Jian Cui , Zhijun Liu , Jiang Hu , Zhidong Bai

The paper concerns the $d$-dimensional stochastic approximation recursion, $$ \theta_{n+1}= \theta_n + \alpha_{n + 1} f(\theta_n, \Phi_{n+1}) $$ where $ \{ \Phi_n \}$ is a stochastic process on a general state space, satisfying a…

Statistics Theory · Mathematics 2024-11-18 Vivek Borkar , Shuhang Chen , Adithya Devraj , Ioannis Kontoyiannis , Sean Meyn

In this paper, we establish the central limit theorem (CLT) for the linear spectral statistics (LSS) of sample correlation matrix $R$, constructed from a $p\times n$ data matrix $X$ with independent and identically distributed (i.i.d.)…

Probability · Mathematics 2024-09-20 Yanpeng Li , Guangming Pan , Jiahui Xie , Wang Zhou

The question of whether the central limit theorem (CLT) holds for the total number of edges in exponential random graph models (ERGMs) in the subcritical region of parameters has remained an open problem. In this paper, we establish the…

Probability · Mathematics 2025-04-09 Xiao Fang , Song-Hao Liu , Qi-Man Shao , Yi-Kun Zhao

We investigate the probability density of rescaled sums of iterates of deterministic dynamical systems, a problem relevant for many complex physical systems consisting of dependent random variables. A Central Limit Theorem (CLT) is only…

Statistical Mechanics · Physics 2007-05-23 Ugur Tirnakli , Christian Beck , Constantino Tsallis

This paper develops asymptotic theory for quantile estimation via stochastic gradient descent (SGD) with a constant learning rate. The quantile loss function is neither smooth nor strongly convex. Beyond conventional perspectives and…

Machine Learning · Statistics 2026-04-06 Ziyang Wei , Jiaqi Li , Likai Chen , Wei Biao Wu

We prove a central limit theorem for the linear statistics of one-dimensional log-gases, or $\beta$-ensembles. We use a method based on a change of variables which allows to treat fairly general situations, including multi-cut and, for the…

Mathematical Physics · Physics 2018-02-08 Florent Bekerman , Thomas Leblé , Sylvia Serfaty

We prove quenched versions of (i) a large deviations principle (LDP), (ii) a central limit theorem (CLT), and (iii) a local central limit theorem (LCLT) for non-autonomous dynamical systems. A key advance is the extension of the spectral…

Dynamical Systems · Mathematics 2018-02-14 Davor Dragicevic , Gary Froyland , Cecilia Gonzalez-Tokman , Sandro Vaienti

When the underlying random variables are Gaussian, the classical Central Limit Theorem (CLT) is trivial, but the functional CLT is not. The objective of the paper is to investigate the functional CLT for stationary Gaussian processes in the…

Probability · Mathematics 2022-09-20 S. V. Lototsky

The Central Limit Theorem (CLT) for additive functionals of Markov chains is a well known result with a long history. In this paper we present applications to two finite-memory versions of the Elephant Random Walk, solving a problem from…

Probability · Mathematics 2020-05-04 Iddo Ben-Ari , Jonah Green , Taylor Meredith , Hugo Panzo , Xiaoran Tan