English
Related papers

Related papers: Limit theorems for stochastic approximation algori…

200 papers

We consider stochastic optimization problems with the dual tasks of (i) effectively finding the optimizer and (ii) reliably conducting statistical inference for the optimal objective function value. We find that classical simulation…

Methodology · Statistics 2025-09-15 Yuhang Wu , Zeyu Zheng , Yingfei Wang , Guangyu Zhang , Zuohua Zhang , Chu Wang

Central limit theorems play an important role in the study of statistical inference for stochastic processes. However, when the nonparametric local polynomial threshold estimator, especially local linear case, is employed to estimate the…

Probability · Mathematics 2017-02-06 Yuping Song , Hanchao Wang

We prove an almost sure central limit theorem on the Poisson space, which is perfectly tailored for stabilizing functionals emerging in stochastic geometry. As a consequence, we provide almost sure central limit theorems for $(i)$ the total…

Probability · Mathematics 2019-12-16 Giovanni-Luca Torrisi , Emilio Leonardi

A Central Limit Theorem is proved for linear random fields when sums are taken over finite disjoint union of rectangles. The approach does not rely upon the use of Beveridge Nelson decomposition and the conditions needed are similar to…

Probability · Mathematics 2010-07-14 Atul Mallik , Michael Woodroofe

We establish some limit theorems for quasi-arithmetic means of random variables. This class of means contains the arithmetic, geometric and harmonic means. Our feature is that the generators of quasi-arithmetic means are allowed to be…

Statistics Theory · Mathematics 2022-05-09 Yuichi Akaoka , Kazuki Okamura , Yoshiki Otobe

Ordinary differential equations obtained as limits of Markov processes appear in many settings. They may arise by scaling large systems, or by averaging rapidly fluctuating systems, or in systems involving multiple time-scales, by a…

Probability · Mathematics 2014-03-24 Hye-Won Kang , Thomas G. Kurtz , Lea Popovic

We prove a central limit theorem for a general class of adaptive Markov Chain Monte Carlo algorithms driven by sub-geometrically ergodic Markov kernels. We discuss in detail the special case of stochastic approximation. We use the result to…

Probability · Mathematics 2009-11-03 Yves F. Atchade , Gersende Fort

For normalized sums $Z_n$ of i.i.d. random variables, we explore necessary and sufficient conditions which guarantee the normal approximation with respect to the R\'enyi divergence of infinite order. In terms of densities $p_n$ of $Z_n$,…

Probability · Mathematics 2024-06-21 Sergey G. Bobkov , Friedrich Götze

A non-classical formulation of the central limit theorem is given for sequences of independent random variables with finite second moments. Singular sequences whose members all have a degenerate or normal distribution are excluded from…

Probability · Mathematics 2025-01-29 Alexander Shmyrov , Vasily Shmyrov

We consider linear two-time-scale stochastic approximation algorithms driven by martingale noise. Recent applications in machine learning motivate the need to understand finite-time error rates, but conventional stochastic approximation…

Machine Learning · Computer Science 2025-12-12 Seo Taek Kong , Sihan Zeng , Thinh T. Doan , R. Srikant

We prove a local limit theorem for the Euclidian algorithms ; standard, centred and odd, with any cost function of moderate growth.

Dynamical Systems · Mathematics 2015-06-26 Aicha Hachemi

Classical probabilistic rounding error analysis is particularly well suited to stochastic rounding (SR), and it yields strong results when dealing with floating-point algorithms that rely heavily on summation. For many numerical linear…

Numerical Analysis · Mathematics 2025-02-26 El-Mehdi El Arar , Massimiliano Fasi , Silviu-Ioan Filip , Mantas Mikaitis

We rigorously prove a central limit theorem for neural network models with a single hidden layer. The central limit theorem is proven in the asymptotic regime of simultaneously (A) large numbers of hidden units and (B) large numbers of…

Probability · Mathematics 2019-06-04 Justin Sirignano , Konstantinos Spiliopoulos

The Adaptive Multilevel Splitting algorithm is a very powerful and versatile iterative method to estimate the probability of rare events, based on an interacting particle systems. In an other article, in a so-called idealized setting, the…

Probability · Mathematics 2019-10-21 Charles-Edouard Bréhier , Ludovic Goudenège , Loic Tudela

In this paper we address the convergence of stochastic approximation when the functions to be minimized are not convex and nonsmooth. We show that the "mean-limit" approach to the convergence which leads, for smooth problems, to the ODE…

Optimization and Control · Mathematics 2018-05-08 Szymon Majewski , Błażej Miasojedow , Eric Moulines

We study the infinite urn scheme when the balls are sequentially distributed over an infinite number of urns labelled 1,2,... so that the urn $j$ at every draw gets a ball with probability $p_j$, $\sum_j p_j=1$. We prove functional central…

Probability · Mathematics 2020-10-28 Mikhail Chebunin , Sergei Zuyev

The Robbins-Monro algorithm is a recursive, simulation-based stochastic procedure to approximate the zeros of a function that can be written as an expectation. It is known that under some technical assumptions, Gaussian limit distributions…

Probability · Mathematics 2025-10-22 Valentin Konakov , Enno Mammen , Lorick Huang

We prove a central limit theorem for a certain class of functions on sparse rank-one inhomogeneous random graphs endowed with additional i.i.d. edge and vertex weights. Our proof of the central limit theorem uses a perturbative form of…

Probability · Mathematics 2024-04-22 Anja Sturm , Moritz Wemheuer

Define the non-overlapping return time of a random process to be the number of blocks that we wait before a particular block reappears. We prove a Central Limit Theorem based on these return times. This result has applications to entropy…

Probability · Mathematics 2007-05-23 Oliver Johnson

We prove central limit theorem for linear eigenvalue statistics of orthogonally invariant ensembles of random matrices with one interval limiting spectrum. We consider ensembles with real analytic potentials and test functions with two…

Mathematical Physics · Physics 2007-11-13 M. Shcherbina