English
Related papers

Related papers: Limit theorems for stochastic approximation algori…

200 papers

This paper investigates the problem of distributed stochastic approximation in multi-agent systems. The algorithm under study consists of two steps: a local stochastic approximation step and a diffusion step which drives the network to a…

Multiagent Systems · Computer Science 2014-10-28 Gemma Morral , Pascal Bianchi , Gersende Fort

We establish central limit theorems for a large class of supercritical branching Markov processes in infinite dimension with spatially dependent and non-necessarily local branching mechanisms. This result relies on a fourth moment…

Probability · Mathematics 2025-01-31 Bertrand Cloez , Nicolás Zalduendo

We prove a central limit theorem for a sequence of random variables whose means are ambiguous and vary in an unstructured way. Their joint distribution is described by a set of measures. The limit is (not the normal distribution and is)…

Probability · Mathematics 2020-07-01 Zengjing Chen , Larry G. Epstein

In applied probability, the normal approximation is often used for the distribution of data with assumed additive structure. This tradition is based on the central limit theorem for sums of (independent) random variables. However, it is…

Probability · Mathematics 2020-10-27 Alexandra Dorofeeva , Victor Korolev , Alexander Zeifman

Consider a probability measure supported by a regular geodesic ball in a manifold. For any p larger than or equal to 1 we define a stochastic algorithm which converges almost surely to the p-mean of the measure. Assuming furthermore that…

Probability · Mathematics 2011-06-28 Marc Arnaudon , Clément Dombry , Anthony Phan , Le Yang

We study the convergence rate of randomly truncated stochastic algorithms, which consist in the truncation of the standard Robbins-Monro procedure on an increasing sequence of compact sets. Such a truncation is often required in practice to…

Probability · Mathematics 2010-04-08 Jérôme Lelong

We study the convergence rate of randomly truncated stochastic algorithms, which consist in the truncation of the standard Robbins-Monro procedure on an increasing sequence of compact sets. Such a truncation is often required in practice to…

Probability · Mathematics 2010-03-23 Jérôme Lelong

We study the asymptotic shape of the trajectory of the stochastic gradient descent algorithm applied to a convex objective function. Under mild regularity assumptions, we prove a functional central limit theorem for the properly rescaled…

Machine Learning · Statistics 2026-02-18 Kessang Flamand , Victor-Emmanuel Brunel

An urn scheme is a probabilistic model in which balls are placed into urns sequentially and independently of each other. All balls share the same probability distribution for hitting the urns. In the simplest case, there is a finite number…

Probability · Mathematics 2026-02-17 Berhane Abebe , Mikhail Chebunin , Artyom Kovalevskii

A central limit theorem is established for a sum of random variables belonging to a sequence of random fields. The fields are assumed to have zero mean conditional on the past history and to satisfy certain conditional $\alpha$-mixing…

Probability · Mathematics 2024-09-17 Abdollah Jalilian , Arnaud Poinas , Ganggang Xu , Rasmus Waagepetersen

The asymptotic behaviour of a generalised P\'olya--Eggenberger urn is well--known to depend on the spectrum of its replacement matrix: If its dominant eigenvalue $r$ is simple and no other eigenvalue is `large' in the sense that its real…

Probability · Mathematics 2019-03-13 Noela Müller

This paper considers a two-color, single-draw urn model with two types of balls, denoted type $1$ and type $2$, with initial counts $Y^1_0\in N^+$ and $Y^2_0\in N^+$, respectively. At each discrete time step, a ball is drawn uniformly at…

Probability · Mathematics 2026-05-27 Jianan Shi , Qing Yin , Yu Miao

We prove a limit theorem for quantum stochastic differential equations with unbounded coefficients which extends the Trotter-Kato theorem for contraction semigroups. From this theorem, general results on the convergence of approximations…

Mathematical Physics · Physics 2008-05-08 Luc Bouten , Ramon van Handel , Andrew Silberfarb

We consider stochastic settings for clustering, and develop provably-good approximation algorithms for a number of these notions. These algorithms yield better approximation ratios compared to the usual deterministic clustering setting.…

Data Structures and Algorithms · Computer Science 2023-10-13 David G. Harris , Shi Li , Thomas Pensyl , Aravind Srinivasan , Khoa Trinh

We analyse the asymptotic properties of a continuous-time, two-timescale stochastic approximation algorithm designed for stochastic bilevel optimisation problems in continuous-time models. We obtain the weak convergence rate of this…

Optimization and Control · Mathematics 2022-07-08 Louis Sharrock

A central limit theorem for arrays of symmetric row-wise exchangeable random variables is presented. The result is valid for finite and infinite extendable and non-extendable sequences. Unlike most reported versions of the central limit…

Probability · Mathematics 2020-06-22 Ilya Soloveychik

In this paper, we consider a new type of urn scheme, where the selection probabilities are proportional to a weight function, which is linear but decreasing in the proportion of existing colours. We refer to it as the \emph{negatively…

Probability · Mathematics 2018-01-09 Antar Bandyopadhyay , Gursharn Kaur

One reason why standard formulations of the central limit theorems are not applicable in high-dimensional and non-stationary regimes is the lack of a suitable limit object. Instead, suitable distributional approximations can be used, where…

Statistics Theory · Mathematics 2024-12-20 Fabian Mies

The Central Limit Theorem states that, in the limit of a large number of terms, an appropriately scaled sum of independent random variables yields another random variable whose probability distribution tends to a stable distribution. The…

Data Analysis, Statistics and Probability · Physics 2024-04-08 Damián H. Zanette , Inés Samengo

We study a random partial covering model on the $(d-1)$-dimensional unit sphere, where $N$ spherical caps are placed independently and uniformly at random, each covering a surface fraction of $1/N$. This model provides a continuous…

Probability · Mathematics 2026-04-10 Steven Hoehner , Christoph Thäle