English
Related papers

Related papers: A Local Limit Theorem for Robbins-Monro Procedure

200 papers

This study introduces an iterative Bayesian Robbins--Monro (IBRM) sequence, which unites the classical Robbins--Monro sequence with statistical estimation for faster root-finding under noisy observations. Although the standard…

Optimization and Control · Mathematics 2025-08-19 Siwei Liu , Ke Ma , Stephan M. Goetz

We consider nonparametric estimation for functional autoregressive processes with Markov switching. First, we study the case where complete data is available; i.e. when we observe the Markov switching regime. Then we estimate the regression…

Statistics Theory · Mathematics 2017-04-25 Lisandro Fermín , Ricardo Ríos , Luis-Angel Rodríguez

In this work, we examine sampling problems with non-smooth potentials. We propose a novel Markov chain Monte Carlo algorithm for sampling from non-smooth potentials. We provide a non-asymptotical analysis of our algorithm and establish a…

Machine Learning · Computer Science 2022-02-11 Jiaming Liang , Yongxin Chen

Ordinary differential equations obtained as limits of Markov processes appear in many settings. They may arise by scaling large systems, or by averaging rapidly fluctuating systems, or in systems involving multiple time-scales, by a…

Probability · Mathematics 2014-03-24 Hye-Won Kang , Thomas G. Kurtz , Lea Popovic

The paper establishes a functional version of the Hoeffding combinatorial central limit theorem. First, a pre-limiting Gaussian process approximation is defined, and is shown to be at a distance of the order of the Lyapounov ratio from the…

Probability · Mathematics 2009-07-03 A. D. Barbour , Svante Janson

An extension of the Gauss-Newton algorithm is proposed to find local minimizers of penalized nonlinear least squares problems, under generalized Lipschitz assumptions. Convergence results of local type are obtained, as well as an estimate…

Optimization and Control · Mathematics 2011-03-03 Saverio Salzo , Silvia Villa

In the regression framework, the empirical measure based on the responses resulting from the nearest neighbors, among the covariates, to a given point $x$ is introduced and studied as a central statistical quantity. First, the associated…

Statistics Theory · Mathematics 2024-04-11 François Portier

We consider triangular arrays of Markov chains that converge weakly to a diffusion process. Local limit theorems for transition densities are proved. The observation time [0,T] may be fixed or lim n T = 0, where nh = T and h is a mesh…

Probability · Mathematics 2007-06-13 Valentin Konakov

We study the asymptotic shape of the trajectory of the stochastic gradient descent algorithm applied to a convex objective function. Under mild regularity assumptions, we prove a functional central limit theorem for the properly rescaled…

Machine Learning · Statistics 2026-02-18 Kessang Flamand , Victor-Emmanuel Brunel

We consider a finite sequence of random points in a finite domain of a finite-dimensional Euclidean space. The points are sequentially allocated in the domain according to a model of cooperative sequential adsorption. The main peculiarity…

Probability · Mathematics 2009-11-11 V. Shcherbakov

We present a rather general method for proving local limit theorems, with a good rate of convergence, for sums of dependent random variables. The method is applicable when a Stein coupling can be exhibited. Our approach involves both…

Probability · Mathematics 2020-07-07 A. D. Barbour , Peter Braunsteins , Nathan Ross

We have random number of independent diffusion processes with absorption on boundaries in some region at initial time $t=0$. The initial numbers and positions of processes in region is defined by Poisson random measure. It is required to…

Probability · Mathematics 2016-09-07 Aniello Fedullo , Vitalii A. Gasanenko

We define the local empirical process, based on $n$ i.i.d. random vectors in dimension $d$, in the neighborhood of the boundary of a fixed set. Under natural conditions on the shrinking neighborhood, we show that, for these local empirical…

Statistics Theory · Mathematics 2011-04-22 John H. J. Einmahl , Estáte V. Khmaladze

We prove a functional limit theorem for Markov chains that, in each step, move up or down by a possibly state dependent constant with probability $1/2$, respectively. The theorem entails that the law of every one-dimensional regular…

Probability · Mathematics 2020-05-13 Stefan Ankirchner , Thomas Kruse , Mikhail Urusov

We propose a new method called the Metropolis-adjusted Mirror Langevin algorithm for approximate sampling from distributions whose support is a compact and convex set. This algorithm adds an accept-reject filter to the Markov chain induced…

Computation · Statistics 2024-06-24 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson

We consider on-line density estimation with a parameterized density from the exponential family. The on-line algorithm receives one example at a time and maintains a parameter that is essentially an average of the past examples. After…

Machine Learning · Computer Science 2013-01-30 Katy S. Azoury , Manfred K. Warmuth

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main result is a…

Statistics Theory · Mathematics 2024-03-01 Shogo Nakakita

In this paper we survey the almost sure central limit theorem and its functional form (quenched) for stationary and ergodic processes. For additive functionals of a stationary and ergodic Markov chain these theorems are known under the…

Probability · Mathematics 2013-04-17 Magda Peligrad

The local (central) limit theorem precisely describes the behavior of iterated convolution powers of a probability distribution on the $d$-dimensional integer lattice, $\mathbb{Z}^d$. Under certain mild assumptions on the distribution, the…

Classical Analysis and ODEs · Mathematics 2022-11-17 Evan Randles

Donsker Theorem is perhaps the most famous invariance principle result for Markov processes. It states that when properly normalized, a random walk behaves asymptotically like a Brownian motion. This approach can be extended to general…

Probability · Mathematics 2020-05-29 Eustache Besançon , E Besanç On , Laurent Decreusefond , Pascal Moyal