English
Related papers

Related papers: Convergence rate bounds for iterative random funct…

200 papers

We study the rate of weak convergence of Markov chains to diffusion processes under suitable but quite general assumptions. We give an example in the financial framework, applying the convergence analysis to a multiple jumps tree…

Probability · Mathematics 2020-05-06 Maya Briani , Lucia Caramellino , Giulia Terenzi

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

Convergence rates of Markov chains have been widely studied in recent years. In particular, quantitative bounds on convergence rates have been studied in various forms by Meyn and Tweedie [Ann. Appl. Probab. 4 (1994) 981-1101], Rosenthal…

Probability · Mathematics 2007-05-23 R. Douc , E. Moulines , Jeffrey S. Rosenthal

Convergence diagnosis for Markov chain Monte Carlo is a matter of fundamental importance in computational statistics: it determines the resources allocated to a particular sampling problem and influences the practitioner's view of the…

Computation · Statistics 2026-05-14 Buu Phan , Gergely Flamich , Ashish Khisti , Shahab Asoodeh

What can one say on convergence to stationarity of a finite state Markov chain that behaves "locally" like a nearest neighbor random walk on ${\mathbb Z}$ ? The model we consider is a version of nearest neighbor lazy random walk on the…

Probability · Mathematics 2014-10-31 Iddo Ben-Ari , Hugo Panzo , Elizabeth Tripp

I show how to run an N-time-step Markov chain simulation in a circular fashion, so that the state at time 0 follows the state at time N-1 in the same way as states at times t follow those at times t-1 for 0<t<N. This wrap-around of the…

Computation · Statistics 2017-11-15 Radford M. Neal

Multistage sampling is commonly used for household surveys when there exists no sampling frame, or when the population is scattered over a wide area. Multistage sampling usually introduces a complex dependence in the selection of the final…

Statistics Theory · Mathematics 2015-11-18 Guillaume Chauvet

We present new results concerning threshold functions for a wide family of random intersection graphs. To this end we apply the coupling method used for establishing threshold functions for homogeneous random intersection graphs introduced…

Combinatorics · Mathematics 2017-10-05 K. Rybarczyk

There are many Markov chains on infinite dimensional spaces whose one-step transition kernels are mutually singular when starting from different initial conditions. We give results which prove unique ergodicity under minimal assumptions on…

Probability · Mathematics 2009-08-20 Martin Hairer , Jonathan C. Mattingly , Michael Scheutzow

A new approach is developed for evaluating the convergence rate for nonlinear Markov chains (MC) based on the recently developed spectral radius technique of markovian coupling for linear MC and the idea of small nonlinear perturbations of…

Probability · Mathematics 2025-03-27 Alexander Shchegolev , Alexander Veretennikov

We determine the convergence speed of a numerical scheme for approximating one-dimensional continuous strong Markov processes. The scheme is based on the construction of coin tossing Markov chains whose laws can be embedded into the process…

Probability · Mathematics 2020-08-26 Stefan Ankirchner , Thomas Kruse , Mikhail Urusov

We obtain moment and Gaussian bounds for general Lipschitz functions evaluated along the sample path of a Markov chain. We treat Markov chains on general (possibly unbounded) state spaces via a coupling method. If the first moment of the…

Probability · Mathematics 2010-12-08 J. -R. Chazottes , F. Redig

The ability to estimate the rate of convergence for the distributions of regenerative processes is in great demand. These processes are often encountered in queuing theory and in related problems. In some papers on regenerative processes,…

Probability · Mathematics 2021-10-19 Galina A. Zverkina

Over the last three decades, there has been a considerable effort within the applied probability community to develop techniques for bounding the convergence rates of general state space Markov chains. Most of these results assume the…

Probability · Mathematics 2020-09-29 Qian Qin , James P. Hobert

This review paper, written for the second edition of the Handbook of Markov Chain Monte Carlo, provides an introduction to the study of convergence analysis for Markov chain Monte Carlo (MCMC), aimed at researchers new to the field. We…

Statistics Theory · Mathematics 2024-09-24 Qian Qin

For $N\in\mathbb{N}$, let $\pi_N$ be the law of the number of fixed points of a random permutation of $\{1, 2, ..., N\}$. Let $\mathcal{P}$ be a Poisson law of parameter 1.A classical result shows that $\pi_N$ converges to $\mathcal{P}$ for…

Probability · Mathematics 2023-05-05 Persi Diaconis , Laurent Miclo

We study the so-called two-time-scale stochastic approximation, a simulation-based approach for finding the roots of two coupled nonlinear operators. Our focus is to characterize its finite-time performance in a Markov setting, which often…

Optimization and Control · Mathematics 2021-04-06 Thinh T. Doan

We prove exponential decay of pair correlations for 1D stationary point processes when spacings satisfy a Markov condition, geometric ergodicity, and a condition on exponential moments. The conditions are phrased for stationary sequences of…

Probability · Mathematics 2026-05-22 Yoon Jun Chan , Markus Heydenreich , Sabine Jansen

In this review paper, we describe the use of couplings in several different mathematical problems. We consider the total variation norm, maximal coupling, and the $\bar{d}$-distance. We present a detailed proof of a result recently proved:…

Probability · Mathematics 2025-11-19 Artur O. Lopes

In this paper we consider large state space continuous time Markov chains (MCs) arising in the field of systems biology. For density dependent families of MCs that represent the interaction of large groups of identical objects, Kurtz has…

Performance · Computer Science 2015-03-04 Alessio Angius , Gianfranco Balbo , Marco Beccuti , Enrico Bibbona , Andras Horvath , Roberta Sirovich