English
Related papers

Related papers: Curvature, concentration and error estimates for M…

200 papers

Strong invariance principles in Markov chain Monte Carlo are crucial to theoretically grounded output analysis. Using the wide-sense regenerative nature of the process, we obtain explicit bounds in the strong invariance converging rates for…

Computation · Statistics 2025-04-11 Arka Banerjee , Dootika Vats

The convergence rate of a Markov chain to its stationary distribution is typically assessed using the concept of total variation mixing time. However, this worst-case measure often yields pessimistic estimates and is challenging to infer…

Statistics Theory · Mathematics 2026-02-06 Geoffrey Wolfer , Pierre Alquier

We prove the convergence at an exponential rate towards the invariant probability measure for a class of solutions of stochastic differential equations with finite delay. This is done, in this non-Markovian setting, using the cluster…

Probability · Mathematics 2016-07-11 Laure Pédèches

We consider Markovian models on graphs with local dynamics. We show that, under suitable conditions, such Markov chains exhibit both rapid convergence to equilibrium and strong concentration of measure in the stationary distribution. We…

Probability · Mathematics 2008-09-30 Malwina J. Luczak

We show that Markov couplings can be used to improve the accuracy of Markov chain Monte Carlo calculations in some situations where the steady-state probability distribution is not explicitly known. The technique generalizes the notion of…

Numerical Analysis · Mathematics 2015-05-13 Jonathan B. Goodman , Kevin K. Lin

When implementing Markov Chain Monte Carlo (MCMC) algorithms, perturbation caused by numerical errors is sometimes inevitable. This paper studies how perturbation of MCMC affects the convergence speed and Monte Carlo estimation accuracy.…

Computation · Statistics 2026-01-14 Tiangang Cui , Jing Dong , Ajay Jasra , Xin T. Tong

Markov chain Monte Carlo (MCMC) is a sampling-based method for estimating features of probability distributions. MCMC methods produce a serially correlated, yet representative, sample from the desired distribution. As such it can be…

Computation · Statistics 2019-12-10 Dootika Vats , Nathan Robertson , James M Flegal , Galin L Jones

Improved rates of convergence for ergodic homogeneous Markov chains are studied. In comparison to the earlier papers the setting is also generalised to the case without a unique dominated measure. Examples are provided where the new bound…

Probability · Mathematics 2021-11-02 Alexander Veretennikov , Maria Veretennikova

The paper is devoted to the estimation of the rate of of exponential convergence of nonhomogeneous queues exhibiting different types of ergodicity. The main tool of our study is the method, which was proposed by the second author in the…

Probability · Mathematics 2007-06-13 Boris L. Granovsky , Aleksandr I. Zeifman

To sample from a given target distribution, Markov chain Monte Carlo (MCMC) sampling relies on constructing an ergodic Markov chain with the target distribution as its invariant measure. For any MCMC method, an important question is how to…

Probability · Mathematics 2023-08-15 Federica Milinanni , Pierre Nyquist

In this paper, we propose a variance reduction approach for Markov chains based on additive control variates and the minimization of an appropriate estimate for the asymptotic variance. We focus on the particular case when control variates…

Statistics Theory · Mathematics 2024-10-29 Denis Belomestny , Artur Goldman , Alexey Naumov , Sergey Samsonov

We prove explicit, i.e. non-asymptotic, error bounds for Markov chain Monte Carlo methods. The problem is to compute the expectation of a function f with respect to a measure {\pi}. Different convergence properties of Markov chains imply…

Probability · Mathematics 2020-04-07 Daniel Rudolf

In order to sample from a given target distribution (often of Gibbs type), the Monte Carlo Markov chain method consists in constructing an ergodic Markov process whose invariant measure is the target distribution. By sampling the Markov…

Probability · Mathematics 2015-06-11 Luc Rey-Bellet , Kostantinos Spiliopoulos

Markov Chain Monte Carlo (MCMC) methods are employed to sample from a given distribution of interest, whenever either the distribution does not exist in closed form, or, if it does, no efficient method to simulate an independent sample from…

Computation · Statistics 2008-07-22 Ioana A. Cosma , Masoud Asgharian

We consider the efficient use of an approximation within Markov chain Monte Carlo (MCMC), with subsequent importance sampling (IS) correction of the Markov chain inexact output, leading to asymptotically exact inference. We detail…

Computation · Statistics 2019-04-15 Jordan Franks

We establish non-asymptotic error bounds for the classical Maximal Likelihood Estimation of the transition matrix of a given Markov chain. Meanwhile, in the reversible case, we propose a new reversibility-preserving online Symmetric…

Statistics Theory · Mathematics 2025-11-07 De Huang , Xiangyuan Li

Convergence diagnosis for Markov chain Monte Carlo is a matter of fundamental importance in computational statistics: it determines the resources allocated to a particular sampling problem and influences the practitioner's view of the…

Computation · Statistics 2026-05-14 Buu Phan , Gergely Flamich , Ashish Khisti , Shahab Asoodeh

In this article, we propose a least squares method for the estimation of the transition density in bifurcating Markov models. Unlike the kernel estimation, this method do not use the quotient which can be a source of errors. In order to…

Methodology · Statistics 2025-09-17 S. Valère Bitseki Penda

We study convergence properties of pseudo-marginal Markov chain Monte Carlo algorithms (Andrieu and Roberts [Ann. Statist. 37 (2009) 697-725]). We find that the asymptotic variance of the pseudo-marginal algorithm is always at least as…

Probability · Mathematics 2015-03-31 Christophe Andrieu , Matti Vihola

In any Markov chain Monte Carlo analysis, rapid convergence of the chain to its target probability distribution is of practical and theoretical importance. A chain that converges at a geometric rate is geometrically ergodic. In this paper,…

Computation · Statistics 2012-10-05 Alicia A. Johnson , Owen Burbank