English
Related papers

Related papers: The Coupling/Minorization/Drift Approach to Markov…

200 papers

Markov Chain Monte Carlo (MCMC) methods for sampling probability density functions (combined with abundant computational resources) have transformed the sciences, especially in performing probabilistic inferences, or fitting models to data.…

Instrumentation and Methods for Astrophysics · Physics 2018-05-23 David W. Hogg , Daniel Foreman-Mackey

Markov chain Monte Calro methods (MCMC) are commonly used in Bayesian statistics. In the last twenty years, many results have been established for the calculation of the exact convergence rate of MCMC methods. We introduce another rate of…

Statistics Theory · Mathematics 2014-02-17 Kengo Kamatani

This paper considers a new approach to using Markov chain Monte Carlo (MCMC) in contexts where one may adopt multilevel (ML) Monte Carlo. The underlying problem is to approximate expectations w.r.t. an underlying probability measure that is…

Numerical Analysis · Mathematics 2018-06-27 Ajay Jasra , Kody Law , Yaxian Xu

Markov chain Monte Carlo (MCMC) is a powerful methodology for the approximation of posterior distributions. However, the iterative nature of MCMC does not naturally facilitate its use with modern highly parallel computation on HPC and cloud…

Adaptive and interacting Markov chain Monte Carlo algorithms (MCMC) have been recently introduced in the literature. These novel simulation algorithms are designed to increase the simulation efficiency to sample complex distributions.…

Statistics Theory · Mathematics 2012-03-15 G. Fort , E. Moulines , P. Priouret

Markov chain Monte Carlo (MCMC) methods are often used in clustering since they guarantee asymptotically exact expectations in the infinite-time limit. In finite time, though, slow mixing often leads to poor performance. Modern computing…

Methodology · Statistics 2022-02-24 Tin D. Nguyen , Brian L. Trippe , Tamara Broderick

This paper presents how to use common random number (CRN) simulation to evaluate Markov chain Monte Carlo (MCMC) convergence to stationarity. We provide an upper bound on the Wasserstein distance of a Markov chain to its stationary…

Computation · Statistics 2025-11-03 Sabrina Sixta , Jeffrey S. Rosenthal , Austin Brown

The use of MCMC algorithms in high dimensional Bayesian problems has become routine. This has spurred so-called convergence complexity analysis, the goal of which is to ascertain how the convergence rate of a Monte Carlo Markov chain scales…

Statistics Theory · Mathematics 2018-04-24 Qian Qin , James P. Hobert

The aim of this work is to give an introduction to the theoretical background and computational complexity of Markov chain Monte Carlo methods. Most of the mathematical results related to the convergence are not found in most of the…

Computation · Statistics 2020-04-16 Izhar Asael Alonzo Matamoros

Convergence rate analysis for general state-space Markov chains is fundamentally important in areas such as Markov chain Monte Carlo and algorithmic analysis (for computing explicit convergence bounds). This problem, however, is notoriously…

Machine Learning · Computer Science 2025-07-22 Yanlin Qu , Jose Blanchet , Peter Glynn

We show that Markov couplings can be used to improve the accuracy of Markov chain Monte Carlo calculations in some situations where the steady-state probability distribution is not explicitly known. The technique generalizes the notion of…

Numerical Analysis · Mathematics 2015-05-13 Jonathan B. Goodman , Kevin K. Lin

We consider adaptive increasingly rare Markov chain Monte Carlo (MCMC) algorithms, which are adaptive MCMC methods, where the adaptation concerning the "past'' happens less and less frequently over time. Under a contraction assumption with…

Numerical Analysis · Mathematics 2026-02-24 Julian Hofstadler , Krzysztof Latuszynski , Gareth O. Roberts , Daniel Rudolf

A long-standing gap exists between the theoretical analysis of Markov chain Monte Carlo convergence, which is often based on statistical divergences, and the diagnostics used in practice. We introduce the first general convergence…

Computation · Statistics 2025-10-16 Adrien Corenflos , Hai-Dang Dau

Markov Chain Monte Carlo (MCMC) is a popular class of statistical methods for simulating autocorrelated draws from target distributions, including posterior distributions in Bayesian analysis. An important consideration in using simulated…

Methodology · Statistics 2017-06-16 Benjamin E. Deonovic , Brian J. Smith

In this paper we investigate the continuum limits of a class of Markov chains. The investigation of such limits is motivated by the desire to model very large networks. We show that under some conditions, a sequence of Markov chains…

Networking and Internet Architecture · Computer Science 2011-06-22 Yang Zhang , Edwin K. P. Chong , Jan Hannig , Donald Estep

The paper presents efficient approaches for evaluating convergence rate in total variation for finite and general linear Markov chains. The motivation for studying convergence rate in this metric is its usefulness in various limit theorems.…

Probability · Mathematics 2026-01-21 Alexander Veretennikov

We investigate the problem of quantifying contraction coefficients of Markov transition kernels in Kantorovich ($L^1$ Wasserstein) distances. For diffusion processes, relatively precise quantitative bounds on contraction rates have recently…

Probability · Mathematics 2018-08-22 Andreas Eberle , Mateusz B. Majka

We present a novel approach to quantizing Markov chains. The approach is based on the Markov chain coupling method, which is frequently used to prove fast mixing. Given a particular coupling, e.g., a grand coupling, we construct a…

Quantum Physics · Physics 2025-12-24 Kristan Temme , Pawel Wocjan

We provide explicit expressions for the constants involved in the characterisation of ergodicity of sub-geometric Markov chains. The constants are determined in terms of those appearing in the assumed drift and one-step minorisation…

Probability · Mathematics 2014-03-18 Christophe Andrieu , Gersende Fort , Matti Vihola

We consider Markov chains on general state spaces in stationary random environment which are defined by a random mapping that is contractive up to a bounded perturbation. We prove their convergence to a limiting law, providing convergence…

Probability · Mathematics 2025-12-18 Attila Lovas , Miklós Rásonyi , Lionel Truquet