English
Related papers

Related papers: Quantitative contraction rates for Markov chains o…

200 papers

Consider a sequence (indexed by n) of Markov chains Z^n in R^d characterized by transition kernels that approximately (in n) depend only on the rescaled state n^{-1} Z^n. Subject to a smoothness condition, such a family can be closely…

Probability · Mathematics 2009-08-17 Kamil Szczegot

We study convergence to equilibrium for a large class of Markov chains in random environment. The chains are sparse in the sense that in every row of the transition matrix $P$ the mass is essentially concentrated on few entries. Moreover,…

Probability · Mathematics 2018-01-23 Charles Bordenave , Pietro Caputo , Justin Salez

Over the last three decades, there has been a considerable effort within the applied probability community to develop techniques for bounding the convergence rates of general state space Markov chains. Most of these results assume the…

Probability · Mathematics 2020-09-29 Qian Qin , James P. Hobert

Observing that the recent developments of the recursive (product) quantization method induces a family of Markov chains which includes all standard discretization schemes of diffusions processes , we propose to compute a general error bound…

Probability · Mathematics 2018-08-30 Gilles Pagès , Abass Sagna

We present a Markov approximation for jump-diffusions whose jump part consists in a Hawkes process with intensity driven by a general (possibly non-monotone) kernel. Under minimal integrability conditions, the kernel can be approximated by…

Probability · Mathematics 2025-07-16 Mahmoud Khabou , Mehdi Talbi

This paper considers how to obtain MCMC quantitative convergence bounds which can be translated into tight complexity bounds in high-dimensional {settings}. We propose a modified drift-and-minorization approach, which establishes…

Computation · Statistics 2022-05-12 Jun Yang , Jeffrey S. Rosenthal

Mathematically modelling diffusive and advective transport of particles in heterogeneous layered media is important to many applications in computational, biological and medical physics. While deterministic continuum models of such…

Computational Physics · Physics 2024-09-16 Elliot J. Carr

We consider additive functionals of Markov processes in continuous time with general (metric) state spaces. We derive concentration bounds for their exponential moments and moments of finite order. Applications include diffusions,…

Probability · Mathematics 2022-02-18 Frank Redig , Florian Völlering

In this paper we consider the field of local times of a discrete-time Markov chain on a general state space, and obtain uniform (in time) upper bounds on the total variation distance between this field and the one of a sequence of $n$…

Probability · Mathematics 2019-03-25 Diego F. de Bernardini , Christophe Gallesco , Serguei Popov

Let $Q$ be a transition probability on a measurable space $E$, let $(X\_n)\_n$ be a Markov chain associated to $Q$, and let $\xi$ be a real-valued measurable function on $E$, and $S\_n = \sum\_{k=1}^{n} \xi(X\_k)$. Under functional…

Probability · Mathematics 2007-05-23 Loïc Hervé

This paper considers linear functions constructed on two different weighted branching processes and provides explicit bounds for their Kantorovich-Rubinstein distance in terms of couplings of their corresponding generic branching vectors.…

Probability · Mathematics 2015-06-26 Ningyuan Chen , Mariana Olvera-Cravioto

In this paper, we consider a general class of two-time-scale Markov chains whose transition rate matrix depends on a parameter $\lambda>0$. We assume that some transition rates of the Markov chain will tend to infinity as…

Probability · Mathematics 2015-07-10 Chen Jia

In the analysis of Markov chains and processes, it is sometimes convenient to replace an unbounded state space with a "truncated" bounded state space. When such a replacement is made, one often wants to know whether the equilibrium behavior…

Probability · Mathematics 2022-03-30 Alex Infanger , Peter W. Glynn , Yuanyuan Liu

A common tool in the practice of Markov Chain Monte Carlo is to use approximating transition kernels to speed up computation when the desired kernel is slow to evaluate or intractable. A limited set of quantitative tools exist to assess the…

Probability · Mathematics 2026-01-14 Jeffrey Negrea , Jeffrey S. Rosenthal

We investigate the mixing properties of a finite Markov chain in random environment defined as a mixture of a deterministic chain and a chain whose state space has been permuted uniformly at random. This work is the counterpart of a…

Probability · Mathematics 2024-02-07 Bastien Dubail

The convergence rate in Wasserstein distance is estimated for empirical measures of ergodic Markov processes, and the estimate can be sharp in some specific situations. The main result is applied to subordinations of typical models excluded…

Probability · Mathematics 2024-08-14 Feng-Yu Wang

We consider a diffusion given by a small noise perturbation of a dynamical system driven by a potential function with a finite number of local minima. The classical results of Freidlin and Wentzell show that the time this diffusion spends…

Probability · Mathematics 2021-01-20 Thomas G. Kurtz , Jason Swanson

We introduce a novel concept of convergence for Markovian processes within Orlicz spaces, extending beyond the conventional approach associated with $L_p$ spaces. After showing that Markovian operators are contractive in Orlicz spaces, our…

Information Theory · Computer Science 2025-11-24 Amedeo Roberto Esposito , Marco Mondelli

This paper is motivated by the problem of quantitatively bounding the convergence of adaptive control methods for stochastic systems to a stationary distribution. Such bounds are useful for analyzing statistics of trajectories and…

Optimization and Control · Mathematics 2021-10-19 Tyler Lekang , Andrew Lamperski

The goal of this work is to formally abstract a Markov process evolving in discrete time over a general state space as a finite-state Markov chain, with the objective of precisely approximating its state probability distribution in time,…

Logic in Computer Science · Computer Science 2017-01-11 Sadegh Esmaeil Zadeh Soudjani , Alessandro Abate