English
Related papers

Related papers: Comparison inequalities and fastest-mixing Markov …

200 papers

The past few decades have seen robust research on questions regarding the existence, form, and properties of stationary distributions of stochastically modeled reaction networks. When a stochastic model admits a stationary distribution an…

Probability · Mathematics 2022-12-14 David F. Anderson , Jinsu Kim

Despite the ubiquity of U-statistics in modern Probability and Statistics, their non-asymptotic analysis in a dependent framework may have been overlooked. In a recent work, a new concentration inequality for U-statistics of order two for…

Statistics Theory · Mathematics 2023-01-25 Quentin Duchemin , Yohann De Castro , Claire Lacour

We introduce a framework for obtaining tight mixing times for Markov chains based on what we call restricted modified log-Sobolev inequalities. Modified log-Sobolev inequalities (MLSI) quantify the rate of relative entropy contraction for…

Data Structures and Algorithms · Computer Science 2021-11-08 Nima Anari , Vishesh Jain , Frederic Koehler , Huy Tuan Pham , Thuy-Duong Vuong

Many classical randomized algorithms (e.g., approximation algorithms for #P-complete problems) utilize the following random walk algorithm for {\em almost uniform sampling} from a state space $S$ of cardinality $N$: run a symmetric ergodic…

Quantum Physics · Physics 2007-05-23 Peter C. Richter

Markov chains are fundamental models for stochastic dynamics, with applications in a wide range of areas such as population dynamics, queueing systems, reinforcement learning, and Monte Carlo methods. Estimating the transition matrix and…

Statistics Theory · Mathematics 2026-01-26 Lasse Leskelä , Maximilien Dreveton

For a Markov semigroup $P_t$ with invariant probability measure $\mu$, a constant $\ll>0$ is called a lower bound of the ultra-exponential convergence rate of $P_t$ to $\mu$, if there exists a constant $C\in (0,\infty)$ such that $$…

Probability · Mathematics 2014-10-14 Feng-Yu Wang

We formulate a new information-theoretic principle--the shifted composition rule--which bounds the divergence (e.g., Kullback-Leibler or R\'enyi) between the laws of two stochastic processes via the introduction of auxiliary shifts. In this…

Probability · Mathematics 2023-11-27 Jason M. Altschuler , Sinho Chewi

We show how to combine Fourier analysis with coupling arguments to bound the mixing times of a variety of Markov chains. The mixing time is the number of steps a Markov chain takes to approach its equilibrium distribution. One application…

Probability · Mathematics 2012-06-19 David Bruce Wilson

We study the rate of convergence of the Markov chain on $S_n$ which starts with a random $(n-k)$-cycle for a fixed $k \geq 1$, followed by random transpositions. The convergence to the stationary distribution turns out to be of order $n$.…

Probability · Mathematics 2018-03-26 Alperen Y. Özdemir

We prove existence of boundary limits of ratios of positive harmonic functions for a wide class of Markov processes with jumps and irregular domains, in the context of general metric measure spaces. As a corollary, we prove uniqueness of…

Probability · Mathematics 2015-09-21 Tomasz Juszczyszyn , Mateusz Kwaśnicki

For a Markov transition kernel $P$ and a probability distribution $ \mu$ on nonnegative integers, a time-sampled Markov chain evolves according to the transition kernel $P_{\mu} = \sum_k \mu(k)P^k.$ In this note we obtain CLT conditions for…

Probability · Mathematics 2011-06-07 Krzysztof Latuszynski , Gareth O. Roberts

The $L^p$ maximal inequalities for martingales are one of the classical results in probability theory. Here we establish the sharp moderate maximal inequalities for upward skip-free Markov chains, which include the $L^p$ maximal…

Probability · Mathematics 2018-03-06 Chen Jia

We study the mixing time of two popular discrete-time Markov chains in continuous space, the Unadjusted Langevin Algorithm and the Proximal Sampler, which are discretizations of the Langevin dynamics. We extend mixing time analyses for…

Statistics Theory · Mathematics 2025-02-13 Siddharth Mitra , Andre Wibisono

The aim of this paper is to present some results relating the properties of stability, concentration and approximation to the identity of convolution through not necessarily mollification type families of heavy tailed Markov kernels. A…

Analysis of PDEs · Mathematics 2017-07-14 Hugo Aimar , Ivana Gómez , Federico Morana

What can one say on convergence to stationarity of a finite state Markov chain that behaves "locally" like a nearest neighbor random walk on ${\mathbb Z}$ ? The model we consider is a version of nearest neighbor lazy random walk on the…

Probability · Mathematics 2014-10-31 Iddo Ben-Ari , Hugo Panzo , Elizabeth Tripp

In this paper we prove a sharp quantitative version of the Kendall's Theorem. The Kendal Theorem states that under some mild conditions imposed on a probability distribution on positive integers (i.e. probabilistic sequence) one can prove…

Probability · Mathematics 2013-01-09 Witold Bednorz

We investigate the convergence to (quasi--)equilibrium of a density dependent Markov chain in~${\mathbb Z}^d$, whose drift satisfies a system of ordinary differential equations having an attractive fixed point. For a sequence of such…

Probability · Mathematics 2025-08-21 Andrew Barbour , Graham Brightwell , Malwina Luczak

A Kernel Adaptive Metropolis-Hastings algorithm is introduced, for the purpose of sampling from a target distribution with strongly nonlinear support. The algorithm embeds the trajectory of the Markov chain into a reproducing kernel Hilbert…

Machine Learning · Statistics 2014-06-16 Dino Sejdinovic , Heiko Strathmann , Maria Lomeli Garcia , Christophe Andrieu , Arthur Gretton

Improved rates of convergence for ergodic homogeneous Markov chains are studied. In comparison to the earlier papers the setting is also generalised to the case without a unique dominated measure. Examples are provided where the new bound…

Probability · Mathematics 2021-11-02 Alexander Veretennikov , Maria Veretennikova

We consider a class of discrete time Markov chains with state space [0,1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then…

Probability · Mathematics 2014-12-04 Shaun McKinlay , Konstantin Borovkov