English
Related papers

Related papers: Quantitative convergence rates for reversible Mark…

200 papers

Continuous time financial market models are often motivated as scaling limits of discrete time models. The objective of this paper is to establish such a connection for a robust framework. More specifically, we consider discrete time models…

Probability · Mathematics 2024-10-17 David Criens

We investigate the mixing properties of a finite Markov chain in random environment defined as a mixture of a deterministic chain and a chain whose state space has been permuted uniformly at random. This work is the counterpart of a…

Probability · Mathematics 2024-02-07 Bastien Dubail

Consider longitudinal networks whose edges turn on and off according to a discrete-time Markov chain with exponential-family transition probabilities. We characterize when their joint distributions are also exponential families with the…

Methodology · Statistics 2024-03-12 William K. Schwartz , Sonja Petrović , Hemanshu Kaul

We demonstrate the existence of an open set of data which exhibits \textit{reversal} and \textit{recirculation} for the stationary Prandtl equations (data is taken in an appropriately defined product space due to the simultaneous forward…

Analysis of PDEs · Mathematics 2024-10-16 Sameer Iyer , Nader Masmoudi

Markov chain Monte Carlo algorithms are invaluable tools for exploring stationary properties of physical systems, especially in situations where direct sampling is unfeasible. Common implementations of Monte Carlo algorithms employ…

Statistical Mechanics · Physics 2016-04-27 Marija Vucelja

The basic question in perturbation analysis of Markov chains is: how do small changes in the transition kernels of Markov chains translate to chains in their stationary distributions? Many papers on the subject have shown, roughly, that the…

Probability · Mathematics 2025-08-13 Na Lin , Yuanyuan Liu , Aaron Smith

We generalise the coarse Ricci curvature method of Ollivier by considering the coarse Ricci curvature of multiple steps in the Markov chain. This implies new spectral bounds and concentration inequalities. We also extend this approach to…

Probability · Mathematics 2015-10-09 Daniel Paulin

We consider the computational task of sampling a bit string $x$ from a distribution $\pi(x)=|\langle x|\psi\rangle|^2$, where $\psi$ is the unique ground state of a local Hamiltonian $H$. Our main result describes a direct link between the…

Quantum Physics · Physics 2023-11-09 Sergey Bravyi , Giuseppe Carleo , David Gosset , Yinchen Liu

We provide a general framework for computing upper bounds on mixing times of finite Markov chains when its minimal ideal is left zero. Our analysis is based on combining results by Brown and Diaconis with our previous work on stationary…

Probability · Mathematics 2023-01-04 John Rhodes , Anne Schilling

Given an irreducible discrete-time Markov chain on a finite state space, we consider the largest expected hitting time $T(\alpha)$ of a set of stationary measure at least $\alpha$ for $\alpha\in(0,1)$. We obtain tight inequalities among the…

Probability · Mathematics 2015-10-29 Simon Griffiths , Ross J. Kang , Roberto Imbuzeiro Oliveira , Viresh Patel

Let $Q$ be a transition probability on a measurable space $E$, let $(X\_n)\_n$ be a Markov chain associated to $Q$, and let $\xi$ be a real-valued measurable function on $E$, and $S\_n = \sum\_{k=1}^{n} \xi(X\_k)$. Under functional…

Probability · Mathematics 2007-05-23 Loïc Hervé

An important problem in the implementation of Markov Chain Monte Carlo algorithms is to determine the convergence time, or the number of iterations before the chain is close to stationarity. For many Markov chains used in practice this time…

Data Structures and Algorithms · Computer Science 2010-07-02 Nayantara Bhatnagar , Andrej Bogdanov , Elchanan Mossel

The rate of strong convergence is investigated for an approximation scheme for a class of stochastic differential equations driven by a time-changed Brownian motion, where the random time changes $(E_t)_{t\ge 0}$ considered include the…

Probability · Mathematics 2020-03-02 Sixian Jin , Kei Kobayashi

What can one say on convergence to stationarity of a finite state Markov chain that behaves "locally" like a nearest neighbor random walk on ${\mathbb Z}$ ? The model we consider is a version of nearest neighbor lazy random walk on the…

Probability · Mathematics 2014-10-31 Iddo Ben-Ari , Hugo Panzo , Elizabeth Tripp

The paper is devoted to studies of perturbed Markov chains commonly used for description of information networks. In such models, the matrix of transition probabilities for the corresponding Markov chain is usually regularised by adding a…

Consider a continuous time Markov chain with rates Q in the state space \Lambda\cup\{0\} with 0 as an absorbing state. In the associated Fleming-Viot process N particles evolve independently in \Lambda with rates Q until one of them…

Probability · Mathematics 2009-05-12 Amine Asselah , Pablo A. Ferrari , Pablo Groisman

In this work, we characterise the statistics of Markov chains by constructing an associated sequence of periodic differential operators. Studying the density of states of these operators reveals the absolutely continuous invariant measure…

Dynamical Systems · Mathematics 2025-09-22 Bryn Davies , Angelica Yu Xiao

We study scaling limits of non-increasing Markov chains with values in the set of non-negative integers, under the assumption that the large jump events are rare and happen at rates that behave like a negative power of the current state. We…

Probability · Mathematics 2012-01-06 Bénédicte Haas , Grégory Miermont

In this paper we study Markov chains associated with the Metropolis-Hastings algorithm. We consider conditions under which the sequence of the successive densities of such a chain converges to the target density according to the total…

Statistics Theory · Mathematics 2020-06-16 Dimiter Tsvetkov , Lyubomir Hristov , Ralitsa Angelova-Slavova

A discrete-time Markov chain can be transformed into a new Markov chain by looking at its states along iterations of an almost surely finite stopping time. By the optional stopping theorem, any bounded harmonic function with respect to the…

Probability · Mathematics 2022-05-04 Iddo Ben-Ari , Behrang Forghani