English
Related papers

Related papers: Commuting time geometry of ergodic Markov chains

200 papers

We demonstrate that the thermodynamic friction metric governing dissipation in slowly driven continuous-time Markov chains is equivalent to the commute-time embedding and the resistance distance. This equivalence yields complementary…

Statistical Mechanics · Physics 2026-03-30 Jordan R Sawchuk , David A Sivak

In any Markov chain with finite state space the distribution of transition records always belongs to the exponential family. This observation is used to prove a fluctuation theorem, and to show that the dynamical entropy of a stationary…

Statistical Mechanics · Physics 2009-11-11 Jan Naudts , Erik Van der Straeten

Let $(\xi_n)_{n=0}^\infty$ be a nonhomogeneous Markov chain taking values from finite state-space of $\mathbf{X}=\{1,2,\ldots,b\}$. In this paper, we will study the generalized entropy ergodic theorem with almost-everywhere and…

Probability · Mathematics 2015-01-19 Zhongzhi Wang , Weiguo Yang

We consider symmetric Markov chains on $\Bbb Z^d$ where we do {\bf not} assume that the conductance between two points must be zero if the points are far apart. Under a uniform second moment condition on the conductances, we obtain upper…

Probability · Mathematics 2007-05-23 Richard F. Bass , Takashi Kumagai

In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition…

Probability · Mathematics 2021-10-22 Aleksandr A. Shchegolev

Max-stable processes are central models for spatial extremes. In this paper, we focus on some space-time max-stable models introduced in Embrechts et al. (2016). The processes considered induce discrete-time Markov chains taking values in…

Probability · Mathematics 2018-05-09 Erwan Koch , Christian Y. Robert

This article provides the first procedure for computing a fully data-dependent interval that traps the mixing time $t_{\text{mix}}$ of a finite reversible ergodic Markov chain at a prescribed confidence level. The interval is computed from…

Machine Learning · Computer Science 2015-11-04 Daniel Hsu , Aryeh Kontorovich , Csaba Szepesvári

Motivated by the notion of resistance distance on graph, we define a new resistance distance between two states on a given finite ergodic Markov chain based on its fundamental matrix. We prove a few equivalent formulations and discuss its…

Probability · Mathematics 2019-03-05 Michael C. H. Choi

A finite ergodic Markov chain exhibits cutoff if its distance to equilibrium remains close to its initial value over a certain number of iterations and then abruptly drops to near 0 on a much shorter time scale. Originally discovered in the…

Probability · Mathematics 2018-01-23 Charles Bordenave , Pietro Caputo , Justin Salez

We introduce a general class of distances (metrics) between Markov chains, which are based on linear behaviour. This class encompasses distances given topologically (such as the total variation distance or trace distance) as well as by…

Formal Languages and Automata Theory · Computer Science 2016-06-27 Przemysław Daca , Thomas A. Henzinger , Jan Křetínský , Tatjana Petrov

We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…

Probability · Mathematics 2016-09-21 Jasper De Bock

The convergence rate of a Markov chain to its stationary distribution is typically assessed using the concept of total variation mixing time. However, this worst-case measure often yields pessimistic estimates and is challenging to infer…

Statistics Theory · Mathematics 2026-02-06 Geoffrey Wolfer , Pierre Alquier

We consider reversible ergodic Markov chains with finite state space, and we introduce a new notion of quasi-stationary distribution that does not require the presence of any absorbing state. In our setting, the hitting time of the…

Probability · Mathematics 2024-10-01 Roberto Fernandez , Francesco Manzo , Matteo Quattropani , Elisabetta Scoppola

A general theory is provided delivering convergence of maximal cyclically monotone mappings containing the supports of coupling measures of sequences of pairs of possibly random probability measures on Euclidean space. The theory is based…

Statistics Theory · Mathematics 2022-08-05 Johan Segers

Improved rates of convergence for ergodic Markov chains and relaxed conditions for them, as well as analogous convergence results for some non-homogeneous Markov chains are studied. The setting from the previous works is extended. Examples…

Probability · Mathematics 2022-09-27 A. Yu. Veretennikov , M. A. Veretennikova

In this paper we discuss how the notion of subgeometric ergodicity in Markov chain theory can be exploited to study stationarity and ergodicity of nonlinear time series models. Subgeometric ergodicity means that the transition probability…

Econometrics · Economics 2020-11-11 Mika Meitz , Pentti Saikkonen

We study the analogues of irreducibility, period, and communicating classes for open quantum random walks, as defined by Attal et al. (J. Stat. Phys., 2012). We recover results similar to the standard ones for Markov chains, in terms of…

Probability · Mathematics 2014-07-21 Raffaella Carbone , Yan Pautrat

Necessary and sufficient conditions for a Markov chain to be ergodic are that the chain is irreducible and aperiodic. This result is manifest in the case of random walks on finite groups by a statement about the support of the driving…

Quantum Algebra · Mathematics 2021-10-22 J. P. McCarthy

Consider a system evolving according to an absorbing discrete-time Markov chain with known transition matrix. The state of the system is observed at two points in time, separated by an unknown number of generations. We are interested in…

Probability · Mathematics 2015-11-04 Bianca De Sanctis , A. P. Jason de Koning

We provide explicit expressions for the constants involved in the characterisation of ergodicity of sub-geometric Markov chains. The constants are determined in terms of those appearing in the assumed drift and one-step minorisation…

Probability · Mathematics 2014-03-18 Christophe Andrieu , Gersende Fort , Matti Vihola