English
Related papers

Related papers: The $L^2$-cutoffs for reversible Markov chains

200 papers

We investigate the cutoff phenomenon for Markov processes under information divergences such as $f$-divergences and R\'enyi divergences. We classify most common divergences into four types, namely $L^2$-type, $\mathrm{TV}$-type,…

Probability · Mathematics 2025-01-23 Youjia Wang , Michael C. H. Choi

It has been well known for some time that for strictly stationary Markov chains that are ``reversible'', that special symmetry provides special extra features in the mathematical theory. This paper here is primarily a purely expository…

Probability · Mathematics 2019-10-04 Richard C. Bradley

Labelled Markov chains (LMCs) are widely used in probabilistic verification, speech recognition, computational biology, and many other fields. Checking two LMCs for equivalence is a classical problem subject to extensive studies, while the…

Logic in Computer Science · Computer Science 2014-05-16 Taolue Chen , Stefan Kiefer

In this paper, we study consistent and partially exchangeable sequences of Markov chains on a finite state space. We provide a characterisation of the admissible transition rates via a decomposition into individual and coordinated motion of…

Let $(X_t)_{t = 0 }^{\infty}$ be an irreducible reversible discrete time Markov chain on a finite state space $\Omega $. Denote its transition matrix by $P$. To avoid periodicity issues (and thus ensuring convergence to equilibrium) one…

Probability · Mathematics 2018-01-29 Jonathan Hermon , Yuval Peres

The mixing time of an ergodic, reversible Markov chain can be bounded in terms of the eigenvalues of the chain: specifically, the second-largest eigenvalue and the smallest eigenvalue. It has become standard to focus only on the…

Combinatorics · Mathematics 2013-01-22 Catherine Greenhill

Substantial progress has recently been made in the understanding of the cutoff phenomenon for Markov processes, using an information-theoretic statistics known as varentropy [Sal23; Sal24; Sal25a; PS25]. In the present paper, we propose an…

Probability · Mathematics 2025-09-18 Francesco Pedrotti , Justin Salez

Substitution Markov chains have been introduced [7] as a new model to describe molecular evolution. In this note, we study the associated Martin boundaries from a probabilistic and topological viewpoint. An example is given that, although…

Probability · Mathematics 2017-06-01 David Koslicki , Manfred Denker

We survey recent results concerning the total-variation mixing time of the simple exclusion process on the segment (symmetric and asymmetric) and a continuum analog, the simple random walk on the simplex with an emphasis on cutoff results.…

Probability · Mathematics 2021-11-15 Hubert Lacoin

We present a recurrence-transience classification for discrete-time Markov chains on manifolds with negative curvature. Our classification depends only on geometric quantities associated to the increments of the chain, defined via the…

Probability · Mathematics 2020-11-10 John Armstrong , Tim King

Given two labelled Markov decision processes (MDPs), the trace-refinement problem asks whether for all strategies of the first MDP there exists a strategy of the second MDP such that the induced labelled Markov chains are trace-equivalent.…

Logic in Computer Science · Computer Science 2023-06-22 Nathanaël Fijalkow , Stefan Kiefer , Mahsa Shirmohammadi

In this paper, we analyze the number of departures from an initially empty $M/M/\infty$ system in a finite time interval. We observe the system during an exponentially distributed period of time starting from the time origin. We then…

Probability · Mathematics 2023-03-20 Fabrice Guillemin

In this paper, we present a new derivative via the Laplace transform. The Laplace transform leads to a natural form of the fractional derivative which is equivalent to a Riemann-Liouville derivative with fixed terminal point. We first…

General Mathematics · Mathematics 2020-02-03 Mostafa Rezapour , Adebowale Sijuwade

We study distributions of meeting times for finite symmetric Markov chains. For Markov kernels defined on large state spaces which satisfy certain weak inhomogeneity in return probabilities of points up to large numbers of steps, we obtain…

Probability · Mathematics 2014-10-20 Yu-Ting Chen

We develop a Markov process viewpoint for discrete circular distributions motivated by directional-statistics settings where angles are observed on a finite grid and evolve over time. On the $m$-point discrete circle, the cycle graph, we…

Statistics Theory · Mathematics 2026-03-04 Sourav Majumdar

A metric space $X$ has {\em Markov type} 2, if for any reversible finite-state Markov chain $\{Z_t\}$ (with $Z_0$ chosen according to the stationary distribution) and any map $f$ from the state space to $X$, the distance $D_t$ from $f(Z_0)$…

Functional Analysis · Mathematics 2016-09-07 Assaf Naor , Yuval Peres , Oded Schramm , Scott Sheffield

We study properties of the Laplace transforms of non-negative additive functionals of Markov chains. We are namely interested in a multiplicative ergodicity property used in [18] to study bifurcating processes with ancestral dependence. We…

Probability · Mathematics 2015-09-11 Loïc Hervé , Françoise Pène

In [Aldous,Pitman,1998] a tree-valued Markov chain is derived by pruning off more and more subtrees along the edges of a Galton-Watson tree. More recently, in [Abraham,Delmas,2012], a continuous analogue of the tree-valued pruning dynamics…

Probability · Mathematics 2015-11-26 Wolfgang Löhr , Guillaume Voisin , Anita Winter

Perturbation theory for Markov chains addresses the question how small differences in the transitions of Markov chains are reflected in differences between their distributions. We prove powerful and flexible bounds on the distance of the…

Computation · Statistics 2017-02-27 Daniel Rudolf , Nikolaus Schweizer

In this paper we study the common distance between points and the behavior of a constant length step discrete random walk on finite area hyperbolic surfaces. We show that if the second smallest eigenvalue of the Laplacian is at least 1/4,…

Geometric Topology · Mathematics 2019-06-04 Konstantin Golubev , Amitay Kamber