English
Related papers

Related papers: Some universal estimates for reversible Markov cha…

200 papers

In this paper, we are interested in investigating the perturbation bounds for the stationary distributions for discrete-time or continuous-time Markov chains on a countable state space. For discrete-time Markov chains, two new norm-wise…

Probability · Mathematics 2012-08-27 Yuanyuan Liu

Irreversibility is one of the most intriguing concepts in physics. While microscopic physical laws are perfectly reversible, macroscopic average behavior has a preferred direction of time. According to the second law of thermodynamics, this…

Quantum Physics · Physics 2017-04-12 T. B. Batalhao , A. M. Souza , R. S. Sarthour , I. S. Oliveira , M. Paternostro , E. Lutz , R. M. Serra

A finite ergodic Markov chain exhibits cutoff if its distance to equilibrium remains close to its initial value over a certain number of iterations and then abruptly drops to near 0 on a much shorter time scale. Originally discovered in the…

Probability · Mathematics 2018-01-23 Charles Bordenave , Pietro Caputo , Justin Salez

We consider reversible ergodic Markov chains with finite state space, and we introduce a new notion of quasi-stationary distribution that does not require the presence of any absorbing state. In our setting, the hitting time of the…

Probability · Mathematics 2024-10-01 Roberto Fernandez , Francesco Manzo , Matteo Quattropani , Elisabetta Scoppola

We present a Markov chain example where non-reversibility and an added edge jointly improve mixing time: when a random edge is added to a cycle of $n$ vertices and a Markov chain with a drift is introduced, we get mixing time of…

Probability · Mathematics 2019-06-07 Balázs Gerencsér

Continuous time financial market models are often motivated as scaling limits of discrete time models. The objective of this paper is to establish such a connection for a robust framework. More specifically, we consider discrete time models…

Probability · Mathematics 2024-10-17 David Criens

We study irreducible time-homogenous Markov chains with finite state space in discrete time. We obtain results on the sensitivity of the stationary distribution and other statistical quantities with respect to perturbations of the…

Probability · Mathematics 2007-05-23 Eilon Solan , Nicolas Vieille

The entropy production is commonly interpreted as measuring the distance from equilibrium. However, this explanation lacks a rigorous description due to the absence of a natural equilibrium measure. The present analysis formalizes this…

Statistical Mechanics · Physics 2025-10-23 David Andrieux

Labelled Markov chains (LMCs) are widely used in probabilistic verification, speech recognition, computational biology, and many other fields. Checking two LMCs for equivalence is a classical problem subject to extensive studies, while the…

Logic in Computer Science · Computer Science 2014-05-16 Taolue Chen , Stefan Kiefer

General Markov chains with a countably additive transition probability in arbitrary phase space are considered. Markov operators extend from the space of countably additive measures to the space of finitely additive measures. In the…

Probability · Mathematics 2018-04-10 Alexander I. Zhdanok

Understanding how systems respond to external perturbations is fundamental to statistical physics. For systems far from equilibrium, a general framework for response remains elusive. While progress has been made on the linear response of…

Statistical Mechanics · Physics 2026-03-04 Ruicheng Bao , Shiling Liang

We establish a new Bernstein-type deviation inequality for general (non-reversible) discrete-time Markov chains via an elementary approach. More robust than existing works in the literature, our result only requires the Markov chain to…

Probability · Mathematics 2025-10-07 De Huang , Xiangyuan Li

We study the convergence time to equilibrium of the Metropolis dynamics for the Generalized Random Energy Model with an arbitrary number of hierarchical levels, a finite and reversible continuous-time Markov process, in terms of the…

Probability · Mathematics 2020-01-08 A. M. B. Nascimento , L. R. Fontes

We study the scaling behavior of the entanglement entropy of two dimensional conformal quantum critical systems, i.e. systems with scale invariant wave functions. They include two-dimensional generalized quantum dimer models on bipartite…

Statistical Mechanics · Physics 2009-03-28 Benjamin Hsu , Michael Mulligan , Eduardo Fradkin , Eun-Ah Kim

Permutation entropy measures the complexity of deterministic time series via a data symbolic quantization consisting of rank vectors called ordinal patterns or just permutations. The reasons for the increasing popularity of this entropy in…

Data Analysis, Statistics and Probability · Physics 2021-03-08 José M. Amigó , Roberto Dale , Piergiulio Tempesta

We analyse and interpret the effects of breaking detailed balance on the convergence to equilibrium of conservative interacting particle systems and their hydrodynamic scaling limits. For finite systems of interacting particles, we review…

Statistical Mechanics · Physics 2017-08-21 Marcus Kaiser , Robert L. Jack , Johannes Zimmer

We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…

Probability · Mathematics 2016-09-21 Jasper De Bock

This article shows how coupled Markov chains that meet exactly after a random number of iterations can be used to generate unbiased estimators of the solutions of the Poisson equation. Through this connection, we re-derive known unbiased…

Computation · Statistics 2025-12-10 Randal Douc , Pierre E. Jacob , Anthony Lee , Dootika Vats

It is commonly admitted that non-reversible Markov chain Monte Carlo (MCMC) algorithms usually yield more accurate MCMC estimators than their reversible counterparts. In this note, we show that in addition to their variance reduction…

Computation · Statistics 2019-08-27 Marie Vialaret , Florian Maire

By proving a local limit theorem for higher-order transitions, we determine the time required for necklace chains to be close to stationarity. Because necklace chains, built by arranging identical smaller chains around a directed cycle, are…

Probability · Mathematics 2021-11-22 Elizabeth L. Wilmer