English
Related papers

Related papers: Full $\Gamma$-expansion of reversible Markov chain…

200 papers

We introduce the concept of asymptotic period for an irreducible and aperiodic, discrete-time Markov chain X on a countable state space, and develop the theory leading to its formal definition. The asymptotic period of X equals one - its…

Probability · Mathematics 2019-03-05 Erik A. van Doorn

In this paper we investigate the existence of $L^{2}(\pi)$-spectral gaps for $\pi$-irreducible, positive recurrent Markov chains on general state space. We obtain necessary and sufficient conditions for the existence of…

Probability · Mathematics 2009-08-07 Achim Wuebker

Let $\{X_n\}_{n\in\N}$ be a Markov chain on a measurable space $\X$ with transition kernel $P$ and let $V:\X\r[1,+\infty)$. The Markov kernel $P$ is here considered as a linear bounded operator on the weighted-supremum space $\cB_V$…

Probability · Mathematics 2013-12-06 Loïc Hervé , James Ledoux

The upper extremes of a Markov chain with regulary varying stationary marginal distribution are known to exhibit under general conditions a multiplicative random walk structure called the tail chain. More generally, if the Markov chain is…

Probability · Mathematics 2007-06-13 Johan Segers

We consider a general honest homogeneous continuous-time Markov process with restarts. The process is forced to restart from a given distribution at time moments generated by an independent Poisson process. The motivation to study such…

Probability · Mathematics 2012-06-26 Konstantin Avrachenkov , Alexei Piunovskiy , Zhang Yi

In this paper, we propose a new Markov chain which generalizes random-to-random shuffling on permutations to random-to-random shuffling on linear extensions of a finite poset of size $n$. We conjecture that the second largest eigenvalue of…

Probability · Mathematics 2017-03-01 Arvind Ayyer , Anne Schilling , Nicolas M. Thiéry

We prove a sample path large deviation principle (LDP) with sub-linear speed for unbounded functionals of certain Markov chains induced by the Lindley recursion. The LDP holds in the Skorokhod space $\mathbb{D}[0,T]$ equipped with the…

Probability · Mathematics 2023-10-03 Mihail Bazhba , Jose Blanchet , Chang-Han Rhee , Bert Zwart

Let $(M_{n},S_{n})_{n\ge 0}$ be a Markov random walk with positive recurrent driving chain $(M_{n})_{n\ge 0}$ having countable state space $\mathcal{S}$ and stationary distribution $\pi$. It is shown in this note that, if the dual sequence…

Probability · Mathematics 2015-11-18 Gerold Alsmeyer

In his 2011 work, Maas has shown that the law of any time-reversible continuous-time Markov chain with finite state space evolves like a gradient flow of the relative entropy with respect to its stationary distribution. In this work we show…

Probability · Mathematics 2015-04-03 Helge Dietert

We take on a Random Matrix theory viewpoint to study the spectrum of certain reversible Markov chains in random environment. As the number of states tends to infinity, we consider the global behavior of the spectrum, and the local behavior…

Probability · Mathematics 2010-06-15 Charles Bordenave , Pietro Caputo , Djalil Chafai

We introduce a family of stochastic processes on the integers, depending on a parameter $p \in [0,1]$ and interpolating between the deterministic rotor walk (p=0) and the simple random walk (p=1/2). This p-rotor walk is not a Markov chain…

Probability · Mathematics 2016-04-08 Wilfried Huss , Lionel Levine , Ecaterina Sava-Huss

We consider a class of continuous time Markov chains on a compact metric space that admit an invariant measure strictly positive on open sets together with absorbing states. We prove the joint large deviation principle for the empirical…

Probability · Mathematics 2015-12-04 Giada Basile , Lorenzo Bertini

Given a finite typed rooted tree $T$ with $n$ vertices, the {\em empirical subtree measure} is the uniform measure on the $n$ typed subtrees of $T$ formed by taking all descendants of a single vertex. We prove a large deviation principle in…

Probability · Mathematics 2007-05-23 Amir Dembo , Peter Morters , Scott Sheffield

We consider topological Markov chains (also called Markov shifts) on countable graphs. We show that a transient graph can be extended to a recurrent graph of equal entropy which is either positive recurrent of null recurrent, and we give an…

Dynamical Systems · Mathematics 2019-01-03 Sylvie Ruette

We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$.…

Probability · Mathematics 2019-07-29 Balazs Gerencser , Miklos Rasonyi

The extremal behaviour of a Markov chain is typically characterized by its tail chain. For asymptotically dependent Markov chains existing formulations fail to capture the full evolution of the extreme event when the chain moves out of the…

Probability · Mathematics 2016-04-07 Ioannis Papastathopoulos , Kirstin Strokorb , Jonathan A. Tawn , Adam Butler

We present a new statistical test to detect that a presented state of a reversible Markov chain was not chosen from a stationary distribution. In particular, given a value function for the states of the Markov chain, we would like to…

Probability · Mathematics 2022-06-08 Maria Chikina , Alan Frieze , Wesley Pegden

Motivated by the study of the time evolution of random dynamical systems arising in a vast variety of domains --- ranging from physics to ecology ---, we establish conditions for the occurrence of a non-trivial asymptotic behaviour for…

Probability · Mathematics 2014-07-15 Vladimir Belitsky , Mikhail Menshikov , Dimitri Petritis , Marina Vachkovskaia

Reversible Markov chains play a central role in stochastic modelling and in algorithms such as Markov chain Monte Carlo (MCMC). Motivated by the fundamental importance of reversibility in classical settings, this paper develops a…

Probability · Mathematics 2025-10-28 Damjan Škulj

Imprecise continuous-time Markov chains are a robust type of continuous-time Markov chains that allow for partially specified time-dependent parameters. Computing inferences for them requires the solution of a non-linear differential…

Probability · Mathematics 2018-10-11 Alexander Erreygers , Jasper De Bock