English
Related papers

Related papers: Characterisation of gradient flows on finite state…

200 papers

Let K be an irreducible and reversible Markov kernel on a finite set X. We construct a metric W on the set of probability measures on X and show that with respect to this metric, the law of the continuous time Markov chain evolves as the…

Probability · Mathematics 2011-06-17 Jan Maas

We study the temporal dissipation of variance and relative entropy for ergodic Markov Chains in continuous time, and compute explicitly the corresponding dissipation rates. These are identified, as is well known, in the case of the variance…

Probability · Mathematics 2022-05-19 Ioannis Karatzas , Jan Maas , Walter Schachermayer

We consider continuous-time Markov chains which display a family of wells at the same depth. We provide sufficient conditions which entail the convergence of the finite-dimensional distributions of the order parameter to the ones of a…

Probability · Mathematics 2019-10-03 Claudio Landim , Michail Loulakis , Mustapha Mourragui

Consider a probability measure on a Hilbert space defined via its density with respect to a Gaussian. The purpose of this paper is to demonstrate that an appropriately defined Markov chain, which is reversible with respect to the measure in…

Statistics Theory · Mathematics 2014-04-21 Natesh S. Pillai , Andrew M. Stuart , Alexandre H. Thiery

We prove the existence of limiting distributions for a large class of Markov chains on a general state space in a random environment. We assume suitable versions of the standard drift and minorization conditions. In particular, the system…

Probability · Mathematics 2020-12-04 Attila Lovas , Miklós Rásonyi

In this study, a new extension of the Markov Renewal theory is introduced by allowing time to evolve in multiple dimensions. The resulting chains are referred to as multi-time Markov Renewal chains and since this extension is new, the state…

Probability · Mathematics 2025-08-21 Leonidas Kordalis , Samis Trevezas

We consider an irreducible continuous time Markov chain on a finite state space and with time periodic jump rates and prove the joint large deviation principle for the empirical measure and flow and the joint large deviation principle for…

Probability · Mathematics 2018-10-17 L. Bertini , R. Chetrite , A. Faggionato , D. Gabrielli

We investigate the mixing properties of a finite Markov chain in random environment defined as a mixture of a deterministic chain and a chain whose state space has been permuted uniformly at random. This work is the counterpart of a…

Probability · Mathematics 2024-02-07 Bastien Dubail

We introduce the notion of order of magnitude reversibility (OM-reversibility) in Markov chains that are parametrized by a positive parameter $\ep$. OM-reversibility is a weaker condition than reversibility, and requires only the knowledge…

Probability · Mathematics 2011-10-26 Badal Joshi

We obtain universal estimates on the convergence to equilibrium and the times of coupling for continuous time irreducible reversible finite-state Markov chains, both in the total variation and in the L^2 norms. The estimates in total…

Probability · Mathematics 2012-01-24 Mykhaylo Shkolnikov

Consider a Markov chain with finite state $\{0, 1, ..., d\}$. We give the generation functions (or Laplace transforms) of absorbing (passage) time in the following two situations : (1) the absorbing time of state $d$ when the chain starts…

Probability · Mathematics 2014-12-09 Wenming Hong , Ke Zhou

We discuss a canonical structure that provides a unifying description of dynamical large deviations for irreversible finite state Markov chains (continuous time), Onsager theory, and Macroscopic Fluctuation Theory. For Markov chains, this…

Statistical Mechanics · Physics 2018-02-19 Marcus Kaiser , Robert L. Jack , Johannes Zimmer

In this paper, we consider a general class of two-time-scale Markov chains whose transition rate matrix depends on a parameter $\lambda>0$. We assume that some transition rates of the Markov chain will tend to infinity as…

Probability · Mathematics 2015-07-10 Chen Jia

Consider a sequence of continuous-time Markov chains $(X^{(n)}_t:t\ge 0)$ evolving on a fixed finite state space $V$. Let $I_n$ be the level two large deviations rate functional for $X^{(n)}_t$, as $t\to\infty$. Under a hypothesis on the…

Probability · Mathematics 2022-09-26 C. Landim

We prove an upper bound on the total variation mixing time of a finite Markov chain in terms of the absolute spectral gap and the number of elements in the state space. Unlike results requiring reversibility or irreducibility, this bound is…

Probability · Mathematics 2013-10-31 Daniel Jerison

Consider an ergodic Markov chain on a countable state space for which the return times have exponential tails. We show that the stationary version of any such chain is a finitary factor of an i.i.d. process. A key step is to show that any…

Probability · Mathematics 2023-06-22 Omer Angel , Yinon Spinka

The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a…

Data Analysis, Statistics and Probability · Physics 2013-11-12 A. N. Gorban , P. A. Gorban , G. Judge

We study a class of ergodic quantum Markov semigroups on finite-dimensional unital $C^*$-algebras. These semigroups have a unique stationary state $\sigma$, and we are concerned with those that satisfy a quantum detailed balance condition…

Operator Algebras · Mathematics 2017-04-27 Eric A. Carlen , Jan Maas

The evolution of entropy is derived with respect to dynamical systems. For a stochastic system, its relative entropy $D$ evolves in accordance with the second law of thermodynamics; its absolute entropy $H$ may also be so, provided that the…

Chaotic Dynamics · Physics 2010-08-31 X. San Liang

Extensions of Kemeny's constant, as derived for irreducible finite Markov chains in discrete time, to Markov renewal processes and Markov chains in continuous time are discussed. Three alternative Kemeny's functions and their variants are…

Probability · Mathematics 2018-09-17 Jeffrey J Hunter
‹ Prev 1 2 3 10 Next ›