English
Related papers

Related papers: Large deviations for possibly reducible Markov cha…

200 papers

Large deviation principles and related results are given for a class of Markov chains associated to the "leaves" in random recursive trees and preferential attachment random graphs, as well as the "cherries" in Yule trees. In particular,…

Probability · Mathematics 2010-01-22 W. Bryc , D. Minda , S. Sethuraman

It is proved that the limit of the normalized rate-distortion functions of block independent approximations of an irreducible, aperiodic Markoff chain is independent of the initial distribution of the Markoff chain and thus, is also equal…

Information Theory · Computer Science 2018-03-28 Mukul Agarwal

Consider a sequence of continuous-time Markov chains $(X^{(n)}_t:t\ge 0)$ evolving on a fixed finite state space $V$. Let $I_n$ be the level two large deviations rate functional for $X^{(n)}_t$, as $t\to\infty$. Under a hypothesis on the…

Probability · Mathematics 2022-09-26 C. Landim

We examine two analytical characterisation of the metastable behavior of a Markov chain. The first one expressed in terms of its transition probabilities, and the second one in terms of its large deviations rate functional. Consider a…

Probability · Mathematics 2022-07-07 L. Bertini , D. Gabrielli , C. Landim

In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition…

Probability · Mathematics 2021-10-22 Aleksandr A. Shchegolev

If the state space of a homogeneous continuous-time Markov chain is too large, making inferences - here limited to determining marginal or limit expectations - becomes computationally infeasible. Fortunately, the state space of such a chain…

Probability · Mathematics 2018-06-01 Alexander Erreygers , Jasper De Bock

For finite size Markov chains, the Donsker-Varadhan theory fully describes the large deviations of the time averaged empirical measure. We are interested in the extension of the Donsker-Varadhan theory for a large size non-equilibrium…

Probability · Mathematics 2024-05-06 Thierry Bodineau , Benoit Dagallier

In this paper, we study small noise asymptotics of Markov-modulated diffusion processes in the regime that the modulating Markov chain is rapidly switching. We prove the joint sample-path large deviations principle for the Markov-modulated…

Probability · Mathematics 2023-02-27 Gang Huang , Michel Mandjes , Peter Spreij

We prove a large-deviation principle (LDP) for the sample paths of jump Markov processes in the small noise limit when, possibly, all the jump rates vanish uniformly, but slowly enough, in a region of the state space. We further discuss the…

Probability · Mathematics 2021-02-26 Andrea Agazzi , Luisa Andreis , Robert I. A. Patterson , D. R. Michiel Renger

It is known that state-dependent, multi-step Lyapunov bounds lead to greatly simplified verification theorems for stability for large classes of Markov chain models. This is one component of the "fluid model" approach to stability of…

Optimization and Control · Mathematics 2012-05-18 Serdar Yüksel , Sean P. Meyn

The large deviations at various levels that are explicit for Markov jump processes satisfying detailed-balance are revisited in terms of the supersymmetric quantum Hamiltonian $H$ that can be obtained from the Markov generator via a…

Statistical Mechanics · Physics 2024-07-15 Cecile Monthus

We prove a Large Deviation Principle for {\color{blue} jump-Markov } Processes on sparse large disordered network with disordered connectivity. The network is embedded in a geometric space, with the probability of a connection a (scaled)…

Probability · Mathematics 2026-02-02 James MacLaurin

The asymptotic variance is an important criterion to evaluate the performance of Markov chains, especially for the central limit theorems. We give the variational formulas for the asymptotic variance of discrete-time (non-reversible) Markov…

Probability · Mathematics 2020-12-29 Lu-Jing Huang , Yong-Hua Mao

We formulate some simple conditions under which a Markov chain may be approximated by the solution to a differential equation, with quantifiable error probabilities. The role of a choice of coordinate functions for the Markov chain is…

Probability · Mathematics 2008-04-23 R. W. R. Darling , J. R. Norris

A large deviation principle is established for a two-scale stochastic system in which the slow component is a continuous process given by a small noise finite dimensional It\^{o} stochastic differential equation, and the fast component is a…

Probability · Mathematics 2017-05-09 Amarjit Budhiraja , Paul Dupuis , Arnab Ganguly

Let $S_N$ be the sum of vector-valued functions defined on a finite Markov chain. An analogue of the Bernstein--Hoeffding inequality is derived for the probability of large deviations of $S_N$ and relates the probability to the spectral gap…

Probability · Mathematics 2009-09-29 Vladislav Kargin

In this paper we establish a large deviation principle for the entropy production rate of possible non-stationary, centered stable Gauss-Markov chains, verifying the Gallavotti-Cohen symmetry. We reach this goal by developing a large…

Probability · Mathematics 2023-04-24 Marco Zamparo , Massimiliano Semeraro

We discuss a canonical structure that provides a unifying description of dynamical large deviations for irreversible finite state Markov chains (continuous time), Onsager theory, and Macroscopic Fluctuation Theory. For Markov chains, this…

Statistical Mechanics · Physics 2018-02-19 Marcus Kaiser , Robert L. Jack , Johannes Zimmer

Dealing with finite Markov chains in discrete time, the focus often lies on convergence behavior and one tries to make different copies of the chain meet as fast as possible and then stick together. There is, however, a very peculiar kind…

Probability · Mathematics 2017-02-15 Timo Hirscher , Anders Martinsson

We study the stochastic block model which is often used to model community structures and study community-detection algorithms. We consider the case of two blocks in regard to its largest connected component and largest biconnected…

Physics and Society · Physics 2020-11-11 Hendrik Schawe , Alexander K. Hartmann