English
Related papers

Related papers: Large deviations for non-irreducible Markov chains…

200 papers

We provide a novel method for sensitivity analysis of parametric robust Markov chains. These models incorporate parameters and sets of probability distributions to alleviate the often unrealistic assumption that precise probabilities are…

Machine Learning · Computer Science 2023-05-03 Thom Badings , Sebastian Junges , Ahmadreza Marandi , Ufuk Topcu , Nils Jansen

Let $(X_t)$ be a discrete time Markov chain on a general state space. It is well-known that if $(X_t)$ is aperiodic and satisfies a drift and minorization condition, then it converges to its stationary distribution $\pi$ at an exponential…

Probability · Mathematics 2019-08-20 Daniel C. Jerison

Large deviations for sums of i.i.d.\ random variables with stretched-exponential tails (also called Weibull or semi-exponential tails) have been well understood since the 60's, going back to Nagaev's seminal work. Many extensions in the…

Probability · Mathematics 2026-02-04 Nina Gantert , Joscha Prochno , Philipp Tuchel

We propose a model of random walks on weighted graphs where the weights are interval valued, and connect it to reversible imprecise Markov chains. While the theory of imprecise Markov chains is now well established, this is a first attempt…

Optimization and Control · Mathematics 2016-09-20 Damjan Škulj

In this work, we study the large deviation properties of random walk in a random environment on $\mathbb{Z}^d$ with $d\geq1$. We start with the quenched case, take the point of view of the particle, and prove the large deviation principle…

Probability · Mathematics 2008-09-09 Atilla Yilmaz

We establish Bernstein's inequalities for functions of general (general-state-space and possibly non-reversible) Markov chains. These inequalities achieve sharp variance proxies and encompass the classical Bernstein inequality for…

Statistics Theory · Mathematics 2025-04-18 Bai Jiang , Qiang Sun , Jianqing Fan

We consider a continuous time Markov chain on a countable state space. We prove a joint large deviation principle (LDP) of the empirical measure and current in the limit of large time interval. The proof is based on results on the joint…

Probability · Mathematics 2014-09-02 L. Bertini , A. Faggionato , D. Gabrielli

In this paper, we prove large deviation principles for the empirical measures associated with the Independent Metropolis Hastings (IMH) sampler and the Metropolis-adjusted Langevin Algorithm (MALA). These are the first large deviation…

Probability · Mathematics 2026-02-23 Federica Milinanni , Pierre Nyquist

The density-dependent Markov chain (DDMC) introduced in \cite{Kurtz1978} is a continuous time Markov process applied in fields such as epidemics, chemical reactions and so on. In this paper, we give moderate deviation principles of paths of…

Probability · Mathematics 2020-05-26 Xiaofeng Xue

We study a precise large deviation principle for a stationary regularly varying sequence of random variables. This principle extends the classical results of A.V. Nagaev (1969) and S.V. Nagaev (1979) for iid regularly varying sequences. The…

Statistics Theory · Mathematics 2012-06-11 Thomas Mikosch , Olivier Wintenberger

Consider a Markov chain $(X_i)_{i\ge0}$ with invariant measure $\mu$ that admits the representation $X_{i+1}=\Phi(X_i,U_i)$, where $(U_i)_{i\ge0}$ are i.i.d. random variables and $\Phi$ is a measurable map. We introduce a tangent-decoupled…

Probability · Mathematics 2025-12-23 Nawaf Bou-Rabee , Victor H. de la Peña

In this paper we establish a large deviation principle for the entropy production rate of possible non-stationary, centered stable Gauss-Markov chains, verifying the Gallavotti-Cohen symmetry. We reach this goal by developing a large…

Probability · Mathematics 2023-04-24 Marco Zamparo , Massimiliano Semeraro

In this paper, we give quantitative bounds on the $f$-total variation distance from convergence of an Harris recurrent Markov chain on an arbitrary under drift and minorisation conditions implying ergodicity at a sub-geometric rate. These…

Probability · Mathematics 2007-05-23 Randal Douc , Eric Moulines , Philippe Soulier

In this paper we consider Markov chains with transition rates that depend on a small parameter $\varepsilon$. Under a mild assumption on the asymptotics of these transition rates, we describe the behavior of the chain at various…

Probability · Mathematics 2017-04-26 Mark Freidlin , Leonid Koralov

Starting from one-point tail bounds, we establish an upper tail large deviation principle for the directed landscape at the metric level. Metrics of finite rate are in one-to-one correspondence with measures supported on a set of countably…

Probability · Mathematics 2024-05-27 Sayan Das , Duncan Dauvergne , Bálint Virág

In this paper, we give precise rates of convergence in the strong invariance principle for stationary sequences of bounded real-valued random variables satisfying weak dependence conditions. One of the main ingredients is a new Fuk-Nagaev…

Probability · Mathematics 2023-07-06 J Dedecker , F Merlevède , Emmanuel Rio

We consider a discrete time hidden Markov model where the signal is a stationary Markov chain. When conditioned on the observations, the signal is a Markov chain in a random environment under the conditional measure. It is shown that this…

Probability · Mathematics 2009-09-24 Ramon van Handel

We present an algorithm that can efficiently compute a broad class of inferences for discrete-time imprecise Markov chains, a generalised type of Markov chains that allows one to take into account partially specified probabilities and other…

Probability · Mathematics 2019-07-02 Natan T'Joens , Thomas Krak , Jasper De Bock , Gert de Cooman

We argue that the spectral theory of non-reversible Markov chains may often be more effectively cast within the framework of the naturally associated weighted-$L_\infty$ space $L_\infty^V$, instead of the usual Hilbert space $L_2=L_2(\pi)$,…

Probability · Mathematics 2009-06-30 Ioannis Kontoyiannis , Sean P. Meyn

Markov chains are convenient means of generating realizations of networks with a given (joint or otherwise) degree distribution, since they simply require a procedure for rewiring edges. The major challenge is to find the right number of…

Social and Information Networks · Computer Science 2012-11-01 J. Ray , A. Pinar , C. Seshadhri