English
Related papers

Related papers: Large deviations for non-irreducible Markov chains…

200 papers

Since the pioneering works of Jakobson and Benedicks & Carleson and others, it has been known that a positive measure set of quadratic maps admit invariant probability measures absolutely continuous with respect to Lebesgue. These measures…

Dynamical Systems · Mathematics 2015-05-28 Yong Moo Chung , Hiroki Takahasi

We give computable bounds on the rate of convergence of the transition probabilities to the stationary distribution for a certain class of geometrically ergodic Markov chains. Our results are different from earlier estimates of Meyn and…

Probability · Mathematics 2007-05-23 Peter H. Baxendale

Let $\Delta^o$ be a finite set and, for each probability measure $m$ on $\Delta^o$, let $G(m)$ be a transition probability kernel on $\Delta^o$. Fix $x_0 \in \Delta^o$ and consider the chain $\{X_n, \; n \in \mathbb{N}_0\}$ of…

Probability · Mathematics 2025-07-15 Amarjit Budhiraja , Adam Waterbury , Pavlos Zoubouloglou

We consider the irreducibility of switch-based Markov chains for the approximate uniform sampling of Hamiltonian cycles in a given undirected dense graph on $n$ vertices. As our main result, we show that every pair of Hamiltonian cycles in…

Combinatorics · Mathematics 2020-11-20 Pieter Kleer , Viresh Patel , Fabian Stroh

The main purpose of this article is to establish moderate deviation principles for additive functionals of bifurcating Markov chains. Bifurcating Markov chains are a class of processes which are indexed by a regular binary tree. They can be…

Probability · Mathematics 2021-05-21 S. Valère Bitseki Penda , Gorgui Gackou

We establish a new Bernstein-type deviation inequality for general (non-reversible) discrete-time Markov chains via an elementary approach. More robust than existing works in the literature, our result only requires the Markov chain to…

Probability · Mathematics 2025-10-07 De Huang , Xiangyuan Li

Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a…

Optimization and Control · Mathematics 2018-09-13 Tao Sun , Yuejiao Sun , Wotao Yin

We study the large deviations principle for one dimensional, continuous, homogeneous, strong Markov processes that do not necessarily behave locally as a Wiener process. Any strong Markov process $X_{t}$ in $\mathbb{R}$ that is continuous…

Probability · Mathematics 2011-07-19 Konstantinos Spiliopoulos

We give rates of convergence in the strong invariance principle for stationary sequences satisfying some projective criteria. The conditions are expressed in terms of conditional expectations of partial sums of the initial sequence. Our…

Probability · Mathematics 2012-03-02 Jérôme Dedecker , Paul Doukhan , Florence Merlevède

We consider a family of measure preserving transformations, which act on a common probability space and are chosen at random by a stationary ergodic Markov chain. This setting defines an instance of a random dynamical system (RDS), which…

Dynamical Systems · Mathematics 2024-02-27 Pablo Lummerzheim , Felix Pogorzelski , Elias Zimmermann

When the initial and transition probabilities of a finite Markov chain in discrete time are not well known, we should perform a sensitivity analysis. This can be done by considering as basic uncertainty models the so-called credal sets that…

Probability · Mathematics 2009-11-24 Gert de Cooman , Filip Hermans , Erik Quaeghebeur

One-dimensional run-and-tumble processes may converge towards some localized non-equilibrium steady state when the two velocities and/or the two switching rates are space-dependent. A long dynamical trajectory can be then analyzed via the…

Statistical Mechanics · Physics 2021-08-23 Cecile Monthus

We present a systematic analysis of stochastic processes conditioned on an empirical measure $Q_T$ defined in a time interval $[0,T]$ for large $T$. We build our analysis starting from a discrete time Markov chain. Results for a continuous…

Statistical Mechanics · Physics 2019-06-26 Bernard Derrida , Tridib Sadhu

We consider a sequence $X^n=(X^n_t)_{t\ge 0},n\ge 1$ of semimartingales. Each $X^n$ is a weak solution to an It\^o equation with respect to a Wiener process and a Poissonian martingale measure and is in general non-Markovian process. For…

Probability · Mathematics 2007-05-23 Robert Sh. Liptser , Anatolii A. Pukhalskii

We establish convergence to an invariant measure as time tends to infinity, for a large class of (possibly non-Markovian) stochastic volatility models. Our arguments are based on a novel coupling idea for Markov chains which also extends to…

Probability · Mathematics 2021-08-30 Balázs Gerencsér , Miklós Rásonyi

We establish a sharp large deviation principle for renewal-reward processes, supposing that each renewal involves a broad-sense reward taking values in a real separable Banach space. In fact, we demonstrate a weak large deviation principle…

Probability · Mathematics 2023-04-24 Marco Zamparo

A sequence of Markov chains is said to exhibit (total variation) cutoff if the convergence to stationarity in total variation distance is abrupt. We consider reversible lazy chains. We prove a necessary and sufficient condition for the…

Probability · Mathematics 2018-01-19 Riddhipratim Basu , Jonathan Hermon , Yuval Peres

In this paper we establish a large deviations type estimate for strongly mixing Markov chains with respect to the Lp norm. As applications we derive such estimates for the iterates of a locally constant random cocycle with mixed rank, as…

Dynamical Systems · Mathematics 2026-02-10 Anselmo Pontes

We consider a Markov chain on $\mathbb{R}^d$ with invariant measure $\mu$. We are interested in the rate of convergence of the empirical measures towards the invariant measure with respect to various dual distances, including in particular…

Probability · Mathematics 2022-10-13 Adrian Riekert

Suppose $ E$ is a space with a null-recurrent Markov kernel $ P$. Furthermore, suppose there are infinite particles with variable weights on $ E$ performing a random walk following $ P$. Let $ X_{t}$ be a weighted functional of the position…

Probability · Mathematics 2010-12-01 Souvik Ghosh