English
Related papers

Related papers: Ergodic property of stable-like Markov chains

200 papers

This paper provides a new path method that can be used to determine when an ergodic continuous-time Markov chain on $\mathbb Z^d$ converges exponentially fast to its stationary distribution in $L^2$. Specifically, we provide general…

Probability · Mathematics 2023-10-02 David F. Anderson , Daniele Cappelletti , Wai-Tong Louis Fan , Jinsu Kim

We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…

Probability · Mathematics 2016-09-21 Jasper De Bock

Let {X_n,n\geq0} be a Markov chain on a general state space X with transition probability P and stationary probability \pi. Suppose an additive component S_n takes values in the real line R and is adjoined to the chain such that…

Probability · Mathematics 2016-09-07 Cheng-Der Fuh

We study the limit behaviour of upper and lower bounds on expected time averages in imprecise Markov chains; a generalised type of Markov chain where the local dynamics, traditionally characterised by transition probabilities, are now…

Probability · Mathematics 2021-02-10 Natan T'Joens , Jasper De Bock

It is shown that transient graphs for the simple random walk do not admit a nearest neighbor transient Markov chain (not necessarily a reversible one), that crosses all edges with positive probability, while there is such chain for the…

Probability · Mathematics 2019-02-15 Itai Benjamini , Jonathan Hermon

We study the recurrence/transience phase transition for Markov chains on $\mathbb{R}_+$, $\mathbb{R}$, and $\mathbb{R}^2$ whose increments have heavy tails with exponent in $(1,2)$ and asymptotically zero mean. This is the infinite-variance…

Probability · Mathematics 2019-06-24 Nicholas Georgiou , Mikhail V. Menshikov , Dimitri Petritis , Andrew R. Wade

The question of recurrence and transience of branching Markov chains is more subtle than for ordinary Markov chains; they can be classified in transience, weak recurrence, and strong recurrence. We review criteria for transience and weak…

Probability · Mathematics 2008-11-12 Sebastian Müller

We consider a bivariate stationary Markov chain $(X_n,Y_n)_{n\ge0}$ in a Polish state space, where only the process $(Y_n)_{n\ge0}$ is presumed to be observable. The goal of this paper is to investigate the ergodic theory and stability…

Probability · Mathematics 2012-08-22 Xin Thomson Tong , Ramon van Handel

In this paper we study the ergodicity and the related semigroup property for a class of symmetric Markov jump processes associated with time changed symmetric $\alpha$-stable processes. For this purpose, explicit and sharp criteria for…

Probability · Mathematics 2013-12-19 Zhen-Qing Chen , Jian Wang

We study limit theorems for partial sums of instantaneous functions of a homogeneous Markov chain on a general state space. The summands are heavy-tailed and the limits are stable distributions. The conditions imposed on the transition…

Probability · Mathematics 2018-08-14 Mohamed El Machkouri , Adam Jakubowski , Dalibor Volný

It is known that the Dobrushin's ergodicity coefficient is one of the effective tools to study a behavior of non-homogeneous Markov chains. In the present paper, we define such an ergodicity coefficient of a positive mapping defined on…

Functional Analysis · Mathematics 2013-11-05 Farrukh Mukhamedov

Let $P$ be the transition matrix of a finite, irreducible and reversible Markov chain. We say the continuous time Markov chain $X$ has transition matrix $P$ and speed $\lambda$ if it jumps at rate $\lambda$ according to the matrix $P$. Fix…

Probability · Mathematics 2015-06-26 Louigi Addario-Berry , Roberto I. Oliveira , Yuval Peres , Perla Sousi

In this short note we prove ``effective" geometric ergodicity (i.e a Perron-Frobenius theorem) for Markov chains in random mixing dynamical environment satisfying a random non-uniform version of the Doeblin condition. Effectivity here means…

Probability · Mathematics 2026-01-05 Yeor Hafouta

We study the ergodic properties of two classes of random dynamical systems: a type of Markov chain which we call the \textit{alternating random walk} and a certain stochastic billiard system which describes the motion of a free-moving rough…

Dynamical Systems · Mathematics 2024-01-02 Peter Rudzis

Consider a stochastic process $\{X(t)\}$ on a finite state space $ {\sf X}=\{1,\dots, d\}$. It is conditionally Markov, given a real-valued `input process' $\{\zeta(t)\}$. This is assumed to be small, which is modeled through the scaling,…

Performance · Computer Science 2018-09-18 Yue Chen , Ana Bušić , Sean Meyn

We develop a practical approach to establish the stability, that is, the recurrence in a given set, of a large class of controlled Markov chains. These processes arise in various areas of applied science and encompass important numerical…

Statistics Theory · Mathematics 2015-02-02 Christophe Andrieu , Vladislav B. Tadić , Matti Vihola

We introduce and study time-inhomogeneous quantum Markov chains with parameter $\zeta \ge 0$ and decoherence parameter $0 \leq p \leq 1$ on finite spaces and their large scale equilibrium properties. Here $\zeta$ resembles the inverse…

Quantum Physics · Physics 2020-12-11 Chia-Han Chou , Wei-Shih Yang

We consider a Markov chain $\{X_n\}_{n=0}^\8$ on $\R^d$ defined by the stochastic recursion $X_{n}=M_n X_{n-1}+Q_n$, where $(Q_n,M_n)$ are i.i.d. random variables taking values in the affine group $H=\R^d\rtimes {\rm GL}(\R^d)$. Assume that…

Probability · Mathematics 2008-11-10 Dariusz Buraczewski , Ewa Damek , Yves Guivarc'h

Non-linear Hawkes processes with memory kernels given by the sum of Erlang kernels are considered. It is shown that their stability properties can be studied in terms of an associated class of piecewise deterministic Markov processes,…

Probability · Mathematics 2018-11-27 Aline Duarte , Eva Löcherbach , Guilherme Ost

We consider a class of discrete time Markov chains with state space [0,1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then…

Probability · Mathematics 2014-12-04 Shaun McKinlay , Konstantin Borovkov