English
Related papers

Related papers: Effective geometric ergodicty for Markov chains in…

200 papers

We derive a generalization of the Perron-Frobenius theorem to time-varying row-stochastic matrices as follows: using Kolmogorov's concept of absolute probability sequences, which are time-varying analogs of principal eigenvectors, we…

Optimization and Control · Mathematics 2024-12-06 Rohit Parasnis , Massimo Franceschetti , Behrouz Touri

We propose a simple criterion, inspired from the irreducible aperiodic Markov chains, to derive the exponential convergence of general positive semi-groups. When not checkable on the whole state space, it can be combined to the use of…

Probability · Mathematics 2020-11-09 Bertrand Cloez , Pierre Gabriel

Ergodicity is a fundamental issue for a stochastic process. In this paper, we refine results on ergodicity for a general type of Markov chain to a specific type or the $GI/G/1$-type Markov chain, which has many interesting and important…

Probability · Mathematics 2012-08-28 YongHua Mao , Yongming Tai , Yiqiang Q. Zhao , Jiezhong Zou

A Markov chain is geometrically ergodic if it converges to its in- variant distribution at a geometric rate in total variation norm. We study geo- metric ergodicity of deterministic and random scan versions of the two-variable Gibbs…

Statistics Theory · Mathematics 2012-06-22 Aixin Tan , Galin L. Jones , James P. Hobert

We study a class of dynamical systems generated by random substitutions, which contains both intrinsically ergodic systems and instances with several measures of maximal entropy. In this class, we show that the measures of maximal entropy…

Dynamical Systems · Mathematics 2026-03-26 Philipp Gohlke , Andrew Mitchell

In the framework of statistical mechanics the properties of macroscopic systems are deduced starting from the laws of their microscopic dynamics. One of the key assumptions in this procedure is the ergodic property, namely the equivalence…

Statistical Mechanics · Physics 2024-01-09 Marco Baldovin , Raffaele Marino , Angelo Vulpiani

It is known that Dobrushin's ergodicity coefficient is one of the effective tools in the investigations of limiting behavior of Markov processes. Several interesting properties of the ergodicity coefficient of a positive mapping defined on…

Functional Analysis · Mathematics 2017-04-26 Nazife Erkurşun Özcan , Farrukh Mukhamedov

For a discrete-time Markov chain $\{X(t)\}$ evolving on $\Re^\ell$ with transition kernel $P$, natural, general conditions are developed under which the following are established: 1. The transition kernel $P$ has a purely discrete spectrum,…

Probability · Mathematics 2019-07-19 Adithya Devraj , Ioannis Kontoyiannis , Sean Meyn

We establish quantitative bounds for rates of convergence and asymptotic variances for iterated conditional sequential Monte Carlo (i-cSMC) Markov chains and associated particle Gibbs samplers. Our main findings are that the essential…

Probability · Mathematics 2015-04-15 Christophe Andrieu , Anthony Lee , Matti Vihola

We investigate the convergence in distribution of sequential empirical processes of dependent data indexed by a class of functions F. Our technique is suitable for processes that satisfy a multiple mixing condition on a space of functions…

Probability · Mathematics 2014-09-26 Herold Dehling , Olivier Durieu , Marco Tusche

We establish verifiable general sufficient conditions for exponential or subexponential ergodicity of Markov processes that may lack the strong Feller property. We apply the obtained results to show exponential ergodicity of a variety of…

Probability · Mathematics 2019-03-27 Oleg Butkovsky , Alexei Kulik , Michael Scheutzow

We consider Markov chains on general state spaces in stationary random environment which are defined by a random mapping that is contractive up to a bounded perturbation. We prove their convergence to a limiting law, providing convergence…

Probability · Mathematics 2025-12-18 Attila Lovas , Miklós Rásonyi , Lionel Truquet

We give computable bounds on the rate of convergence of the transition probabilities to the stationary distribution for a certain class of geometrically ergodic Markov chains. Our results are different from earlier estimates of Meyn and…

Probability · Mathematics 2007-05-23 Peter H. Baxendale

New relations between ergodic rate, L_p convergence rates, and asymptotic behavior of tail probabilities for hitting times of a time homogeneous Markov process are established. For L_p convergence rates and related spectral and functional…

Probability · Mathematics 2009-12-01 Alexey M. Kulik

In this paper we discuss how the notion of subgeometric ergodicity in Markov chain theory can be exploited to study stationarity and ergodicity of nonlinear time series models. Subgeometric ergodicity means that the transition probability…

Econometrics · Economics 2020-11-11 Mika Meitz , Pentti Saikkonen

We obtain a perfect sampling characterization of weak ergodicity for backward products of finite stochastic matrices, and equivalently, simultaneous tail triviality of the corresponding nonhomogeneous Markov chains. Applying these ideas to…

Statistics Theory · Mathematics 2016-01-07 Nick Whiteley , Anthony Lee

The use of higher-order stochastic processes such as nonlinear Markov chains or vertex-reinforced random walks is significantly growing in recent years as they are much better at modeling high dimensional data and nonlinear dynamics in…

Numerical Analysis · Mathematics 2020-04-29 Dario Fasino , Francesco Tudisco

A piecewise-deterministic Markov process, specified by random jumps and switching semi-flows, as well as the associated Markov chain given by its post-jump locations, are investigated in this paper. The existence of an exponentially…

Probability · Mathematics 2020-12-07 Dawid Czapla , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

Let $(\xi_n)_{n=0}^\infty$ be a nonhomogeneous Markov chain taking values from finite state-space of $\mathbf{X}=\{1,2,\ldots,b\}$. In this paper, we will study the generalized entropy ergodic theorem with almost-everywhere and…

Probability · Mathematics 2015-01-19 Zhongzhi Wang , Weiguo Yang

The aim of this note is to present an elementary proof of a variation of Harris' ergodic theorem of Markov chains. This theorem, dating back to the fifties essentially states that a Markov chain is uniquely ergodic if it admits a ``small''…

Probability · Mathematics 2008-10-16 Martin Hairer , Jonathan C. Mattingly