English
Related papers

Related papers: On convergence rate for homogeneous Markov chains

200 papers

In this note, a general approach to the study of non-stationary Markov chains with catastrophes and the corresponding queuing models is considered, as well as to obtain estimates of the limiting regime itself. As an illustration, an example…

Probability · Mathematics 2021-05-05 Alexander Zeifman

We give a bound on the mixing time of a uniformly ergodic, reversible Markov chain in terms of the spectral radius of the transition operator. This bound has been established previously in finite state spaces, and is widely believed to hold…

Probability · Mathematics 2014-05-02 Dawn B. Woodard

A continuous-time random walk in the quarter plane with homogeneous transition rates is considered. Given a non-negative reward function on the state space, we are interested in the expected stationary performance. Since a direct derivation…

Probability · Mathematics 2017-08-31 Xinwei Bai , Jasper Goseling

It is known that Dobrushin's ergodicity coefficient is one of the effective tools in the investigations of limiting behavior of Markov processes. Several interesting properties of the ergodicity coefficient of a positive mapping defined on…

Functional Analysis · Mathematics 2017-04-26 Nazife Erkurşun Özcan , Farrukh Mukhamedov

This paper is concerned with homogenization of systems of linear elasticity with rapidly oscillating periodic coefficients. We establish sharp convergence rates in $L^2$ for the mixed boundary value problems with bounded measurable…

Analysis of PDEs · Mathematics 2017-02-14 Zhongwei Shen , Jinping Zhuge

The first aim of this paper is to introduce a class of Markov chains on $\mathbb{Z}_+$ which are discrete self-similar in the sense that their semigroups satisfy an invariance property expressed in terms of a discrete random dilation…

Probability · Mathematics 2022-03-08 Laurent Miclo , Pierre Patie , Rohan Sarkar

In this paper we find nonasymptotic exponential upper bounds for the deviation in the ergodic theorem for families of homogeneous Markov processes. We find some sufficient conditions for geometric ergodicity uniformly over a parametric…

Probability · Mathematics 2012-05-10 Leonid Galtchouk , Serguei Pergamenchtchikov

Consider a filtering process associated to a hidden Markov model with densities for which both the state space and the observation space are complete, separable, metric spaces. If the underlying, hidden Markov chain is strongly ergodic and…

Probability · Mathematics 2016-06-03 Thomas Kaijser

In this paper, we provide sufficient conditions for the existence of the invariant distribution and for subgeometric rates of convergence in Wasserstein distance for general state-space Markov chains which are (possibly) not irreducible.…

Probability · Mathematics 2015-07-15 Alain Durmus , Gersende Fort , Eric Moulines

Mixing of finite time-homogeneous Markov chains is well understood nowadays, with a rich set of techniques to estimate their mixing time. In this paper, we study the mixing time of random walks in dynamic random environments. To that end,…

Probability · Mathematics 2023-09-27 Raphael Erb

We show that the convergence of finite state space Markov chains to stationarity can often be considerably speeded up by alternating every step of the chain with a deterministic move. Under fairly general conditions, we show that not only…

Probability · Mathematics 2020-08-27 Sourav Chatterjee , Persi Diaconis

Convergence rate analyses of random walk Metropolis-Hastings Markov chains on general state spaces have largely focused on establishing sufficient conditions for geometric ergodicity or on analysis of mixing times. Geometric ergodicity is a…

Statistics Theory · Mathematics 2023-07-24 Riddhiman Bhattacharya , Galin L. Jones

The main subject of the study in this paper is the simultaneous renewal time for two time-inhomogeneous Markov chains which start with arbitrary initial distributions. By a simultaneous renewal we mean the first time of joint hitting the…

Probability · Mathematics 2020-01-09 Vitaliy Golomoziy

We prove that moderate deviations for empirical measures for countable nonhomogeneous Markov chains hold under the assumption of uniform convergence of transition probability matrices for countable nonhomogeneous Markov chains in Ces\`aro…

Probability · Mathematics 2020-10-16 Mingzhou Xu , Kun Cheng

We investigate multivariate regular variation in the context of time-homogeneous Markov chains on general vector spaces and in random coefficient linear models. In the first part, we show that the regular variation of the stationary…

Probability · Mathematics 2025-10-23 Piotr Dyszewski , Tamara Mika

In this paper, we are interested in investigating the perturbation bounds for the stationary distributions for discrete-time or continuous-time Markov chains on a countable state space. For discrete-time Markov chains, two new norm-wise…

Probability · Mathematics 2012-08-27 Yuanyuan Liu

A new version of a sufficient condition of a Dobrushin type is proposed for non-homogeneous Markov chains for a certain class of such processes. The original Dobrushin's condition may fail, yet, the CLT is still valid

Probability · Mathematics 2024-07-18 Alexander Veretennikov , Aisha Nurieva

A time-dependent finite-state Markov chain that uses doubly stochastic transition matrices, is considered. Entropic quantities that describe the randomness of the probability vectors, and also the randomness of the discrete paths, are…

Quantum Physics · Physics 2022-03-18 A. Vourdas

In this paper a new estimator for the transition density $\pi$ of an homogeneous Markov chain is considered. We introduce an original contrast derived from regression framework and we use a model selection method to estimate $\pi$ under…

Statistics Theory · Mathematics 2015-06-26 Claire Lacour

In the investigation of limits of Markov chains, the presence of states which become instantaneous states in the limit may prevent the convergence of the chain in the Skorohod topology. We present in this article a weaker topology adapted…

Probability · Mathematics 2014-08-29 C. Landim