English

Asymptotic behaviour of random Markov chains with tridiagonal generators

Dynamical Systems 2013-01-18 v2 Functional Analysis Probability

Abstract

Continuous-time discrete-state random Markov chains generated by a random linear differential equation with a random tridiagonal matrix are shown to have a random attractor consisting of singleton subsets, essentially a random path, in the simplex of probability vectors. The proof uses comparison theorems for Carath\'eodory random differential equations and the fact that the linear cocycle generated by the Markov chain is a uniformly contractive mapping of the positive cone into itself with respect to the the Hilbert projective metric. It does not involve probabilistic properties of the sample path and is thus equally valid in the nonautonomous deterministic context of Markov chains with, say, periodically varying transitions probabilities, in which case the attractor is a periodic path.

Keywords

Cite

@article{arxiv.1201.1999,
  title  = {Asymptotic behaviour of random Markov chains with tridiagonal generators},
  author = {P. E. Kloeden and V. S. Kozyakin},
  journal= {arXiv preprint arXiv:1201.1999},
  year   = {2013}
}

Comments

11 pages, 15 bibliography references, added bibliography, minor changes

R2 v1 2026-06-21T20:02:33.305Z