English

Exponential Convergence Rates for Stochastically Ordered Markov Processes with Random Initial Conditions

Probability 2018-10-19 v1

Abstract

In this brief paper we find computable exponential convergence rates for a large class of stochastically ordered Markov processes. We extend the result of Lund, Meyn, and Tweedie (1996), who found exponential convergence rates for stochastically ordered Markov processes starting from a fixed initial state, by allowing for a random initial condition that is also stochastically ordered. Our bounds are formulated in terms of moment-generating functions of hitting times. To illustrate our result, we find an explicit exponential convergence rate for an M/M/1 queue beginning in equilibrium and then experiencing a change in its arrival or departure rates, a setting which has not been studied to our knowledge.

Keywords

Cite

@article{arxiv.1810.07732,
  title  = {Exponential Convergence Rates for Stochastically Ordered Markov Processes with Random Initial Conditions},
  author = {Julia Gaudio and Saurabh Amin and Patrick Jaillet},
  journal= {arXiv preprint arXiv:1810.07732},
  year   = {2018}
}

Comments

13 pages

R2 v1 2026-06-23T04:43:41.980Z