English

Stability of a Markov-modulated Markov Chain, with application to a wireless network governed by two protocols

Probability 2013-02-13 v2

Abstract

We consider a discrete-time Markov chain (Xt,Yt)(X^t,Y^t), t=0,1,2,...t=0,1,2,..., where the XX-component forms a Markov chain itself. Assume that (Xt)(X^t) is Harris-ergodic and consider an auxiliary Markov chain Y^t{\hat{Y}^t} whose transition probabilities are the averages of transition probabilities of the YY-component of the (X,Y)(X,Y)-chain, where the averaging is weighted by the stationary distribution of the XX-component. We first provide natural conditions in terms of test functions ensuring that the Y^\hat{Y}-chain is positive recurrent and then prove that these conditions are also sufficient for positive recurrence of the original chain (Xt,Yt)(X^t,Y^t). The we prove a "multi-dimensional" extension of the result obtained. In the second part of the paper, we apply our results to two versions of a multi-access wireless model governed by two randomised protocols.

Keywords

Cite

@article{arxiv.1105.0270,
  title  = {Stability of a Markov-modulated Markov Chain, with application to a wireless network governed by two protocols},
  author = {Sergey Foss and Seva Shneer and Andrey Tyurlikov},
  journal= {arXiv preprint arXiv:1105.0270},
  year   = {2013}
}

Comments

23 pages