Stability of a Markov-modulated Markov Chain, with application to a wireless network governed by two protocols
Abstract
We consider a discrete-time Markov chain , , where the -component forms a Markov chain itself. Assume that is Harris-ergodic and consider an auxiliary Markov chain whose transition probabilities are the averages of transition probabilities of the -component of the -chain, where the averaging is weighted by the stationary distribution of the -component. We first provide natural conditions in terms of test functions ensuring that the -chain is positive recurrent and then prove that these conditions are also sufficient for positive recurrence of the original chain . The we prove a "multi-dimensional" extension of the result obtained. In the second part of the paper, we apply our results to two versions of a multi-access wireless model governed by two randomised protocols.
Keywords
Cite
@article{arxiv.1105.0270,
title = {Stability of a Markov-modulated Markov Chain, with application to a wireless network governed by two protocols},
author = {Sergey Foss and Seva Shneer and Andrey Tyurlikov},
journal= {arXiv preprint arXiv:1105.0270},
year = {2013}
}
Comments
23 pages