English

Feedback control: two-sided Markov-modulated Brownian motion with instantaneous change of phase at boundaries

Probability 2016-03-08 v1

Abstract

We consider a Markov-modulated Brownian motion {Y(t),ρ(t)}\{Y(t), \rho(t)\} with two boundaries at 00 and b>0b > 0, and allow for the controlling Markov chain {ρ(t)}\{\rho(t)\} to instantaneously undergo a change of phase upon hitting either of the two boundaries at semi-regenerative epochs defined to be the first time the process reaches a boundary since it last hits the other boundary. We call this process a flexible Markov-modulated Brownian motion. Using the recently-established links between stochastic fluid models and Markov-modulated Brownian motions, we determine important characteristics of first exit times of a Markov-modulated Brownian motion from an interval with a regulated boundary. These results allow us to follow a Markov-regenerative approach and obtain the stationary distribution of the flexible process. This highlights the effectiveness of the regenerative approach in analyzing Markov-modulated Brownian motions subject to more general boundary behaviors than the classic regulated boundaries.

Keywords

Cite

@article{arxiv.1603.01945,
  title  = {Feedback control: two-sided Markov-modulated Brownian motion with instantaneous change of phase at boundaries},
  author = {Guy Latouche and Giang T. Nguyen},
  journal= {arXiv preprint arXiv:1603.01945},
  year   = {2016}
}

Comments

34 pages