English

Specific bounds for a probabilistically interpretable solution of the Poisson equation for general state-space Markov chains with queueing applications

Probability 2019-09-18 v1

Abstract

This paper considers the Poisson equation for general state-space Markov chains in continuous time. The main purpose of this paper is to present specific bounds for the solutions of the Poisson equation for general state-space Markov chains. The solutions of the Poisson equation are unique in the sense that they are expressed in terms of a certain probabilistically interpretable solution (called the {\it standard solution}). Thus, we establish some specific bounds for the standard solution under the ff-modulated drift condition (which is a kind of Foster-Lyapunov-type condition) and some moderate conditions. To demonstrate the applicability of our results, we consider the workload processes in two queues: MAP/GI/1 queue, and M/GI/1 queue with workload capacity limit.

Keywords

Cite

@article{arxiv.1909.07567,
  title  = {Specific bounds for a probabilistically interpretable solution of the Poisson equation for general state-space Markov chains with queueing applications},
  author = {Hiroyuki Masuyama},
  journal= {arXiv preprint arXiv:1909.07567},
  year   = {2019}
}

Comments

Submitted to Applied Probability Trust, June 2018

R2 v1 2026-06-23T11:17:27.172Z