English

Average optimality for continuous-time Markov decision processes under weak continuity conditions

Optimization and Control 2014-03-05 v2

Abstract

This article considers the average optimality for a continuous-time Markov decision process with Borel state and action spaces and an arbitrarily unbounded nonnegative cost rate. The existence of a deterministic stationary optimal policy is proved under a different and general set of conditions as compared to the previous literature; the controlled process can be explosive, the transition rates can be arbitrarily unbounded and are weakly continuous, the multifunction defining the admissible action spaces can be neither compact-valued nor upper semi-continuous, and the cost rate is not necessarily inf-compact.

Keywords

Cite

@article{arxiv.1401.4856,
  title  = {Average optimality for continuous-time Markov decision processes under weak continuity conditions},
  author = {Yi Zhang},
  journal= {arXiv preprint arXiv:1401.4856},
  year   = {2014}
}
R2 v1 2026-06-22T02:49:45.236Z