Zero-Sum Games for Continuous-time Markov Decision Processes with Risk-Sensitive Average Cost Criterion
Optimization and Control
2021-09-21 v1
Abstract
We consider zero-sum stochastic games for continuous time Markov decision processes with risk-sensitive average cost criterion. Here the transition and cost rates may be unbounded. We prove the existence of the value of the game and a saddle-point equilibrium in the class of all stationary strategies under a Lyapunov stability condition. This is accomplished by establishing the existence of a principal eigenpair for the corresponding Hamilton-Jacobi-Isaacs (HJI) equation. This in turn is established by using the nonlinear version of Krein-Rutman theorem. We then obtain a characterization of the saddle-point equilibrium in terms of the corresponding HJI equation. Finally, we use a controlled population system to illustrate results.
Keywords
Cite
@article{arxiv.2109.08837,
title = {Zero-Sum Games for Continuous-time Markov Decision Processes with Risk-Sensitive Average Cost Criterion},
author = {Mrinal K. Ghosh and Subrata Golui and Chandan Pal and Somnath Pradhan},
journal= {arXiv preprint arXiv:2109.08837},
year = {2021}
}
Comments
28 pages