Time-inconsistent Risk-sensitive Equilibrium for Countable-stated Markov Decision Processes
Optimization and Control
2020-10-22 v2 Probability
Abstract
This paper is devoted to solving a time-inconsistent risk-sensitive control problem with parameter and its limit case () for countable-stated Markov decision processes (MDPs for short). Since the cost functional is time-inconsistent, it is impossible to find a global optimal strategy for both cases. Instead, for each case, we will prove the existence of time-inconstant equilibrium strategies which verify the so-called step-optimality. Moreover, we prove the convergence of -equilibriums and the corresponding value functions as .
Cite
@article{arxiv.1909.06863,
title = {Time-inconsistent Risk-sensitive Equilibrium for Countable-stated Markov Decision Processes},
author = {Hongwei Mei},
journal= {arXiv preprint arXiv:1909.06863},
year = {2020}
}