English

Time-inconsistent Risk-sensitive Equilibrium for Countable-stated Markov Decision Processes

Optimization and Control 2020-10-22 v2 Probability

Abstract

This paper is devoted to solving a time-inconsistent risk-sensitive control problem with parameter \e\e and its limit case (\e0+\e\rightarrow0^+) for countable-stated Markov decision processes (MDPs for short). Since the cost functional is time-inconsistent, it is impossible to find a global optimal strategy for both cases. Instead, for each case, we will prove the existence of time-inconstant equilibrium strategies which verify the so-called step-optimality. Moreover, we prove the convergence of \e\e-equilibriums and the corresponding value functions as \e0+\e\rightarrow0^+.

Keywords

Cite

@article{arxiv.1909.06863,
  title  = {Time-inconsistent Risk-sensitive Equilibrium for Countable-stated Markov Decision Processes},
  author = {Hongwei Mei},
  journal= {arXiv preprint arXiv:1909.06863},
  year   = {2020}
}
R2 v1 2026-06-23T11:15:50.605Z