English

Maximum principle for discrete-time stochastic optimal control problem under distribution uncertainty

Optimization and Control 2022-06-28 v1

Abstract

In this paper, we study a discrete-time stochastic optimal control problem under distribution uncertainty with convex control domain. By weak convergence method and Sion's minimax theorem, we obtain the variational inequality for cost functional under a reference probability PP^{\ast}. Moreover, under the square integrability condition for noise and control, we establish the discrete-time stochastic maximum principle under PP^{\ast}. Finally, we introduce a backward algorithm to calculate the reference probability PP^{\ast} and the optimal control uu^{\ast}.

Keywords

Cite

@article{arxiv.2206.12846,
  title  = {Maximum principle for discrete-time stochastic optimal control problem under distribution uncertainty},
  author = {Mingshang Hu and Shaolin Ji and Xiaojuan Li},
  journal= {arXiv preprint arXiv:2206.12846},
  year   = {2022}
}

Comments

20 pages

R2 v1 2026-06-24T12:04:18.648Z