Policy iteration for the deterministic control problems -- a viscosity approach
Optimization and Control
2025-04-11 v2 Numerical Analysis
Analysis of PDEs
Numerical Analysis
Abstract
This paper is concerned with the convergence rate of policy iteration for (deterministic) optimal control problems in continuous time. To overcome the problem of ill-posedness due to lack of regularity, we consider a semi-discrete scheme by adding a viscosity term via finite differences in space. We prove that PI for the semi-discrete scheme converges exponentially fast, and provide a bound on the error induced by the semi-discrete scheme. We also consider the discrete space-time scheme, where both space and time are discretized. Convergence rate of PI and the discretization error are studied.
Cite
@article{arxiv.2301.00419,
title = {Policy iteration for the deterministic control problems -- a viscosity approach},
author = {Wenpin Tang and Hung Vinh Tran and Yuming Paul Zhang},
journal= {arXiv preprint arXiv:2301.00419},
year = {2025}
}
Comments
27 pages. Theorems 3.4 and 4.3, and their proofs have been updated to https://epubs.siam.org/doi/full/10.1137/24M1631602