Value and Policy Iteration in Optimal Control and Adaptive Dynamic Programming
Systems and Control
2015-10-05 v2 Data Structures and Algorithms
Numerical Analysis
Optimization and Control
Abstract
In this paper, we consider discrete-time infinite horizon problems of optimal control to a terminal set of states. These are the problems that are often taken as the starting point for adaptive dynamic programming. Under very general assumptions, we establish the uniqueness of solution of Bellman's equation, and we provide convergence results for value and policy iteration.
Keywords
Cite
@article{arxiv.1507.01026,
title = {Value and Policy Iteration in Optimal Control and Adaptive Dynamic Programming},
author = {Dimitri P. Bertsekas},
journal= {arXiv preprint arXiv:1507.01026},
year = {2015}
}