Dynamic Programming for General Linear Quadratic Optimal Stochastic Control with Random Coefficients
Abstract
We are concerned with the linear-quadratic optimal stochastic control problem with random coefficients. Under suitable conditions, we prove that the value field , is quadratic in , and has the following form: where is an essentially bounded nonnegative symmetric matrix-valued adapted processes. Using the dynamic programming principle (DPP), we prove that is a continuous semi-martingale of the form with being a continuous process of bounded variation and and that with is a solution to the associated backward stochastic Riccati equation (BSRE), whose generator is highly nonlinear in the unknown pair of processes. The uniqueness is also proved via a localized completion of squares in a self-contained manner for a general BSRE. The existence and uniqueness of adapted solution to a general BSRE was initially proposed by the French mathematician J. M. Bismut (1976, 1978). It had been solved by the author (2003) via the stochastic maximum principle with a viewpoint of stochastic flow for the associated stochastic Hamiltonian system. The present paper is its companion, and gives the {\it second but more comprehensive} adapted solution to a general BSRE via the DDP. Further extensions to the jump-diffusion control system and to the general nonlinear control system are possible.
Cite
@article{arxiv.1407.5031,
title = {Dynamic Programming for General Linear Quadratic Optimal Stochastic Control with Random Coefficients},
author = {Shanjian Tang},
journal= {arXiv preprint arXiv:1407.5031},
year = {2014}
}
Comments
16 pages