Time-reversal solution of BSDEs in stochastic optimal control: a linear quadratic study
Abstract
This paper addresses the numerical solution of backward stochastic differential equations (BSDEs) arising in stochastic optimal control. Specifically, we investigate two BSDEs: one derived from the Hamilton-Jacobi-Bellman equation and the other from the stochastic maximum principle. For both formulations, we analyze and compare two numerical methods. The first utilizes the least-squares Monte-Carlo (LSMC) approach for approximating conditional expectations, while the second leverages a time-reversal (TR) of diffusion processes. Although both methods extend to nonlinear settings, our focus is on the linear-quadratic case, where analytical solutions provide a benchmark. Numerical results demonstrate the superior accuracy and efficiency of the TR approach across both BSDE representations, highlighting its potential for broader applications in stochastic control.
Keywords
Cite
@article{arxiv.2410.04615,
title = {Time-reversal solution of BSDEs in stochastic optimal control: a linear quadratic study},
author = {Yuhang Mei and Amirhossein Taghvaei},
journal= {arXiv preprint arXiv:2410.04615},
year = {2025}
}
Comments
7 pages, 4 figures, 1 table