Related papers: Learning Optimal Control via Forward and Backward …
We address a general optimal switching problem over finite horizon for a stochastic system described by a differential equation driven by Brownian motion. The main novelty is the fact that we allow for infinitely many modes (or regimes,…
In this paper, we consider the fully coupled forward-backward stochastic functional differential equations (FBSFDEs) with stochastic functional differential equations as the forward equations and the generalized anticipated backward…
We study optimal stochastic control problem for non-Markovian stochastic differential equations (SDEs) where the drift, diffusion coefficients, and gain functionals are path-dependent, and importantly we do not make any ellipticity…
We consider an optimal control problem for piecewise deterministic Markov processes (PDMPs) on a bounded state space. The control problem under study is very general: a pair of controls acts continuously on the deterministic flow and on the…
In the present work we employ, for the first time, backward stochastic differential equations (BSDEs) to study the optimal control of semi-Markov processes on finite horizon, with general state and action spaces. More precisely, we prove…
This paper investigates the near optimal control for a kind of linear stochastic control systems governed by the forward backward stochastic differential equations, where both the drift and diffusion terms are allowed to depend on controls…
The purpose of this paper is to provide a detailed probabilistic analysis of the optimal control of nonlinear stochastic dynamical systems of the McKean Vlasov type. Motivated by the recent interest in mean field games, we highlight the…
Optimal control problems of forward-backward stochastic Volterra integral equations (FBSVIEs, in short) with closed control regions are formulated and studied. Instead of using spike variation method as one may imagine, here we turn to…
We establish a connection between stochastic optimal control and generative models based on stochastic differential equations (SDEs), such as recently developed diffusion probabilistic models. In particular, we derive a…
Optimal control theory aims to find an optimal protocol to steer a system between assigned boundary conditions while minimizing a given cost functional in finite time. Equations arising from these types of problems are often non-linear and…
In this paper, our primary focus lies in the thorough investigation of a specific category of nonlinear fully coupled forward-backward stochastic differential equations involving time delays and advancements with the incorporation of…
This paper considers a non-Markov control problem arising in a financial market where asset returns depend on hidden factors. The problem is non-Markov because nonlinear filtering is required to make inference on these factors, and hence…
In this paper, we consider a class of stochastic control problems for stochastic differential equations with random coefficients. The control domain need not to be convex but the control process is not allowed to enter in diffusion term.…
This paper is concerned with optimal control of stochastic fully coupled forward-backward linear quadratic (FBLQ) problems with indefinite control weight costs. In order to obtain the state feedback representation of the optimal control, we…
This paper is concerned with linear quadratic optimal control problems for mean-field backward stochastic differential equations (MF-BSDEs, for short) with deterministic coefficients. The optimality system, which is a linear mean-field…
The path-integral control, which stems from the stochastic Hamilton-Jacobi-Bellman equation, is one of the methods to control stochastic nonlinear systems. This paper gives a new insight into nonlinear stochastic optimal control problems…
This is one of our series papers on multistep schemes for solving forward backward stochastic differential equations (FBSDEs) and related problems. Here we extend (with non-trivial updates) our multistep schemes in [W. Zhao, Y. Fu and T.…
In this paper we introduce a new kind of Backward Stochastic Differential Equations, called ergodic BSDEs, which arise naturally in the study of optimal ergodic control. We study the existence, uniqueness and regularity of solution to…
This paper presents an inverse optimality method to solve the Hamilton-Jacobi-Bellman equation for a class of nonlinear problems for which the cost is quadratic and the dynamics are affine in the input. The method is inverse optimal because…
In this paper, we introduce a model-based deep-learning approach to solve finite-horizon continuous-time stochastic control problems with jumps. We iteratively train two neural networks: one to represent the optimal policy and the other to…