English
Related papers

Related papers: Particle-based algorithm for stochastic optimal co…

200 papers

This paper is concerned with an optimal control problem for a forward-backward stochastic differential equation (FBSDE, for short) with a recursive cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for…

Optimization and Control · Mathematics 2022-09-20 Hanxiao Wang , Jiongmin Yong , Chao Zhou

In this paper we study stochastic optimal control problems of fully coupled forward-backward stochastic differential equations (FBSDEs). The recursive cost functionals are defined by controlled fully coupled FBSDEs. We study two cases of…

Optimization and Control · Mathematics 2013-02-06 Juan Li , Qingmeng Wei

We establish a connection between stochastic optimal control and generative models based on stochastic differential equations (SDEs), such as recently developed diffusion probabilistic models. In particular, we derive a…

Machine Learning · Computer Science 2024-03-27 Julius Berner , Lorenz Richter , Karen Ullrich

We propose a new method for the numerical solution of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. Using Girsanov's…

Optimization and Control · Mathematics 2022-10-20 Kelsey P. Hawkins , Ali Pakniyat , Evangelos Theodorou , Panagiotis Tsiotras

In this paper, we study one kind of stochastic recursive optimal control problem with the obstacle constraints for the cost function where the cost function is described by the solution of one reflected backward stochastic differential…

Optimization and Control · Mathematics 2007-05-23 Zhen Wu , Zhiyong Yu

With the growing global emphasis on sustainability and the implementation of contemporary environmental policies, photovoltaic (PV) generation is playing an increasingly important role in modern power systems, while its intrinsic…

Optimization and Control · Mathematics 2026-04-14 Alfredo Bermúdez , Iago Padín

An optimal control problem is considered for a stochastic differential equation with the cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). This kind of cost functional can cover the general…

Optimization and Control · Mathematics 2019-11-13 Hanxiao Wang , Jiongmin Yong

In this paper, we aim to solve the high dimensional stochastic optimal control problem from the view of the stochastic maximum principle via deep learning. By introducing the extended Hamiltonian system which is essentially an FBSDE with a…

Optimization and Control · Mathematics 2021-06-23 Shaolin Ji , Shige Peng , Ying Peng , Xichuan Zhang

This work is devoted to the study of optimal control of stochastic functional differential equations (SFDEs) and its application to mathematical finance. By using the Dynkin formula and solution of the Dirichlet-Poisson problem, the…

Optimization and Control · Mathematics 2014-04-04 Edson A. Coayla-Teran , Anatoly Swishchuk

Optimal control problem is typically solved by first finding the value function through Hamilton-Jacobi equation (HJE) and then taking the minimizer of the Hamiltonian to obtain the control. In this work, instead of focusing on the value…

Optimization and Control · Mathematics 2021-09-10 Alain Bensoussan , Jiayue Han , Sheung Chi Phillip Yam , Xiang Zhou

In this paper we make a survey on the so called randomization method, a recent methodology to study stochastic optimization problems. It allows to represent the value function of an optimal control problem by a suitable backward stochastic…

Optimization and Control · Mathematics 2025-06-12 Marco Fuhrman

Stochastic optimal control problems with constraints on the probability distribution of the final output are considered. Necessary conditions for optimality in the form of a coupled system of partial differential equations involving a…

Optimization and Control · Mathematics 2022-03-10 Samuel Daudin

We consider a pathwise stochastic optimal control problem and study the associated (not necessarily adapted) Hamilton-Jacobi-Bellman stochastic partial differential equation. We show that the value process is the unique solution of this…

Probability · Mathematics 2023-11-02 Neeraj Bhauryal , Ana Bela Cruzeiro , Carlos Oliveira

We consider the problem of stochastic optimal control, where the state-feedback control policies take the form of a probability distribution and where a penalty on the entropy is added. By viewing the cost function as a Kullback- Leibler…

Optimization and Control · Mathematics 2024-12-12 Marc Lambert , Francis Bach , Silvère Bonnabel

In this paper, we propose a new policy iteration algorithm to compute the value function and the optimal controls of continuous time stochastic control problems. The algorithm relies on successive approximations using linear-quadratic…

Optimization and Control · Mathematics 2024-09-09 Dylan Possamaï , Ludovic Tangpi

We tackle a nonlinear optimal control problem for a stochastic differential equation in Euclidean space and its state-linear counterpart for the Fokker-Planck-Kolmogorov equation in the space of probabilities. Our approach is founded on a…

Optimization and Control · Mathematics 2024-09-23 Roman Chertovskih , Nikolay Pogodaev , Maxim Staritsyn , A. Pedro Aguiar

This paper considers optimal control of dynamical systems which are represented by nonlinear stochastic differential equations. It is well-known that the optimal control policy for this problem can be obtained as a function of a value…

Robotics · Computer Science 2014-05-30 Oktay Arslan , Evangelos Theodorou , Panagiotis Tsiotras

This paper proposes two algorithms for solving stochastic control problems with deep learning, with a focus on the utility maximisation problem. The first algorithm solves Markovian problems via the Hamilton Jacobi Bellman (HJB) equation.…

Computational Finance · Quantitative Finance 2024-10-15 Ashley Davey , Harry Zheng

We study a stochastic control problem on a bounded domain, which arises from a continuous-time optimal management model. Via the corresponding Hamilton-Jacobi-Bellman equation the value function is shown to be jointly continuous and to…

Probability · Mathematics 2017-10-24 Ruoting Gong , Christian Houdré

We study the stochastic control-stopping problem when the data are of polynomial growth. The approach is based on backward stochastic dierential equations (BSDEs for short). The problem turns into the study of a specic reected BSDE with a…

Optimization and Control · Mathematics 2020-05-15 Brahim Asri , Said Hamadène , Khalid Oufdil