English
Related papers

Related papers: Value Function Estimators for Feynman-Kac Forward-…

200 papers

We propose a new method for the numerical solution of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. Using Girsanov's…

Optimization and Control · Mathematics 2022-10-20 Kelsey P. Hawkins , Ali Pakniyat , Evangelos Theodorou , Panagiotis Tsiotras

We propose a numerical method for the computation of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. By the use of the…

Optimization and Control · Mathematics 2021-03-29 Kelsey P. Hawkins , Ali Pakniyat , Evangelos Theodorou , Panagiotis Tsiotras

In this paper we present a novel sampling-based numerical scheme designed to solve a certain class of stochastic optimal control problems, utilizing forward and backward stochastic differential equations (FBSDEs). By means of a nonlinear…

Systems and Control · Computer Science 2020-06-18 Ioannis Exarchos , Evangelos A. Theodorou

The solution to a stochastic optimal control problem can be determined by computing the value function from a discretization of the associated Hamilton-Jacobi-Bellman equation. Alternatively, the problem can be reformulated in terms of a…

Optimization and Control · Mathematics 2024-02-29 Sebastian Reich

We consider a classical finite horizon optimal control problem for continuous-time pure jump Markov processes described by means of a rate transition measure depending on a control parameter and controlled by a feedback law. For this class…

Probability · Mathematics 2015-01-20 Elena Bandini , Marco Fuhrman

This paper presents a novel approach to numerically solve stochastic differential games for nonlinear systems. The proposed approach relies on the nonlinear Feynman-Kac theorem that establishes a connection between parabolic deterministic…

Optimization and Control · Mathematics 2019-06-13 Ziyi Wang , Keuntaek Lee , Marcus A. Pereira , Ioannis Exarchos , Evangelos A. Theodorou

In this introductory paper, we discuss how quantitative finance problems under some common risk factor dynamics for some common instruments and approaches can be formulated as time-continuous or time-discrete forward-backward stochastic…

Computational Finance · Quantitative Finance 2019-11-29 Bernhard Hientzsch

We propose a new method for the numerical solution of backward stochastic differential equations (BSDEs) which finds its roots in Fourier analysis. The method consists of an Euler time discretization of the BSDE with certain conditional…

Probability · Mathematics 2015-06-25 Cody Blaine Hyndman , Polynice Oyono Ngou

This paper is concerned with an optimal control problem for a forward-backward stochastic differential equation (FBSDE, for short) with a recursive cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for…

Optimization and Control · Mathematics 2022-09-20 Hanxiao Wang , Jiongmin Yong , Chao Zhou

In this paper, we study a kind of optimal control problem for forward-backward stochastic differential equations (FBSDEs for short) of McKean--Vlasov type via the dynamic programming principle (DPP for short) motivated by studying the…

Optimization and Control · Mathematics 2024-07-09 Liangquan Zhang

We study linear-quadratic stochastic optimal control problems with bilinear state dependence for which the underlying stochastic differential equation (SDE) consists of slow and fast degrees of freedom. We show that, in the same way in…

Dynamical Systems · Mathematics 2018-03-21 Omar Kebiri , Lara Neureither , Carsten Hartmann

In this paper, we present a scalable deep learning approach to solve opinion dynamics stochastic optimal control problems with mean field term coupling in the dynamics and cost function. Our approach relies on the probabilistic…

Multiagent Systems · Computer Science 2022-04-19 Tianrong Chen , Ziyi Wang , Evangelos A. Theodorou

We present a deep recurrent neural network architecture to solve a class of stochastic optimal control problems described by fully nonlinear Hamilton Jacobi Bellmanpartial differential equations. Such PDEs arise when one considers…

Machine Learning · Computer Science 2019-12-24 Marcus A Pereira , Ziyi Wang , Tianrong Chen , Emily Reed , Evangelos A Theodorou

We study a class of backward stochastic differential equations (BSDEs) driven by a random measure or, equivalently, by a marked point process. Under appropriate assumptions we prove well-posedness and continuous dependence of the solution…

Probability · Mathematics 2012-05-24 Fulvia Confortola , Marco Fuhrman

We consider an infinite horizon discounted optimal control problem for piecewise deterministic Markov processes, where a piecewise open-loop control acts continuously on the jump dynamics and on the deterministic flow. For this class of…

Optimization and Control · Mathematics 2015-12-08 Elena Bandini

In this paper, we propose a new policy iteration algorithm to compute the value function and the optimal controls of continuous time stochastic control problems. The algorithm relies on successive approximations using linear-quadratic…

Optimization and Control · Mathematics 2024-09-09 Dylan Possamaï , Ludovic Tangpi

Supervised machine learning is powerful. In recent years, it has enabled massive breakthroughs in computer vision and natural language processing. But leveraging these advances for optimal control has proved difficult. Data is a key…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Vince Kurtz , Joel W. Burdick

This paper is concerned with a stochastic recursive optimal control problem with time delay, where the controlled system is described by a stochastic differential delayed equation (SDDE) and the cost functional is formulated as the solution…

Optimization and Control · Mathematics 2014-08-26 Jingtao Shi , Huanshui Zhang

In this paper, we present a novel Feynman-Kac formula and investigate learning-based methods for approximating general nonlinear time-dependent Schr\"odinger equations which may be high-dimensional. Our formulation integrates both the…

Analysis of PDEs · Mathematics 2025-06-23 Hang Cheung , Jinniao Qiu , Yang Yang

This paper addresses the numerical solution of backward stochastic differential equations (BSDEs) arising in stochastic optimal control. Specifically, we investigate two BSDEs: one derived from the Hamilton-Jacobi-Bellman equation and the…

Optimization and Control · Mathematics 2025-03-12 Yuhang Mei , Amirhossein Taghvaei
‹ Prev 1 2 3 10 Next ›