English
Related papers

Related papers: Learning High-Dimensional McKean-Vlasov Forward-Ba…

200 papers

This work develops a particle system addressing the approximation of McKean-Vlasov stochastic differential equations (SDEs). The novelty of the approach lies in involving low discrepancy sequences nontrivially in the construction of a…

Numerical Analysis · Mathematics 2024-09-17 Nadhir Ben Rached , Abdul-Lateef Haji-Ali , Raúl Tempone , Leon Wilkosz

We present a deep recurrent neural network architecture to solve a class of stochastic optimal control problems described by fully nonlinear Hamilton Jacobi Bellmanpartial differential equations. Such PDEs arise when one considers…

Machine Learning · Computer Science 2019-12-24 Marcus A Pereira , Ziyi Wang , Tianrong Chen , Emily Reed , Evangelos A Theodorou

We propose a numerical method for the computation of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. By the use of the…

Optimization and Control · Mathematics 2021-03-29 Kelsey P. Hawkins , Ali Pakniyat , Evangelos Theodorou , Panagiotis Tsiotras

Two novel numerical estimators are proposed for solving forward-backward stochastic differential equations (FBSDEs) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. In contrast to the…

Optimization and Control · Mathematics 2021-10-01 Kelsey P. Hawkins , Ali Pakniyat , Panagiotis Tsiotras

In this paper, we aim to solve the high dimensional stochastic optimal control problem from the view of the stochastic maximum principle via deep learning. By introducing the extended Hamiltonian system which is essentially an FBSDE with a…

Optimization and Control · Mathematics 2021-06-23 Shaolin Ji , Shige Peng , Ying Peng , Xichuan Zhang

We study the weak convergence behaviour of the Leimkuhler--Matthews method, a non-Markovian Euler-type scheme with the same computational cost as the Euler scheme, for the approximation of the stationary distribution of a one-dimensional…

Numerical Analysis · Mathematics 2025-01-14 Xingyuan Chen , Goncalo dos Reis , Wolfgang Stockinger , Zac Wilde

We study a class of McKean-Vlasov type stochastic differential equations (SDEs) which arise from the random vortex dynamics and other physics models. By introducing a new approach we resolve the existence and uniqueness of both the weak and…

Probability · Mathematics 2021-04-13 Zhongmin Qian , Yuhan Yao

The optimal stopping problem is one of the core problems in financial markets, with broad applications such as pricing American and Bermudan options. The deep BSDE method [Han, Jentzen and E, PNAS, 115(34):8505-8510, 2018] has shown great…

Probability · Mathematics 2023-08-28 Chengfan Gao , Siping Gao , Ruimeng Hu , Zimu Zhu

We introduce a class of backward stochastic differential equations (BSDEs) on the Wasserstein space of probability measures. This formulation extends the classical correspondence between BSDEs, stochastic control, and partial differential…

Probability · Mathematics 2025-07-01 Mao Fabrice Djete

Fine-scale simulation of complex systems governed by multiscale partial differential equations (PDEs) is computationally expensive and various multiscale methods have been developed for addressing such problems. In addition, it is…

Computational Physics · Physics 2021-06-24 Govinda Anantha Padmanabha , Nicholas Zabaras

We consider the simulation of Bayesian statistical inverse problems governed by large-scale linear and nonlinear partial differential equations (PDEs). Markov chain Monte Carlo (MCMC) algorithms are standard techniques to solve such…

Numerical Analysis · Mathematics 2021-02-09 Harbir Antil , Howard C Elman , Akwum Onwunta , Deepanshu Verma

In this work, we propose a new deep learning-based scheme for solving high dimensional nonlinear backward stochastic differential equations (BSDEs). The idea is to reformulate the problem as a global optimization, where the local loss…

Numerical Analysis · Mathematics 2024-04-18 Lorenc Kapllani , Long Teng

In this paper, we propose a deep forward-backward stochastic differential equation (FBSDE) based control algorithm for locomotion tasks. We also include state constraints in the FBSDE formulation to impose stable walking solutions or other…

Robotics · Computer Science 2021-07-19 Bolun Dai , Virinchi Roy Surabhi , Prashanth Krishnamurthy , Farshad Khorrami

We introduce multilevel Picard (MLP) approximations for McKean--Vlasov stochastic differential equations (SDEs) with nonconstant diffusion coefficient. Under standard Lipschitz assumptions on the coefficients, we show that the MLP algorithm…

Numerical Analysis · Mathematics 2025-11-25 Ariel Neufeld , Tuan Anh Nguyen , Philipp Schmocker

A dynamic mean field theory is developed for finite state and action Bayesian reinforcement learning in the large state space limit. In an analogy with statistical physics, the Bellman equation is studied as a disordered dynamical system;…

Machine Learning · Statistics 2023-07-13 George Stamatescu

The aim of this work is to propose an extension of the deep solver by Han, Jentzen, E (2018) to the case of forward backward stochastic differential equations (FBSDEs) with jumps. As in the aforementioned solver, starting from a discretized…

Probability · Mathematics 2025-05-23 Kristoffer Andersson , Alessandro Gnoatto , Marco Patacca , Athena Picarelli

In this paper, we analyze the mean field backward stochastic differential equations (MFBSDEs) with double mean reflections, whose generator and constraints both depend on the distribution of the solution. When the generator is Lipschitz…

Probability · Mathematics 2026-01-12 Hanwu Li , Jin Shi

In this work, we propose a novel backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs), where the deep neural network (DNN) models are trained not only…

Numerical Analysis · Mathematics 2024-04-15 Lorenc Kapllani , Long Teng

In ultra-dense unmanned aerial vehicle (UAV) networks, it is challenging to coordinate the resource allocation and interference management among large-scale UAVs, for providing flexible and efficient service coverage to the ground users…

Systems and Control · Electrical Eng. & Systems 2024-11-22 Fei Song , Zhe Wang , Jun Li , Long Shi , Wen Chen , Shi Jin

This paper presents a novel approach to numerically solve stochastic differential games for nonlinear systems. The proposed approach relies on the nonlinear Feynman-Kac theorem that establishes a connection between parabolic deterministic…

Optimization and Control · Mathematics 2019-06-13 Ziyi Wang , Keuntaek Lee , Marcus A. Pereira , Ioannis Exarchos , Evangelos A. Theodorou