English
Related papers

Related papers: Actor-Critic Algorithm for High-dimensional Partia…

200 papers

We introduce a deep neural network based method for solving a class of elliptic partial differential equations. We approximate the solution of the PDE with a deep neural network which is trained under the guidance of a probabilistic…

Machine Learning · Computer Science 2020-08-26 Jihun Han , Mihai Nica , Adam R Stinchcombe

Factored decentralized Markov decision process (Dec-MDP) is a framework for modeling sequential decision making problems in multi-agent systems. In this paper, we formalize the learning of numerical methods for hyperbolic partial…

Machine Learning · Computer Science 2022-10-17 Yiwei Fu , Dheeraj S. K. Kapilavai , Elliot Way

We present a multidimensional deep learning implementation of a stochastic branching algorithm for the numerical solution of fully nonlinear PDEs. This approach is designed to tackle functional nonlinearities involving gradient terms of any…

Numerical Analysis · Mathematics 2023-09-12 Jiang Yu Nguwi , Guillaume Penent , Nicolas Privault

Semilinear parabolic partial differential equations (PDEs) are fundamental to modeling complex dynamical systems across scientific domains. The Deep Backward Stochastic Differential Equation (BSDE) method is a promising approach for…

Computational Engineering, Finance, and Science · Computer Science 2026-05-12 Xiaotao Zheng , Xingye Yue , Zhihong Xia , Xin Li

Efficient algorithms for solving high-dimensional partial differential equations (PDEs) has been an exceedingly difficult task for a long time, due to the curse of dimensionality. We extend the forward-backward stochastic neural networks…

Numerical Analysis · Mathematics 2024-06-21 Yangtao Deng , Qiaolin He

Deep reinforcement learning (RL) algorithms can use high-capacity deep networks to learn directly from image observations. However, these high-dimensional observation spaces present a number of challenges in practice, since the policy must…

Machine Learning · Computer Science 2020-10-27 Alex X. Lee , Anusha Nagabandi , Pieter Abbeel , Sergey Levine

The numerical solution of high dimensional partial differential equations (PDEs) is severely constrained by the curse of dimensionality (CoD), rendering classical grid--based methods impractical beyond a few dimensions. In recent years,…

Numerical Analysis · Mathematics 2026-01-27 Wenzhong Zhang , Zheyuan Hu , Wei Cai , George EM Karniadakis

In this paper we present a novel sampling-based numerical scheme designed to solve a certain class of stochastic optimal control problems, utilizing forward and backward stochastic differential equations (FBSDEs). By means of a nonlinear…

Systems and Control · Computer Science 2020-06-18 Ioannis Exarchos , Evangelos A. Theodorou

We consider the dynamic multichannel access problem, which can be formulated as a partially observable Markov decision process (POMDP). We first propose a model-free actor-critic deep reinforcement learning based framework to explore the…

Information Theory · Computer Science 2018-10-10 Chen Zhong , Ziyang Lu , M. Cenk Gursoy , Senem Velipasalar

Two novel numerical estimators are proposed for solving forward-backward stochastic differential equations (FBSDEs) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. In contrast to the…

Optimization and Control · Mathematics 2021-10-01 Kelsey P. Hawkins , Ali Pakniyat , Panagiotis Tsiotras

In this paper we introduce a numerical method for nonlinear parabolic PDEs that combines operator splitting with deep learning. It divides the PDE approximation problem into a sequence of separate learning problems. Since the computational…

Numerical Analysis · Mathematics 2021-10-12 Christian Beck , Sebastian Becker , Patrick Cheridito , Arnulf Jentzen , Ariel Neufeld

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

In this paper, a class of non-Markovian forward-backward doubly stochastic systems is studied. By using the technique of functional It\^o (or path-dependent) calculus, the relationship between the systems and related path-dependent…

Probability · Mathematics 2022-06-14 Yufeng Shi , Jiaqiang Wen , Jie Xiong

Here, we develop a deep learning algorithm for solving Principal-Agent (PA) mean field games with market-clearing conditions -- a class of problems that have thus far not been studied and one that poses difficulties for standard numerical…

Machine Learning · Computer Science 2021-10-05 Steven Campbell , Yichao Chen , Arvind Shrivats , Sebastian Jaimungal

As the dimension of a system increases, traditional methods for control and differential games rapidly become intractable, making the design of safe autonomous agents challenging in complex or team settings. Deep-learning approaches avoid…

Optimization and Control · Mathematics 2025-04-29 William Sharpless , Zeyuan Feng , Somil Bansal , Sylvia Herbert

We aim to provide a Feynman-Kac type representation for Hamilton-Jacobi-Bellman equation, in terms of forward backward stochastic differential equation (FBSDE) with a simulatable forward process. For this purpose, we introduce a class of…

Probability · Mathematics 2015-09-10 Idris Kharroubi , Huyên Pham

Using probabilistic methods, we establish a-priori estimates for two classes of quasilinear parabolic systems of partial differential equations (PDEs). We treat in particular the case of a nonlinearity which has quadratic growth in the…

Probability · Mathematics 2023-04-05 Joe Jackson

In this paper we present a scalable deep learning framework for finding Markovian Nash Equilibria in multi-agent stochastic games using fictitious play. The motivation is inspired by theoretical analysis of Forward Backward Stochastic…

Artificial Intelligence · Computer Science 2021-05-24 Tianrong Chen , Ziyi Wang , Ioannis Exarchos , Evangelos A. Theodorou

We propose a finite-dimensional control-based method to approximate solution operators for evolutional partial differential equations (PDEs), particularly in high-dimensions. By employing a general reduced-order model, such as a deep neural…

Numerical Analysis · Mathematics 2024-01-22 Nathan Gaby , Xiaojing Ye

High-dimensional partial differential equations (PDEs) pose significant challenges for numerical computation due to the curse of dimensionality, which limits the applicability of traditional mesh-based methods. Since 2017, the Deep BSDE…

Numerical Analysis · Mathematics 2025-05-26 Jiequn Han , Arnulf Jentzen , Weinan E