中文
相关论文

相关论文: Actor-Critic Algorithm for High-dimensional Partia…

200 篇论文

We study an optimal control problem on infinite horizon for a controlled stochastic differential equation driven by Brownian motion, with a discounted reward functional. The equation may have memory or delay effects in the coefficients,…

最优化与控制 · 数学 2017-10-19 F. Confortola , A. Cosso , M. Fuhrman

We provide a representation formula for viscosity solutions to a class of nonlinear second order parabolic PDE problem involving sublinear operators. This is done through a dynamic programming principle derived from [8]. The formula can be…

偏微分方程分析 · 数学 2020-05-14 Marco Pozza

The classical Feynman-Kac identity builds a bridge between stochastic analysis and partial differential equations (PDEs) by providing stochastic representations for classical solutions of linear Kolmogorov PDEs. This opens the door for the…

概率论 · 数学 2021-10-25 Christian Beck , Martin Hutzenthaler , Arnulf Jentzen

In this paper,we mainly focus on the numerical solution of high-dimensional stochastic optimal control problem driven by fully-coupled forward-backward stochastic differential equations (FBSDEs in short) through deep learning. We first…

最优化与控制 · 数学 2024-08-21 Shaolin Ji , Shige Peng , Ying Peng , Xichuan Zhang

We propose an algorithm based on variational quantum imaginary time evolution for solving the Feynman-Kac partial differential equation resulting from a multidimensional system of stochastic differential equations. We utilize the…

We propose a nonlinear forward Feynman-Kac type equation, which represents the solution of a non-conservative semilinear parabolic Partial Differential Equations (PDE). We show in particular existence and uniqueness. The solution of that…

概率论 · 数学 2018-10-05 Anthony Lecavil , Anthony Le Cavil , Nadia Oudjane , Francesco Russo

This paper proposes an actor-critic algorithm for controlling the temperature of a battery pack using a cooling fluid. This is modeled by a coupled 1D partial differential equation (PDE) with a controlled advection term that determines the…

机器学习 · 计算机科学 2023-05-19 Amartya Mukherjee , Jun Liu

This paper build on our recent work where we presented a dual stochastic optimal control formulation of the nonlinear filtering problem [1]. The constraint for the dual problem is a backward stochastic differential equations (BSDE). The…

最优化与控制 · 数学 2021-11-02 Jin Won Kim , Prashant G. Mehta

In recent years a large literature on deep learning based methods for the numerical solution partial differential equations has emerged; results for integro-differential equations on the other hand are scarce. In this paper we study deep…

数值分析 · 数学 2021-09-27 Rüdiger Frey , Verena Köck

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for…

机器学习 · 计算机科学 2019-10-17 Mohammad Amin Nabian , Hadi Meidani

Actor-critic (AC) methods are widely used in reinforcement learning (RL) and benefit from the flexibility of using any policy gradient method as the actor and value-based method as the critic. The critic is usually trained by minimizing the…

机器学习 · 计算机科学 2023-11-01 Sharan Vaswani , Amirreza Kazemi , Reza Babanezhad , Nicolas Le Roux

We propose machine learning methods for solving fully nonlinear partial differential equations (PDEs) with convex Hamiltonian. Our algorithms are conducted in two steps. First the PDE is rewritten in its dual stochastic control…

计算金融 · 定量金融 2022-05-23 William Lefebvre , Grégoire Loeper , Huyên Pham

In [5] the authors obtained Mean-Field backward stochastic differential equations (BSDE) associated with a Mean-field stochastic differential equation (SDE) in a natural way as limit of some highly dimensional system of forward and backward…

概率论 · 数学 2007-11-21 Rainer Buckdahn , Juan Li , Shige Peng

We propose a probabilistic numerical algorithm to solve Backward Stochastic Differential Equations (BSDEs) with nonnegative jumps, a class of BSDEs introduced in [9] for representing fully nonlinear HJB equations. In particular, this allows…

概率论 · 数学 2019-07-11 Idris Kharroubi , Nicolas Langrené , Huyên Pham

In this paper, we consider a reflected backward stochastic differential equation driven by a $G$-Brownian motion ($G$-BSDE), with the generator growing quadratically in the second unknown. We obtain the existence by the penalty method, and…

概率论 · 数学 2019-06-19 Dong Cao , Shanjian Tang

This paper considers the problem of uniqueness of the solutions to a class of Markovian backward stochastic differential equations (BSDEs) which are also connected to certain nonlinear partial differential equation (PDE) through a…

概率论 · 数学 2012-11-06 Coskun Cetin

Supervised machine learning is powerful. In recent years, it has enabled massive breakthroughs in computer vision and natural language processing. But leveraging these advances for optimal control has proved difficult. Data is a key…

系统与控制 · 电气工程与系统科学 2024-09-10 Vince Kurtz , Joel W. Burdick

While recent advances in deep learning have shown promising efficiency gains in solving time-dependent partial differential equations (PDEs), matching the accuracy of conventional numerical solvers still remains a challenge. One strategy to…

数值分析 · 数学 2025-11-26 Yuwei Geng , Junqi Yin , Eric C. Cyr , Guannan Zhang , Lili Ju

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

We consider the simulation of Bayesian statistical inverse problems governed by large-scale linear and nonlinear partial differential equations (PDEs). Markov chain Monte Carlo (MCMC) algorithms are standard techniques to solve such…

数值分析 · 数学 2021-02-09 Harbir Antil , Howard C Elman , Akwum Onwunta , Deepanshu Verma