中文
相关论文

相关论文: Actor-Critic Algorithm for High-dimensional Partia…

200 篇论文

In this paper, we introduce a type of path-dependent quasilinear (parabolic) partial differential equations in which the (continuous) paths on an interval [0,t] becomes the basic variables in the place of classical variables (t,x). This new…

概率论 · 数学 2011-08-23 Shige Peng , Falei Wang

Reinforcement learning, mathematically described by Markov Decision Problems, may be approached either through dynamic programming or policy search. Actor-critic algorithms combine the merits of both approaches by alternating between steps…

机器学习 · 计算机科学 2023-01-31 Harshat Kumar , Alec Koppel , Alejandro Ribeiro

Relying on the classical connection between Backward Stochastic Differential Equations (BSDEs) and non-linear parabolic partial differential equations (PDEs), we propose a new probabilistic learning scheme for solving high-dimensional…

数值分析 · 数学 2021-02-25 Jean-François Chassagneux , Junchao Chen , Noufel Frikha , Chao Zhou

Current model-based reinforcement learning approaches use the model simply as a learned black-box simulator to augment the data for policy optimization or value function learning. In this paper, we show how to make more effective use of the…

机器学习 · 计算机科学 2020-05-19 Ignasi Clavera , Violet Fu , Pieter Abbeel

Recent work on Path-Dependent Partial Differential Equations (PPDEs) has shown that PPDE solutions can be approximated by a probabilistic representation, implemented in the literature by the estimation of conditional expectations using…

机器学习 · 计算机科学 2022-10-05 Jiang Yu Nguwi , Nicolas Privault

Reinforcement learning (RL) for continuous control under delayed rewards is an under-explored problem despite its significance in real-world applications. Many complex skills are based on intermediate ones as prerequisites. For instance, a…

机器学习 · 计算机科学 2025-08-21 Bahareh Tasdighi , Manuel Haussmann , Nicklas Werge , Yi-Shan Wu , Melih Kandemir

In this paper, we consider the risk-sensitive cost criterion with exponentiated costs for Markov decision processes and develop a model-free policy gradient algorithm in this setting. Unlike additive cost criteria such as average or…

机器学习 · 计算机科学 2025-08-05 Soumyajit Guin , Vivek S. Borkar , Shalabh Bhatnagar

Backward stochastic differential equation (BSDE)-based deep learning methods provide an alternative to Physics-Informed Neural Networks (PINNs) for solving high-dimensional partial differential equations (PDEs), offering potential…

机器学习 · 计算机科学 2026-01-15 Sungje Park , Stephen Tu

We study the robustness of deep reinforcement learning algorithms against distribution shifts within contextual multi-stage stochastic combinatorial optimization problems from the operations research domain. In this context, risk-sensitive…

机器学习 · 计算机科学 2024-02-16 Tobias Enders , James Harrison , Maximilian Schiffer

In this paper, we study an optimal control problem of linear backward stochastic differential equation (BSDE) with quadratic cost functional under partial information. This problem is solved completely and explicitly by using a stochastic…

最优化与控制 · 数学 2020-12-16 Guangchen Wang , Wencan Wang , Zhiguo Yan

We study a class of backward stochastic differential equations (BSDEs) driven by a random measure or, equivalently, by a marked point process. Under appropriate assumptions we prove well-posedness and continuous dependence of the solution…

概率论 · 数学 2012-05-24 Fulvia Confortola , Marco Fuhrman

In this article we design a novel quasi-regression Monte Carlo algorithm in order to approximate the solution of discrete time backward stochastic differential equations (BSDEs), and we analyze the convergence of the proposed method. The…

数值分析 · 数学 2024-08-01 E. Gobet , J. G. López-Salas , C. Vázquez

The paper is devoted to the construction of a probabilistic particle algorithm. This is related to nonlin-ear forward Feynman-Kac type equation, which represents the solution of a nonconservative semilinear parabolic Partial Differential…

概率论 · 数学 2017-09-15 Anthony Le Cavil , Nadia Oudjane , Francesco Russo

This paper introduces a new approximation scheme for solving high-dimensional semilinear partial differential equations (PDEs) and backward stochastic differential equations (BSDEs). First, we decompose a target semilinear PDE (BSDE) into…

数值分析 · 数学 2022-02-09 Akihiko Takahashi , Yoshifumi Tsuchida , Toshihiro Yamada

In many robotic applications, some aspects of the system dynamics can be modeled accurately while others are difficult to obtain or model. We present a novel reinforcement learning (RL) method for continuous state and action spaces that…

人工智能 · 计算机科学 2017-06-06 Tomoki Nishi , Prashant Doshi , Michael R. James , Danil Prokhorov

Applications in quantitative finance such as optimal trade execution, risk management of options, and optimal asset allocation involve the solution of high dimensional and nonlinear Partial Differential Equations (PDEs). The connection…

机器学习 · 统计学 2019-10-28 Batuhan Güler , Alexis Laignelet , Panos Parpas

In this paper we introduce a multilevel Picard approximation algorithm for general semilinear parabolic PDEs with gradient-dependent nonlinearities whose coefficient functions do not need to be constant. We also provide a full convergence…

数值分析 · 数学 2025-02-19 Ariel Neufeld , Sizhou Wu

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

机器学习 · 计算机科学 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

This paper studies a new class of linear-quadratic mean field games and teams problem, where the large-population system satisfies a class of $N$ weakly coupled linear backward stochastic differential equations (BSDEs), and $z_i$ (a part of…

最优化与控制 · 数学 2025-01-10 Yu Si , Jingtao Shi

In this paper, we mainly focus on solving high-dimensional stochastic Hamiltonian systems with boundary condition, which is essentially a Forward Backward Stochastic Differential Equation (FBSDE in short), and propose a novel method from…

最优化与控制 · 数学 2021-12-13 Shaolin Ji , Shige Peng , Ying Peng , Xichuan Zhang