中文
相关论文

相关论文: A neural network based policy iteration algorithm …

200 篇论文

We propose a probabilistic numerical algorithm to solve Backward Stochastic Differential Equations (BSDEs) with nonnegative jumps, a class of BSDEs introduced in [9] for representing fully nonlinear HJB equations. In particular, this allows…

概率论 · 数学 2019-07-11 Idris Kharroubi , Nicolas Langrené , Huyên Pham

We propose a splitting approach to solve the second-order Hamilton--Jacobi equation, reducing it to a heat step and a purely first-order step. The latter is implemented using a gradient value policy iteration algorithm, enabling efficient…

最优化与控制 · 数学 2026-03-23 Alain Bensoussan , Thien P. B. Nguyen , Minh-Binh Tran , Son N. T. Tu

When randomness in demand affects the sales of a product, retailers use dynamic pricing strategies to maximize their profits. In this article, we formulate the pricing problem as a continuous-time stochastic optimal control problem and find…

最优化与控制 · 数学 2019-03-13 Asbjørn Nilsen Riseth

We study a two-player zero-sum stochastic differential game with both players adopting impulse controls, on a finite time horizon. The Hamilton-Jacobi-Bellman-Isaacs (HJBI) partial differential equation of the game turns out to be a…

概率论 · 数学 2012-06-26 Andrea Cosso

A new framework for formulating reachability problems with competing inputs, nonlinear dynamics and state constraints as optimal control problems is developed. Such reach-avoid problems arise in, among others, the study of safety problems…

最优化与控制 · 数学 2009-11-25 Kostas Margellos , John Lygeros

Merton portfolio management problem is studied in this paper within a stochastic volatility, non constant time discount rate, and power utility framework. This problem is time inconsistent and the way out of this predicament is to consider…

投资组合管理 · 定量金融 2024-02-09 Oumar Mbodji , Traian A. Pirvu

For pricing American options, %after suitable discretization in space and time, a sequence of discrete linear complementarity problems (LCPs) or equivalently Hamilton-Jacobi-Bellman (HJB) equations need to be solved in a sequential…

数值分析 · 数学 2024-05-15 Xian-Ming Gu , Jun Liu , Cornelis W. Oosterlee

A new stochastic control model for the long-run environmental management of rivers is mathematically and numerically analyzed, focusing on a modern sediment replenishment problem with unique nonsmooth and nonlinear properties. Rational…

最优化与控制 · 数学 2022-03-11 Hidekazu Yoshioka , Motoh Tsujimura

We propose a numerical method for solving high dimensional fully nonlinear partial differential equations (PDEs). Our algorithm estimates simultaneously by backward time induction the solution and its gradient by multi-layer neural…

最优化与控制 · 数学 2021-01-27 Huyen Pham , Xavier Warin , Maximilien Germain

We present a deep recurrent neural network architecture to solve a class of stochastic optimal control problems described by fully nonlinear Hamilton Jacobi Bellmanpartial differential equations. Such PDEs arise when one considers…

机器学习 · 计算机科学 2019-12-24 Marcus A Pereira , Ziyi Wang , Tianrong Chen , Emily Reed , Evangelos A Theodorou

The uncertainties in plant dynamics remain a challenge for nonlinear control problems. This paper develops a ternary policy iteration (TPI) algorithm for solving nonlinear robust control problems with bounded uncertainties. The controller…

系统与控制 · 电气工程与系统科学 2020-07-15 Jie Li , Shengbo Eben Li , Yang Guan , Jingliang Duan , Wenyu Li , Yuming Yin

This paper presents a {\delta}-PI algorithm which is based on damped Newton method for the H{\infty} tracking control problem of unknown continuous-time nonlinear system. A discounted performance function and an augmented system are used to…

机器学习 · 计算机科学 2024-01-24 Qi Wang

In this article, we provide a numerical method based on fitted finite volume method to approximate the Hamilton-Jacobi-Bellman (HJB) equation coming from stochastic optimal control problems. The computational challenge is due to the nature…

数值分析 · 数学 2020-02-21 Christelle Dleuna Nyoumbi , Antoine Tambue

This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…

最优化与控制 · 数学 2026-05-21 Dunxiang Liang , Qingxin Meng

In this brief paper, we consider the problem of minimizing the asymptotic exit rate of diffusion processes from an open connected bounded set pertaining to a multi-channel system with small random perturbations. Specifically, we establish a…

动力系统 · 数学 2016-10-05 Getachew K. Befekadu

We mathematically analyze and numerically study an actor-critic machine learning algorithm for solving high-dimensional Hamilton-Jacobi-Bellman (HJB) partial differential equations from stochastic control theory. The architecture of the…

最优化与控制 · 数学 2026-05-20 Samuel N. Cohen , Jackson Hebner , Deqing Jiang , Justin Sirignano

This paper studies {a} mixed singular/switching stochastic control problem for a multidimensional diffusion with multiples regimes on a bounded domain. Using probabilistic, partial differential equation (PDE) and penalization techniques, we…

最优化与控制 · 数学 2020-10-13 Mark Kelbert , Harold A. Moreno-Franco

In this paper, we present a fast and accurate numerical scheme for the solution of fifth-order boundary-value problems. We apply the reproducing kernel Hilbert space method (RKHSM) for solving this problem. The analytic results of the…

数值分析 · 数学 2013-05-21 Mustafa Inc , Ali Akgül , Mehdi Dehghan

Nonzero-sum stochastic differential games with impulse controls offer a realistic and far-reaching modelling framework for applications within finance, energy markets, and other areas, but the difficulty in solving such problems has…

数值分析 · 数学 2020-06-29 Diego Zabaljauregui

Controlling systems of ordinary differential equations (ODEs) is ubiquitous in science and engineering. For finding an optimal feedback controller, the value function and associated fundamental equations such as the Bellman equation and the…

最优化与控制 · 数学 2021-04-14 Mathias Oster , Leon Sallandt , Reinhold Schneider