English
Related papers

Related papers: Set-valued Hamilton-Jacobi-Bellman Equations

200 papers

In the present work we employ, for the first time, backward stochastic differential equations (BSDEs) to study the optimal control of semi-Markov processes on finite horizon, with general state and action spaces. More precisely, we prove…

Optimization and Control · Mathematics 2015-05-27 Elena Bandini , Fulvia Confortola

We consider the value function originating from an expected utility maximization problem with finite fuel constraint and show its close relation to a nonlinear parabolic degenerated Hamilton-Jacobi-Bellman (HJB) equation with singularity.…

Mathematical Finance · Quantitative Finance 2015-10-14 Mourad Lazgham

We mathematically analyze and numerically study an actor-critic machine learning algorithm for solving high-dimensional Hamilton-Jacobi-Bellman (HJB) partial differential equations from stochastic control theory. The architecture of the…

Optimization and Control · Mathematics 2026-05-20 Samuel N. Cohen , Jackson Hebner , Deqing Jiang , Justin Sirignano

This paper investigates the convergence properties of the upwind difference scheme for the Hamilton--Jacobi--Bellman (HJB) equation, a central partial differential equation in optimal control theory. First, assuming the existence of a…

Numerical Analysis · Mathematics 2026-02-05 Daisuke Inoue , Yuji Ito , Takahito Kashiwabara , Norikazu Saito , Hiroaki Yoshida

The overarching goal of this paper is to establish a set-valued It\^{o}'s formula. As an application, we obtain the existence and uniqueness of solutions for the general set-valued backward stochastic differential equation which gives an…

Probability · Mathematics 2021-02-09 Yao-jia Zhang , Zhun Gou , Nan-jing Huang

We introduce a novel numerical approach for a class of stochastic dynamic programs which arise as discretizations of backward stochastic differential equations or semi-linear partial differential equations. Solving such dynamic programs…

Numerical Analysis · Mathematics 2016-06-24 Christian Bender , Christian Gaertner , Nikolaus Schweizer

Functional dynamics, introduced in a previous paper, is analyzed, focusing on the formation of a hierarchical rule to determine the dynamics of the functional value. To study the periodic (or non-fixed) solution, the functional dynamics is…

adap-org · Physics 2007-05-23 N. Kataoka , K. Kaneko

We present a new formulation for the computation of solutions of a class of Hamilton Jacobi Bellman (HJB) equations on closed smooth surfaces of co-dimension one. For the class of equations considered in this paper, the viscosity solution…

Numerical Analysis · Mathematics 2020-08-06 Lindsay Martin , Richard Tsai

The purpose of this note is to propose a new approach for the probabilistic interpretation of Hamilton-Jacobi-Bellman equations associated with stochastic recursive optimal control problems, utilizing the representation theorem for…

Probability · Mathematics 2017-05-03 Lishun Xiao , Shengjun Fan , Dejian Tian

We extend the stochastic Perron method to analyze the framework of stochastic target games, in which one player tries to find a strategy such that the state process almost surely reaches a given target no matter which action is chosen by…

Probability · Mathematics 2016-04-07 Erhan Bayraktar , Jiaqi Li

We show that necessary and sufficient conditions of optimality in periodic optimization problems can be stated in terms of a solution of the corresponding HJB inequality, the latter being equivalent to a max-min type variational problem…

Optimization and Control · Mathematics 2013-09-10 Vladimir Gaitsgory , Ludmila Manic

We consider a dynamic portfolio optimization problem that incorporates predictable returns, instantaneous transaction costs, price impact, and stochastic volatility, extending the classical results of Garleanu and Pedersen (2013), which…

Computational Finance · Quantitative Finance 2025-07-24 Patrick Chan , Ronnie Sircar , Iosif Zimbidis

In this paper, we guarantee the existence and uniqueness (in the almost everywhere sense) of the solution to a Hamilton-Jacobi-Bellman (HJB) equation with gradient constraint and a partial integro-differential operator whose L\'evy measure…

Analysis of PDEs · Mathematics 2019-03-26 Mark Kelbert , Harold A. Moreno-Franco

The goal of this thesis is to provide efficient and provably convergent numerical methods for solving partial differential equations (PDEs) coming from impulse control problems motivated by finance. Impulses, which are controlled jumps in a…

Numerical Analysis · Mathematics 2018-02-05 Parsiad Azimzadeh

We give a short proof of It\^o's formula for stochastic Hilbert-space valued processes in the setting $V\subset H\subset V^{*}$ based on the possibility to lift the stochastic differentials, which are originally in $V^{*}$, into $H$. Using…

Probability · Mathematics 2012-08-21 N. V. Krylov

We study the solution theory of the whole-space static (elliptic) Hamilton-Jacobi-Bellman (HJB) equation in spectral Barron spaces. We prove that under the assumption that the coefficients involved are spectral Barron functions and the…

Analysis of PDEs · Mathematics 2025-09-18 Ye Feng , Jianfeng Lu

We consider the problem of maximizing expected utility for a power investor who can allocate his wealth in a stock, a defaultable security, and a money market account. The dynamics of these security prices are governed by geometric Brownian…

Portfolio Management · Quantitative Finance 2014-06-04 Agostino Capponi , Jose Enrique Figueroa Lopez , Andrea Pascucci

This study introduces a mathematical framework to investigate the viability and reachability of production systems under constraints. We develop a model that incorporates key decision variables, such as pricing policy, quality investment,…

Optimization and Control · Mathematics 2025-09-16 Achraf Bouhmady , Mustapha Serhani , Nadia Raissi

In this manuscript we consider a class optimal control problem for stochastic differential delay equations. First, we rewrite the problem in a suitable infinite-dimensional Hilbert space. Then, using the dynamic programming approach, we…

Optimization and Control · Mathematics 2023-02-20 Filippo de Feo , Salvatore Federico , Andrzej Święch

This paper is concerned with stochastic impulse control problems in which the running cost changes depending on the impulse control. Because of such a dependence, it brings several difficulties when the usual dynamic programming principle…

Optimization and Control · Mathematics 2025-11-11 Yuchen Cao , Jiongmin Yong