English
Related papers

Related papers: Convergence Analysis of the Upwind Difference Meth…

200 papers

In this article, we provide a numerical method based on fitted finite volume method to approximate the Hamilton-Jacobi-Bellman (HJB) equation coming from stochastic optimal control problems. The computational challenge is due to the nature…

Numerical Analysis · Mathematics 2020-02-21 Christelle Dleuna Nyoumbi , Antoine Tambue

Optimal control and the associated second-order Hamilton-Jacobi-Bellman (HJB) equation are studied for unbounded stochastic evolution systems in Hilbert spaces. A new notion of viscosity solution, featured by absence of B-continuity, is…

Optimization and Control · Mathematics 2026-02-10 Shanjian Tang , Jianjun Zhou

This paper introduces a notion of viscosity solutions for second order elliptic Hamilton-Jacobi-Bellman (HJB) equations with infinite delay associated with infinite-horizon optimal control problems for stochastic differential equations with…

Optimization and Control · Mathematics 2021-12-28 Jianjun Zhou

We consider the numerical solution of Hamilton-Jacobi-Bellman equations arising in stochastic control theory. We introduce a class of monotone approximation schemes relying on monotone interpolation. These schemes converge under very weak…

Numerical Analysis · Mathematics 2014-05-26 Kristian Debrabant , Espen R. Jakobsen

We study a stochastic optimal control problem with the state constrained to a smooth, compact domain. The control influences both the drift and a possibly degenerate, control-dependent dispersion matrix, leading to a fully nonlinear,…

Optimization and Control · Mathematics 2025-08-08 Anderson O. Calixto , Bernardo Freitas Paulo da Costa , Glauco Valle

In this paper, we study the optimal singular controls for stochastic recursive systems, in which the control has two components: the regular control, and the singular control. Under certain assumptions, we establish the dynamic programming…

Optimization and Control · Mathematics 2018-11-06 Liangquan Zhang

This work concerns the optimal control problem for McKean-Vlasov SDEs. In order to characterize the value function, we develop the viscosity solution theory for Hamilton-Jacobi-Bellman (HJB) equations on the Wasserstein space using…

Probability · Mathematics 2023-10-19 Jinghai Shao

Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution…

Machine Learning · Computer Science 2022-06-20 Harley Wiltzer , David Meger , Marc G. Bellemare

The aim of this work is to deal with a discontinuous Hamilton-Jacobi equation in the whole euclidian N-dimensional space, associated to a possibly unbounded optimal control problem. Here, the discontinuities are located on a hyperplane and…

Optimization and Control · Mathematics 2024-05-16 Emmanuel Chasseigne , Robson Carlos Reis , Silvia Sastre-Gomez

Many optimal control problems are formulated as two point boundary value problems (TPBVPs) with conditions of optimality derived from the Hamilton-Jacobi-Bellman (HJB) equations. In most cases, it is challenging to solve HJBs due to the…

Optimization and Control · Mathematics 2019-07-25 Sixiong You , Ran Dai , Ping Lu

In this paper, we guarantee the existence and uniqueness (in the almost everywhere sense) of the solution to a Hamilton-Jacobi-Bellman (HJB) equation with gradient constraint and a partial integro-differential operator whose L\'evy measure…

Analysis of PDEs · Mathematics 2019-03-26 Mark Kelbert , Harold A. Moreno-Franco

In this manuscript, we study optimal control problems for stochastic delay differential equations using the dynamic programming approach in Hilbert spaces via viscosity solutions of the associated Hamilton-Jacobi-Bellman equations. We show…

Optimization and Control · Mathematics 2024-12-24 Filippo de Feo , Andrzej Święch

The ergodic control problem for a non-degenerate controlled diffusion controlled through its drift is considered under a uniform stability condition that ensures the well-posedness of the associated Hamilton-Jacobi-Bellman (HJB) equation. A…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Vivek S. Borkar

In this paper, we study the existence and uniqueness of viscosity solutions to a kind of Hamilton-Jacobi-Bellman (HJB) equations combined with algebra equations. This HJB equation is related to a stochastic optimal control problem for which…

Optimization and Control · Mathematics 2019-06-19 Mingshang Hu , Shaolin Ji , Xiaole Xue

We prove comparison principle for viscosity solutions of a Hamilton-Jacobi-Bellman equation in a strong coupling regime considering a stationary and a time-dependent version of the equation. We consider a Hamiltonian that has a…

Analysis of PDEs · Mathematics 2023-10-10 Serena Della Corte , Richard C. Kraaij

The framework of deep operator network (DeepONet) has been widely exploited thanks to its capability of solving high dimensional partial differential equations. In this paper, we incorporate DeepONet with a recently developed policy…

Optimization and Control · Mathematics 2024-06-18 Jae Yong Lee , Yeoneung Kim

This article is a continuation of a previous work where we studied infinite horizon control problems for which the dynamic, running cost and control space may be different in two half-spaces of some euclidian space $\R^N$. In this article…

Analysis of PDEs · Mathematics 2014-01-27 Guy Barles , Ariela Briani , Emmanuel Chasseigne

We study a second order BDF (Backward Differentiation Formula) scheme for the numerical approximation of parabolic HJB (Hamilton-Jacobi-Bellman) equations. The scheme under consideration is implicit, non-monotone, and second order accurate…

Numerical Analysis · Mathematics 2018-02-21 Olivier Bokanowski , Athena Picarelli , Christoph Reisinger

The paper deals with a class of time-inconsistent control problems for McKean-Vlasov dynamics. By solving a backward time-inconsistent Hamilton-Jacobi-Bellman (HJB for short) equation coupled with a forward distribution-dependent stochastic…

Optimization and Control · Mathematics 2020-02-18 Hongwei Mei , Chao Zhu

This paper is concerned with an optimal control problem for a forward-backward stochastic differential equation (FBSDE, for short) with a recursive cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for…

Optimization and Control · Mathematics 2022-09-20 Hanxiao Wang , Jiongmin Yong , Chao Zhou