English
Related papers

Related papers: Hamilton-Jacobi-Bellman Equations for Maximum Entr…

200 papers

This paper develops a framework for establishing the existence of solutions to the equilibrium Hamilton-Jacobi-Bellman (EHJB) equation arising in time-inconsistent stochastic control problems. The time-inconsistency in our setting arises…

Optimization and Control · Mathematics 2026-04-07 Zhenhua Wang , Xiang Yu , Jingjie Zhang , Zhou Zhou

This paper investigates a Hamilton-Jacobi (HJ) analysis to solve finite-horizon optimal control problems for high-dimensional systems. Although grid-based methods, such as the level-set method [1], numerically solve a general class of HJ…

Systems and Control · Electrical Eng. & Systems 2021-06-28 Donggun Lee , Claire J. Tomlin

In this paper, we study a time-inconsistent stochastic optimal control problem with a recursive cost functional by a multi-person hierarchical differential game approach. An equilibrium strategy of this problem is constructed and a…

Optimization and Control · Mathematics 2016-06-13 Qingmeng Wei , Jiongmin Yong , Zhiyong Yu

Stochastic optimal control control problems with merely measurable coefficients are not well understood. In this manuscript, we consider fully non-linear stochastic optimal control problems in infinite horizon with measurable coefficients…

Optimization and Control · Mathematics 2026-05-21 Filippo de Feo

Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution…

Machine Learning · Computer Science 2022-06-20 Harley Wiltzer , David Meger , Marc G. Bellemare

Feedback controllers for port-Hamiltonian systems reveal an intrinsic inverse optimality property since each passivating state feedback controller is optimal with respect to some specific performance index. Due to the nonlinear…

Optimization and Control · Mathematics 2020-07-20 Lukas Kölsch , Pol Jané Soneira , Felix Strehle , Sören Hohmann

The aim of this work is to develop a deep learning method for solving high-dimensional stochastic control problems based on the Hamilton--Jacobi--Bellman (HJB) equation and physics-informed learning. Our approach is to parameterize the…

Optimization and Control · Mathematics 2025-06-23 Zhe Jiao , Wantao Jia , Weiqiu Zhu

This paper studies the time-inconsistent MV optimal stopping problem via a game-theoretic approach to find equilibrium strategies. To overcome the mathematical intractability of direct equilibrium analysis, we propose a vanishing…

Optimization and Control · Mathematics 2025-10-29 Yuchao Dong , Harry Zheng

This paper presents a mathematical formulation to perform temporal parallelisation of continuous-time optimal control problems, which can be solved via the Hamilton--Jacobi--Bellman (HJB) equation. We divide the time interval of the control…

Optimization and Control · Mathematics 2024-12-18 Simo Särkkä , Ángel F. García-Fernández

In this article, a notion of viscosity solutions is introduced for second order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent stochastic evolution equations in Hilbert…

Probability · Mathematics 2020-09-14 Jianjun Zhou

Computing optimal feedback controls for nonlinear systems generally requires solving Hamilton-Jacobi-Bellman (HJB) equations, which are notoriously difficult when the state dimension is large. Existing strategies for high-dimensional…

Optimization and Control · Mathematics 2021-04-09 Tenavi Nakamura-Zimmerer , Qi Gong , Wei Kang

The Hamilton Jacobi Bellman Equation (HJB) provides the globally optimal solution to large classes of control problems. Unfortunately, this generality comes at a price, the calculation of such solutions is typically intractible for systems…

Optimization and Control · Mathematics 2014-09-23 Matanya B. Horowitz , Anil Damle , Joel W. Burdick

We study a stochastic control problem on a bounded domain, which arises from a continuous-time optimal management model. Via the corresponding Hamilton-Jacobi-Bellman equation the value function is shown to be jointly continuous and to…

Probability · Mathematics 2017-10-24 Ruoting Gong , Christian Houdré

We treat infinite horizon optimal control problems by solving the associated stationary Hamilton-Jacobi-Bellman (HJB) equation numerically to compute the value function and an optimal feedback law. The dynamical systems under consideration…

Optimization and Control · Mathematics 2021-05-19 Mathias Oster , Leon Sallandt , Reinhold Schneider

We show that necessary and sufficient conditions of optimality in periodic optimization problems can be stated in terms of a solution of the corresponding HJB inequality, the latter being equivalent to a max-min type variational problem…

Optimization and Control · Mathematics 2013-09-10 Vladimir Gaitsgory , Ludmila Manic

A general time-inconsistent optimal control problem is considered for stochastic differential equations with deterministic coefficients. Under suitable conditions, a Hamilton-Jacobi-Bellman type equation is derived for the equilibrium value…

Optimization and Control · Mathematics 2012-04-04 Jiongmin Yong

In this paper, a stochastic optimal control problem is investigated in which the system is governed by a stochastic functional differential equation. In the framework of functional It\^o calculus, we build the dynamic programming principle…

Optimization and Control · Mathematics 2013-01-03 Shaolin Ji , Shuzhen Yang

We study a stochastic optimal control problem with the state constrained to a smooth, compact domain. The control influences both the drift and a possibly degenerate, control-dependent dispersion matrix, leading to a fully nonlinear,…

Optimization and Control · Mathematics 2025-08-08 Anderson O. Calixto , Bernardo Freitas Paulo da Costa , Glauco Valle

In this paper, we propose a novel image restoration framework that integrates optimal control techniques with the Hamilton-Jacobi-Bellman (HJB) equation. Motivated by models from production planning, our method restores degraded images by…

Analysis of PDEs · Mathematics 2025-05-13 Dragos-Patru Covei

This article is devoted to the optimal control of state equations with memory of the form: ?[x(t) = F(x(t),u(t), \int_0^{+\infty} A(s) x(t-s) ds), t>0, with initial conditions x(0)=x, x(-s)=z(s), s>0.]Denoting by $y_{x,z,u}$ the solution of…

Optimization and Control · Mathematics 2011-11-02 Guillaume Carlier , Rabah Tahraoui