English
Related papers

Related papers: Hamilton Jacobi Bellman equations in infinite dime…

200 papers

In this paper, we first establish the dynamic programming principle for stochastic optimal control problems defined on compact Riemannian manifolds without boundary. Subsequently, we derive the associated Hamilton-Jacobi-Bellman (HJB)…

Optimization and Control · Mathematics 2025-07-03 Dingqian Gao , Qi Lü

This paper investigates the convergence properties of the upwind difference scheme for the Hamilton--Jacobi--Bellman (HJB) equation, a central partial differential equation in optimal control theory. First, assuming the existence of a…

Numerical Analysis · Mathematics 2026-02-05 Daisuke Inoue , Yuji Ito , Takahito Kashiwabara , Norikazu Saito , Hiroaki Yoshida

We consider a class of closed loop stochastic optimal control problems in finite time horizon, in which the cost is an expectation conditional on the event that the process has not exited a given bounded domain. An important difficulty is…

Optimization and Control · Mathematics 2019-12-19 Yves Achdou , Mathieu Laurière , Pierre-Louis Lions

The purpose of this paper is to describe the numerical solution of the Hamilton-Jacobi-Bellman (HJB) for an optimal control problem for quantum spin systems. This HJB equation is a first order nonlinear partial differential equation defined…

Quantum Physics · Physics 2011-10-05 Srinivas Sridharan , Matthew R. James

In this manuscript we consider optimal control problems of stochastic differential equations with delays in the state and in the control. First, we prove an equivalent Markovian reformulation on Hilbert spaces of the state equation. Then,…

Optimization and Control · Mathematics 2024-05-20 Filippo de Feo

In this paper, we establish a connection between the spectral theory of the Koopman operator and the solution of the Hamilton Jacobi (HJ) equation. The HJ equation occupies a central place in systems theory, and its solution is of interest…

Dynamical Systems · Mathematics 2025-04-11 Umesh Vaidya

An optimal control problem related to the probability of transition between stable states for a thermally driven Ginzburg-Landau equation is considered. The value function for the optimal control problem with a spatial discretization is…

Optimization and Control · Mathematics 2008-09-11 Mattias Sandberg

We survey the main numerical techniques for finite-dimensional nonlinear optimal control. The chapter is written as a guide to practitioners who wish to get rapidly acquainted with the main numerical methods used to efficiently solve an…

Optimization and Control · Mathematics 2022-12-07 Jean-Baptiste Caillau , Roberto Ferretti , Emmanuel Trélat , Hasnaa Zidani

We study the large time behavior of Lipschitz continuous, possibly unbounded, viscosity solutions of Hamilton-Jacobi Equations in the whole space $\R^N$. The associated ergodic problem has Lipschitz continuous solutions if the analogue of…

Analysis of PDEs · Mathematics 2007-08-30 Guy Barles , Jean-Michel Roquejoffre

We consider the numerical solution of Hamilton-Jacobi-Bellman equations arising in stochastic control theory. We introduce a class of monotone approximation schemes relying on monotone interpolation. These schemes converge under very weak…

Numerical Analysis · Mathematics 2014-05-26 Kristian Debrabant , Espen R. Jakobsen

We study the well-posedness of an infinite-dimensional Hamilton-Jacobi equation posed on the set of non-negative measures and with a monotonic non-linearity. Our results will be used in a companion work to propose a conjecture and prove…

Analysis of PDEs · Mathematics 2023-08-30 Tomas Dominguez , Jean-Christophe Mourrat

In this article, we study the large time behavior of solutions of first-order Hamilton-Jacobi Equations, set in a bounded domain with nonlinear Neumann boundary conditions, including the case of dynamical boundary conditions. We establish…

Analysis of PDEs · Mathematics 2015-05-30 Guy Barles , Hiroyoshi Mitake , Hitoshi Ishii

The ability to characterise a Hamiltonian with high precision is crucial for the implementation of quantum technologies. In addition to the well-developed approaches utilising optimal probe states and optimal measurements, the method of…

Quantum Physics · Physics 2022-12-14 Shushen Qin , Marcus Cramer , Christiane P. Koch , Alessio Serafini

We study in this paper a control problem in a space of random variables. We show that its Hamilton Jacobi Bellman equation is related to the Master equation in Mean field theory. P.L. Lions in [14,15] introduced the Hilbert space of square…

Optimization and Control · Mathematics 2015-08-05 Alain Bensoussan , Phillip Yam

The paper studies a system of first order Hamilton-Jacobi equations with discontinuous coefficients, arising from a model of deterministic optimal debt management in infinite time horizon, with exponential discount and currency devaluation.…

Optimization and Control · Mathematics 2021-02-09 Antonio Marigonda , Khai T. Nguyen

The approximation of solutions to second order Hamilton--Jacobi--Bellman (HJB) equations by deep neural networks is investigated. It is shown that for HJB equations that arise in the context of the optimal control of certain Markov…

Numerical Analysis · Mathematics 2021-03-11 Philipp Grohs , Lukas Herrmann

Lagrangian submanifolds are becoming a very essential tool to generalize and geometrically understand results and procedures in the area of mathematical physics. Here we use general Lagrangian submanifolds to provide a geometric version of…

Mathematical Physics · Physics 2012-09-06 M. Barbero-Liñán , M. de León , D. Martín de Diego

This paper concerns continuous dependence estimates for Hamilton-Jacobi-Bellman-Isaacs operators (briefly, HJBI). For the parabolic Cauchy problem, we establish such an estimate in the whole space $[0,+\infty)\times\Rn$. Moreover, under…

Analysis of PDEs · Mathematics 2010-08-02 Claudio Marchi

It is proved the existence of multivalent solutions for the Riemann-Hilbert problem in the general settings of finitely connected domains bounded by mutually disjoint Jordan curves, measurable coefficients and measurable boundary data. The…

Complex Variables · Mathematics 2015-10-19 Vladimir Ryazanov

We introduce a new numerical method to approximate the solution of a finite horizon deterministic optimal control problem. We exploit two Hamilton-Jacobi-Bellman PDE, arising by considering the dynamics in forward and backward time. This…

Optimization and Control · Mathematics 2023-04-21 Marianne Akian , Stéphane Gaubert , Shanqing Liu