English
Related papers

Related papers: Temporal Parallelisation of the HJB Equation and C…

200 papers

Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution…

Machine Learning · Computer Science 2022-06-20 Harley Wiltzer , David Meger , Marc G. Bellemare

This paper presents the optimal control and synchronization problem of a multilevel network of R\"ossler chaotic oscillators. Using the Hamilton-Jacobi-Bellman (HJB) technique, the optimal control law with three-state variables feedback is…

Optimization and Control · Mathematics 2022-10-18 Thierry Njougouo , Victor Camargo , Patrick Louodop , Fernando F Ferreira , Pierre K. Talla , Hilda A. Cerdeira

We present a hierarchical computation approach for solving finite-time optimal control problems using operator splitting methods. The first split is performed over the time index and leads to as many subproblems as the length of the…

Optimization and Control · Mathematics 2013-04-09 Georgios Stathopoulos , Tamás Keviczky , Yang Wang

Stochastic optimal control problems governed by delay equations with delay in the control are usually more difficult to study than the the ones when the delay appears only in the state. This is particularly true when we look at the…

Probability · Mathematics 2021-03-22 F. Gozzi , F. Masiero

We present an accelerated algorithm for the solution of static Hamilton-Jacobi-Bellman equations related to optimal control problems. Our scheme is based on a classic policy iteration procedure, which is known to have superlinear…

Optimization and Control · Mathematics 2016-02-22 Alessandro Alla , Maurizio Falcone , Dante Kalise

We discuss time-optimal control problems for two setups involving globally driven Rydberg atoms in the blockade limit by deriving the associated Hamilton-Jacobi-Bellman equations. From these equations, we extract the globally optimal…

Quantum Physics · Physics 2024-09-27 Charles Fromonteil , Roberto Tricarico , Francesco Cesa , Hannes Pichler

We study a family of optimal control problems under a set of controlled-loss constraints holding at different deterministic dates. The characterization of the associated value function by a Hamilton-Jacobi-Bellman equation usually calls for…

Optimization and Control · Mathematics 2020-07-27 Geraldine Bouveret , Athena Picarelli

In this paper we study a first extension of the theory of mild solutions for HJB equations in Hilbert spaces to the case when the domain is not the whole space. More precisely, we consider a half-space as domain, and a semilinear…

Optimization and Control · Mathematics 2022-09-30 Alessandro Calvia , Gianluca Cappa , Fausto Gozzi , Enrico Priola

Environmental management optimizing a long-run objective is an ergodic control problem whose resolution can be achieved by solving an associated non-local Hamilton-Jacobi-Bellman (HJB) equation having an effective Hamiltonian. Focusing on…

Optimization and Control · Mathematics 2022-05-11 Hidekazu Yoshioka , Motoh Tsujimura , Yuta Yaegashi

The aim of this work is to develop a deep learning method for solving high-dimensional stochastic control problems based on the Hamilton--Jacobi--Bellman (HJB) equation and physics-informed learning. Our approach is to parameterize the…

Optimization and Control · Mathematics 2025-06-23 Zhe Jiao , Wantao Jia , Weiqiu Zhu

We consider continuous-time stochastic optimal control problems featuring Conditional Value-at-Risk (CVaR) in the objective. The major difficulty in these problems arises from time-inconsistency, which prevents us from directly using…

Optimization and Control · Mathematics 2020-05-27 Christopher W. Miller , Insoon Yang

Optimal control problems are crucial in various domains, including path planning, robotics, and humanoid control, demonstrating their broad applicability. The connection between optimal control and Hamilton-Jacobi (HJ) partial differential…

Optimization and Control · Mathematics 2024-03-06 Tingwei Meng , Siting Liu , Wuchen Li , Stanley Osher

The numerical realization of the dynamic programming principle for continuous-time optimal control leads to nonlinear Hamilton-Jacobi-Bellman equations which require the minimization of a nonlinear mapping over the set of admissible…

Optimization and Control · Mathematics 2015-02-26 Dante Kalise , Axel Kröner , Karl Kunisch

Hamilton-Jacobi partial differential equations (HJ PDEs) have deep connections with a wide range of fields, including optimal control, differential games, and imaging sciences. By considering the time variable to be a higher dimensional…

Machine Learning · Computer Science 2023-12-12 Paula Chen , Tingwei Meng , Zongren Zou , Jérôme Darbon , George Em Karniadakis

Recent studies have extended the use of the stochastic Hamilton-Jacobi-Bellman (HJB) equation to include complex variables for deriving quantum mechanical equations. However, these studies often assume that it is valid to apply the HJB…

Quantum Physics · Physics 2024-10-14 Vasil Yordanov

We consider an infinite horizon control problem for dynamics constrained to remain on a multidimensional junction with entry costs. We derive the associated system of Hamilton-Jacobi equations (HJ), prove the comparison principle and that…

Analysis of PDEs · Mathematics 2020-02-25 Manh-Khang Dao , Boualem Djehiche

This is the first in a series of papers in which we study an efficient approximation scheme for solving the Hamilton-Jacobi-Bellman equation for multi-dimensional problems in stochastic control theory. The method is a combination of a WKB…

Computational Finance · Quantitative Finance 2014-06-26 Sakda Chaiworawitkul , Patrick S. Hagan , Andrew Lesniewski

In this paper, we study a stochastic recursive optimal control problem in which the system is governed by a functional forward-backward stochastic differential equation. Under standard assumptions, we establish the dynamic programming…

Probability · Mathematics 2013-01-03 Shaolin Ji , Shuzhen Yang

We address the problem of combined stochastic and impulse control for a market maker operating in a limit order book. The problem is formulated as a Hamilton-Jacobi-Bellman quasi-variational inequality (HJBQVI). We propose an implicit…

Mathematical Finance · Quantitative Finance 2025-12-25 Alexey Meteykin

We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman…

Quantum Physics · Physics 2007-05-23 J. Gough , V. P. Belavkin , O. G. Smolyanov