English
Related papers

Related papers: Hamilton-Jacobi Deep Q-Learning for Deterministic …

200 papers

Verification theorems are key results to successfully employ the dynamic programming approach to optimal control problems. In this paper we introduce a new method to prove verification theorems for infinite dimensional stochastic optimal…

Optimization and Control · Mathematics 2018-05-01 Salvatore Federico , Fausto Gozzi

This paper presents the optimal control and synchronization problem of a multilevel network of R\"ossler chaotic oscillators. Using the Hamilton-Jacobi-Bellman (HJB) technique, the optimal control law with three-state variables feedback is…

Optimization and Control · Mathematics 2022-10-18 Thierry Njougouo , Victor Camargo , Patrick Louodop , Fernando F Ferreira , Pierre K. Talla , Hilda A. Cerdeira

Since Peng (1993) established a local maximum principle for a general stochastic control problem governed by forward-backward stochastic differential equations (FBSDEs), the corresponding partial differential equation (PDE) characterization…

Optimization and Control · Mathematics 2025-08-07 Yuhong Xu , Shuzhen Yang

This paper introduces a novel methodology that leverages the Hamilton-Jacobi solution to enhance non-linear model predictive control (MPC) in scenarios affected by navigational uncertainty. Using Hamilton-Jacobi-Theoretic approach, a…

Optimization and Control · Mathematics 2025-04-01 Amit Jain , Roshan T. Eapen , Puneet Singla

We study optimal control problems governed by abstract infinite dimensional stochastic differential equations using the dynamic programming approach. In the first part, we prove Lipschitz continuity, semiconcavity and semiconvexity of the…

Optimization and Control · Mathematics 2025-02-27 Filippo de Feo , Andrzej Święch , Lukas Wessels

We propose a neural network approach for solving high-dimensional optimal control problems. In particular, we focus on multi-agent control problems with obstacle and collision avoidance. These problems immediately become high-dimensional,…

Optimization and Control · Mathematics 2022-05-05 Derek Onken , Levon Nurbekyan , Xingjian Li , Samy Wu Fung , Stanley Osher , Lars Ruthotto

Hamiltonian learning is a cornerstone for advancing accurate many-body simulations, improving quantum device performance, and enabling quantum-enhanced sensing. Existing readily deployable quantum metrology techniques primarily focus on…

Quantum Physics · Physics 2025-10-10 Suying Liu , Xiaodi Wu , Murphy Yuezhen Niu

Here, we study quantitative homogenization of first-order convex Hamilton-Jacobi equations with $(u/\varepsilon)$-periodic Hamiltonians which typically appear in dislocation dynamics. Firstly, we establish the optimal convergence rate by…

Analysis of PDEs · Mathematics 2025-07-02 Hiroyoshi Mitake , Panrui Ni , Hung V. Tran

We propose a neural network approach that yields approximate solutions for high-dimensional optimal control problems and demonstrate its effectiveness using examples from multi-agent path finding. Our approach yields controls in a feedback…

Optimization and Control · Mathematics 2022-06-29 Derek Onken , Levon Nurbekyan , Xingjian Li , Samy Wu Fung , Stanley Osher , Lars Ruthotto

The paper studies a system of first order Hamilton-Jacobi equations with discontinuous coefficients, arising from a model of deterministic optimal debt management in infinite time horizon, with exponential discount and currency devaluation.…

Optimization and Control · Mathematics 2021-02-09 Antonio Marigonda , Khai T. Nguyen

The paper deals with a class of time-inconsistent control problems for McKean-Vlasov dynamics. By solving a backward time-inconsistent Hamilton-Jacobi-Bellman (HJB for short) equation coupled with a forward distribution-dependent stochastic…

Optimization and Control · Mathematics 2020-02-18 Hongwei Mei , Chao Zhu

Learning optimal feedback control laws capable of executing optimal trajectories is essential for many robotic applications. Such policies can be learned using reinforcement learning or planned using optimal control. While reinforcement…

Machine Learning · Computer Science 2019-10-14 Michael Lutter , Boris Belousov , Kim Listmann , Debora Clever , Jan Peters

We investigate in this work a fully-discrete semi-Lagrangian approximation of second order possibly degenerate Hamilton-Jacobi-Bellman (HJB) equations on a bounded domain with oblique boundary conditions. These equations appear naturally in…

Numerical Analysis · Mathematics 2021-09-22 Elisa Calzola , Elisabetta Carlini , Xavier Dupuis , Francisco J. Silva

This note lays part of the theoretical ground for a definition of differential systems modeling reinforcement learning in continuous time non-Markovian rough environments. Specifically we focus on optimal relaxed control of rough equations…

Optimization and Control · Mathematics 2024-02-29 Prakash Chakraborty , Harsha Honnappa , Samy Tindel

A procedure for the numerical approximation of high-dimensional Hamilton-Jacobi-Bellman (HJB) equations associated to optimal feedback control problems for semilinear parabolic equations is proposed. Its main ingredients are a…

Optimization and Control · Mathematics 2019-02-08 Dante Kalise , Karl Kunisch

When randomness in demand affects the sales of a product, retailers use dynamic pricing strategies to maximize their profits. In this article, we formulate the pricing problem as a continuous-time stochastic optimal control problem and find…

Optimization and Control · Mathematics 2019-03-13 Asbjørn Nilsen Riseth

Optimal control and the associated second-order path-dependent Hamilton-Jacobi-Bellman (PHJB) equation are studied for unbounded functional stochastic evolution systems in Hilbert spaces. The notion of viscosity solution without…

Optimization and Control · Mathematics 2024-02-27 Shanjian Tang , Jianjun Zhou

Devising optimal interventions for diffusive systems often requires the solution of the Hamilton-Jacobi-Bellman (HJB) equation, a nonlinear backward partial differential equation (PDE), that is, in general, nontrivial to solve. Existing…

Statistical Mechanics · Physics 2022-10-18 Dimitra Maoutsa , Manfred Opper

Hamilton-Jacobi (HJ) reachability analysis is a widely used method for ensuring the safety of robotic systems. Traditional approaches compute reachable sets by numerically solving an HJ Partial Differential Equation (PDE) over a grid, which…

Robotics · Computer Science 2025-05-08 Zeyuan Feng , Le Qiu , Somil Bansal

In this manuscript we consider a class optimal control problem for stochastic differential delay equations. First, we rewrite the problem in a suitable infinite-dimensional Hilbert space. Then, using the dynamic programming approach, we…

Optimization and Control · Mathematics 2023-02-20 Filippo de Feo , Salvatore Federico , Andrzej Święch