Optimal $H_{\infty}$ control based on stable manifold of discounted Hamilton-Jacobi-Isaacs equation
Abstract
The optimal control problem over an infinite time horizon, which incorporates a performance function with a discount factor (), is important in various fields. Solving this optimal control problem is equivalent to addressing a discounted Hamilton-Jacobi-Isaacs (HJI) partial differential equation. In this paper, we first provide a precise estimate for the discount factor that ensures the existence of a nonnegative stabilizing solution to the HJI equation. This stabilizing solution corresponds to the stable manifold of the characteristic system of the HJI equation, which is a contact Hamiltonian system due to the presence of the discount factor. Secondly, we demonstrate that approximating the optimal controller in a natural manner results in a closed-loop system with a finite -gain that is nearly less than the gain of the original system. Thirdly, based on the theoretical results obtained, we propose a deep learning algorithm to approximate the optimal controller using the stable manifold of the contact Hamiltonian system associated with the HJI equation. Finally, we apply our method to the control of the Allen-Cahn equation to illustrate its effectiveness.
Keywords
Cite
@article{arxiv.2410.02272,
title = {Optimal $H_{\infty}$ control based on stable manifold of discounted Hamilton-Jacobi-Isaacs equation},
author = {Guoyuan Chen and Yi Wang and Qinglong Zhou},
journal= {arXiv preprint arXiv:2410.02272},
year = {2024}
}