Related papers: Discrete Hamilton-Jacobi Theory
In this note, we discuss a class of time-dependent Hamilton-Jacobi equations depending on a function of time, this function being chosen in order to keep the maximum of the solution to the constant value 0. The main result of the note is…
We establish a well-posedness and error-estimation framework that solves Hamilton-Jacobi equations by minimizing the least-squares residual of monotone finite-difference discretizations. This approach also applies naturally to second-order…
We investigate a singular perturbation for Hamilton-Jacobi equations in an open subset of two dimensional Euclidean space, where the set is determined through a Hamiltonian function and the Hamilton-Jacobi equations are the dynamic…
This paper is concerned with a stochastic recursive optimal control problem with time delay, where the controlled system is described by a stochastic differential delayed equation (SDDE) and the cost functional is formulated as the solution…
We propose a new numerical method for solving the Hamilton-Jacobi-Bellman quasi-variational inequality associated with the combined impulse and stochastic optimal control problem over a finite time horizon. Our method corresponds to an…
In this paper we consider a class of conjugate discrete-time Riccati equations, arising originally from the linear quadratic regulation problem for discrete-time antilinear systems. Under some mild assumptions and the framework of the…
We study the optimal control of path-dependent piecewise deterministic processes. An appropriate dynamic programming principle is established. We prove that the associated value function is the unique minimax solution of the corresponding…
In this paper, we propose a geometric Hamilton-Jacobi theory for systems of implicit differential equations. In particular, we are interested in implicit Hamiltonian systems, described in terms of Lagrangian submanifolds of $TT^*Q$…
We extend some aspects of the Hamilton-Jacobi theory to the category of stochastic Hamiltonian dynamical systems. More specifically, we show that the stochastic action satisfies the Hamilton-Jacobi equation when, as in the classical…
The rarely used Hamilton-Jacobi equation has been utilized as an elegant way to find the trajectories of mechanical systems and to derive symplectic maps. Further, the exact solution in kick approximation of Hamilton's equations of motion…
In this paper we develop a Hamilton-Jacobi theory in the setting of almost Poisson manifolds. The theory extends the classical Hamilton-Jacobi theory and can be also applied to very general situations including nonholonomic mechanical…
The optimal control of a mechanical system is of crucial importance in many realms. Typical examples are the determination of a time-minimal path in vehicle dynamics, a minimal energy trajectory in space mission design, or optimal motion…
We present a new setting of the geometric Hamilton-Jacobi theory by using the so-called time-evolution operator K. This new approach unifies both the Lagrangian and the Hamiltonian formulation of the problem developed in a previous paper…
Main objects of the paper are stationary and weak KAM Hamilton-Jacobi equations on the finite-dimensional torus. The key idea of the paper is to replace the underlying calculus of variations problems with continuous time Markov decision…
This paper investigates the convergence properties of the upwind difference scheme for the Hamilton--Jacobi--Bellman (HJB) equation, a central partial differential equation in optimal control theory. First, assuming the existence of a…
In this paper, we construct Hamilton-Jacobi equations for a great variety of mechanical systems (nonholonomic systems subjected to linear or affine constraints, dissipative systems subjected to external forces, time-dependent mechanical…
For continuous systems modeled by dynamical equations such as ODEs and SDEs, Bellman's Principle of Optimality takes the form of the Hamilton-Jacobi-Bellman (HJB) equation, which provides the theoretical target of reinforcement learning…
In this article, we provide a numerical method based on fitted finite volume method to approximate the Hamilton-Jacobi-Bellman (HJB) equation coming from stochastic optimal control problems. The computational challenge is due to the nature…
We discuss an extension of the Hamilton-Jacobi theory to nonholonomic mechanics with a particular interest in its application to exactly integrating the equations of motion. We give an intrinsic proof of a nonholonomic analogue of the…
This paper presents a mathematical formulation to perform temporal parallelisation of continuous-time optimal control problems, which can be solved via the Hamilton--Jacobi--Bellman (HJB) equation. We divide the time interval of the control…