Related papers: Discrete Hamilton-Jacobi Theory
We reconsider the variational integration of optimal control problems for mechanical systems based on a direct discretization of the Lagrange-d'Alembert principle. This approach yields discrete dynamical constraints which by construction…
We consider the simplest example of a time-dependent first order Hamilton-Jacobi equation, in one space dimension and with a bounded and Lipschitz continuous Hamiltonian which only depends on the spatial derivative. We show that if the…
We consider an infinite horizon control problem for dynamics constrained to remain on a multidimensional junction with entry costs. We derive the associated system of Hamilton-Jacobi equations (HJ), prove the comparison principle and that…
In this paper, some of formulations of Hamilton-Jacobi equations for Hamiltonian system and regular reduced Hamiltonian systems are given. At first, an important lemma is proved, and it is a modification for the corresponding result of…
In this paper, we study the optimal singular controls for stochastic recursive systems, in which the control has two components: the regular control, and the singular control. Under certain assumptions, we establish the dynamic programming…
We study a stochastic control problem on a bounded domain, which arises from a continuous-time optimal management model. Via the corresponding Hamilton-Jacobi-Bellman equation the value function is shown to be jointly continuous and to…
This paper considers linear-quadratic control of a non-linear dynamical system subject to arbitrary cost. I show that for this class of stochastic control problems the non-linear Hamilton-Jacobi-Bellman equation can be transformed into a…
We study the convergence rates of policy iteration (PI) for nonconvex viscous Hamilton--Jacobi equations using a discrete space-time scheme, where both space and time variables are discretized. We analyze the case with an uncontrolled…
We consider a numerical scheme for Hamilton-Jacobi equations based on a direct discretization of the Lax-Oleinik semi-group. We prove that this method is convergent with respect to the time and space stepsizes provided the solution is…
In this paper we aim at presenting a concise but also comprehensive study of time-dependent (tdependent) Hamiltonian dynamics on a locally conformal symplectic (lcs) manifold. We present a generalized geometric theory of canonical…
We propose a new way to perform path integrals in quantum mechanics by using a quantum version of Hamilton-Jacobi theory. In classical mechanics, Hamilton-Jacobi theory is a powerful formalism, however, its utility is not explored in…
In this article, we study the large time behavior of solutions of first-order Hamilton-Jacobi Equations, set in a bounded domain with nonlinear Neumann boundary conditions, including the case of dynamical boundary conditions. We establish…
In this work we study the theory of linearized gravity via the Hamilton-Jacobi formalism. We make a brief review of this theory and its Lagrangian description, as well as a review of the Hamilton-Jacobi approach for singular systems. Then…
We introduce a new machinery to study the large time behavior for general classes of Hamilton--Jacobi type equations, which include degenerate parabolic equations and weakly coupled systems. We establish the convergence results by using the…
We present a simple and easy to implement method for the numerical solution of a rather general class of Hamilton-Jacobi-Bellman (HJB) equations. In many cases, the considered problems have only a viscosity solution, to which, fortunately,…
We develop a class of C1-continuous time integration methods that are applicable to conservative problems in elastodynamics. These methods are based on Hamilton's law of varying action. From the action of the continuous system we derive a…
This is the first in a series of papers in which we study an efficient approximation scheme for solving the Hamilton-Jacobi-Bellman equation for multi-dimensional problems in stochastic control theory. The method is a combination of a WKB…
In this paper, a stochastic optimal control problem is investigated in which the system is governed by a stochastic functional differential equation. In the framework of functional It\^o calculus, we build the dynamic programming principle…
Designing optimal controllers for nonlinear dynamical systems often relies on reinforcement learning and adaptive dynamic programming (ADP) to approximate solutions of the Hamilton Jacobi Bellman (HJB) equation. However, these methods…
We consider a finite-time stochastic drift control problem with the assumption that the control is bounded and the system is controlled until the state process leaves the half-line. Assuming general conditions, it is proved that the…