Related papers: Discrete Hamilton-Jacobi Theory
In this paper we present a general framework that allows one to study discretization of certain dynamical systems. This generalizes earlier work on discretization of Lagrangian and Hamiltonian systems on tangent bundles and cotangent…
In this paper, we review the discrete Hamilton--Jacobi theory from a geometric point of view. In the discrete realm, the usual geometric interpretation of the Hamilton--Jacobi theory in terms of vector fields is not straightforward. Here,…
In this paper, we propose a discrete Hamilton--Jacobi theory for (discrete) Hamiltonian dynamics defined on a (discrete) contact manifold. To this end, we first provide a novel geometric Hamilton--Jacobi theory for continuous contact…
We establish existence and uniqueness of minimax solutions for a fairly general class of path-dependent Hamilton-Jacobi equations. In particular, the relevant Hamiltonians can contain the solution and they only need to be measurable with…
This paper is devoted to discrete mechanical systems subject to external forces. We introduce a discrete version of systems with Rayleigh-type forces, obtain the equations of motion and characterize the equivalence for these systems.…
The control of relaxation-type systems of ordinary differential equations is investigated using the Hamilton-Jacobi-Bellman equation. First, we recast the model as a singularly perturbed dynamics which we embed in a family of controlled…
In this paper, we propose Q-learning algorithms for continuous-time deterministic optimal control problems with Lipschitz continuous controls. Our method is based on a new class of Hamilton-Jacobi-Bellman (HJB) equations derived from…
The geometric framework for the Hamilton-Jacobi theory is used to study this theory in the ambient of higher-order mechanical systems, both in the Lagrangian and Hamiltonian formalisms. Thus, we state the corresponding Hamilton-Jacobi…
This paper proposes a new framework to model control systems in which a dynamic friction occurs. The model consists in a controlled differential inclusion with a discontinuous right hand side, which still preserves existence and uniqueness…
Hamilton-Jacobi partial differential equations (HJ PDEs) have deep connections with a wide range of fields, including optimal control, differential games, and imaging sciences. By considering the time variable to be a higher dimensional…
In this paper, we apply the geometric Hamilton--Jacobi theory to obtain solutions of Hamiltonian systems in Classical Mechanics, that are either compatible with a cosymplectic or a contact structure. As it is well known, the first structure…
In this paper, we investigate the numerical approximation of Hamilton-Jacobi equations with the Caputo time-fractional derivative. We introduce an explicit in time discretization of the Caputo derivative and a finite difference scheme for…
The geometric framework for the Hamilton-Jacobi theory developed in previous works is extended for multisymplectic first-order classical field theories. The Hamilton-Jacobi problem is stated for the Lagrangian and the Hamiltonian formalisms…
Systems of Hamilton-Jacobi equations arise naturally when we study the optimal control problems with pathwise deterministic trajectories with random switching. In this work, we are interested in the large time behavior of weakly coupled…
A general time-inconsistent optimal control problem is considered for stochastic differential equations with deterministic coefficients. Under suitable conditions, a Hamilton-Jacobi-Bellman type equation is derived for the equilibrium value…
We propose a new probabilistic numerical scheme for fully nonlinear equation of Hamilton-Jacobi-Bellman (HJB) type associated to stochastic control problem, which is based on the Feynman-Kac representation in [12] by means of control…
Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution…
In this paper, we study the integrability of contact Hamiltonian systems, both time-dependent and independent. In order to do so, we construct a Hamilton--Jacobi theory for these systems following two approaches, obtaining two different…
We study the structure of a simple dynamic optimization problem consisting of one state and one control variable, from a physicist's point of view. By using an analogy to a physical model, we study this system in the classical and quantum…
A generalization of the Hamilton-Jacobi theory to arbitrary dynamical systems, including non-Hamiltonian ones, is considered. The generalized Hamilton-Jacobi theory is constructed as a theory of ensemble of identical systems moving in the…