Related papers: Discrete variational principles and Hamilton-Jacob…
This paper considers linear-quadratic control of a non-linear dynamical system subject to arbitrary cost. I show that for this class of stochastic control problems the non-linear Hamilton-Jacobi-Bellman equation can be transformed into a…
In this study, Hamiltonian and Lagrangian theories, which are mathematical models of mechanical systems, are structured on the horizontal and the vertical distributions of tangent and cotangent bundles. In the end, the geometrical and…
We address the design and synthesis of optimal control strategies for high-dimensional stochastic dynamical systems. Such systems may be deterministic nonlinear systems evolving from random initial states, or systems driven by random…
This work conducts a Hamilton-Jacobi analysis of classical dynamical systems with internal constraints. We examine four systems, all previously analyzed by David Brown: three with familiar components (point masses, springs, rods, ropes, and…
We consider Hamiltonian systems in first-order multisymplectic field theories. We review the properties of Hamiltonian systems in the so-called restricted multimomentum bundle, including the variational principle which leads to the…
The Hamilton-Jacobi problem is revisited bearing in mind the consequences arising from a possible bi-Hamiltonian structure. The problem is formulated on the tangent bundle for Lagrangian systems in order to avoid the bias of the existence…
This paper develops a structure-preserving numerical integration scheme for a class of higher-order mechanical systems. The dynamics of these systems are governed by invariant variational principles defined on higher-order tangent bundles…
We study the connection between Lagrangian and Hamiltonian descriptions of closed/open dynamics, for a collection of particles with quadratic interaction (closed system) and a sub-collection of particles with linear damping (open system).…
This paper firstly presents the necessary and sufficient conditions for a kind of discrete-time robust stochastic optimal control problem with convex control domains. As it is an "inf sup problem", the classical variational method is…
In this paper, the optimal control for discrete-time systems driven by fractional noises is studied. A stochastic maximum principle is obtained by introducing a backward stochastic difference equation contains both fractional noises and the…
Numerical methods that preserves geometric invariants of the system such as energy, momentum and symplectic form, are called geometric integrators. These include variational integrators as an important subclass of geometric integrators. The…
Hybrid dynamical systems are systems which undergo both continuous and discrete transitions. The Bolza problem from optimal control theory was applied to these systems and a hybrid version of Pontryagin's maximum principle was presented.…
Models involving hybrid systems are versatile in their application but difficult to optimize efficiently due to their combinatorial nature. This work presents a method to cope with hybrid optimal control problems which, in contrast to…
Hamiltonian systems are differential equations which describe systems in classical mechanics, plasma physics, and sampling problems. They exhibit many structural properties, such as a lack of attractors and the presence of conservation…
In this paper we present a new algorithm for the solution of Hamilton-Jacobi-Bellman equations related to optimal control problems. The key idea is to divide the domain of computation into subdomains which are shaped by the optimal dynamics…
Extremal principles can generally be divided into two rather distinct classes. There are, on the one hand side, formulations based on the Lagrangian or Hamiltonian mechanics, respectively, dealing with time dependent problems, but…
In this work, we consider optimal control problems for mechanical systems on vector spaces with fixed initial and free final state and a quadratic Lagrange term. Specifically, the dynamics is described by a second order ODE containing an…
In the context of optimal control, we consider the inverse problem of Lagrangian identification given system dynamics and optimal trajectories. Many of its theoretical and practical aspects are still open. Potential applications are very…
A proposal for the Hamilton-Jacobi theory in the context of the covariant formulation of Hamiltonian systems is done. The current approach consists in applying Dirac's method to the corresponding action which implies the inclusion of…
In this note, we develop the first-order theory of optimal control problems with box constraints on the control. We emphasize the precise modification of Pontryagin's maximum principle when the admissible control set is compact, the…