Related papers: From Adam to Adam-Like Lagrangians: Second-Order N…
Adam has achieved strong empirical success, but its theory remains incomplete even in the deterministic full-batch setting, largely because adaptive preconditioning and momentum are tightly coupled. In this work, a convergent reformulation…
In this paper, we propose in a Hilbertian setting a second-order time-continuous dynamic system with fast convergence guarantees to solve structured convex minimization problems with an affine constraint. The system is associated with the…
We analyze the relation between the concept of auxiliary variables and the Inverse problem of the calculus of variations to construct a Lagrangian from a given set of equations of motion. The problem of the construction of a consistent…
I consider Lagrangians which depend nonlocally in time but in such a way that there is no mixing between times differing by more than some finite value $\Delta t$. By considering these systems as the limits of ever higher derivative…
Acceleration-induced nonlocality and the corresponding Lorentz-invariant nonlocal field equations of accelerated systems in Minkowski spacetime are discussed. Under physically reasonable conditions, the nonlocal equation of motion of the…
We study Lagrangian systems with a finite number of degrees of freedom that are non-local in time. We obtain an extension of Noether theorem and Noether identities to this kind of Lagrangians. A Hamiltonian formalism is then set up for this…
We develop a time-non-local (TNL) formalism based on variational calculus, which allows for the analysis of TNL Lagrangians. We derive the generalized Euler-Lagrange equations starting from the Hamilton's principle and, by defining a…
Using Dirac's approach to constrained dynamics, the Hamiltonian formulation of regular higher order Lagrangians is developed. The conventional description of such systems due to Ostrogradsky is recovered. However, unlike the latter, the…
This thesis aims to study nonlocal Lagrangians with a finite and an infinite number of degrees of freedom. We obtain an extension of Noether's theorem and Noether's identities for such Lagrangians. We then set up a Hamiltonian formalism for…
Adam-type algorithms have become a preferred choice for optimisation in the deep learning setting, however, despite success, their convergence is still not well understood. To this end, we introduce a unified framework for Adam-type…
We introduce the concept of a "transitory" dynamical system---one whose time-dependence is confined to a compact interval---and show how to quantify transport between two-dimensional Lagrangian coherent structures for the Hamiltonian case.…
We introduce a Hamiltonian framework for nonlocal Lagrangian systems without relying on infinite-derivative expansions. Starting from a (trajectory-based) variational principle and a generalized Noether theorem, we define the canonical…
A time-fractional Allen-Cahn equation with volume constraint is first proposed by introducing a nonlocal time-dependent Lagrange multiplier. Adaptive linear second-order energy stable schemes are developed for the proposed model by…
We derive the dynamics of several rigid bodies of arbitrary shape in a 2-dimensional inviscid and incompressible fluid, whose vorticity field is given by point vortices. We adopt the idea of Vankerschaver et al. (2009) to derive the…
In this paper, we present a Lagrangian formalism for nonequilibrium thermodynamics. This formalism is an extension of the Hamilton principle in classical mechanics that allows the inclusion of irreversible phenomena in both discrete and…
Non-standard Lagrangians do not display any discernible energy-like terms, yet they give the same equations of motion as standard Lagrangians, which have easily identifiable energy-like terms. A new method to derive non-standard Lagrangians…
We consider a class of Lagrangians that depend not only on some configurational variables and their first time derivatives, but also on second time derivatives, thereby leading to fourth-order evolution equations. The proposed higher-order…
In this paper, we propose a continuous-time formulation for the AdaGrad, RMSProp, and Adam optimization algorithms by modeling them as first-order integro-differential equations. We perform numerical simulations of these equations, along…
We study the constrained Ostrogradski-Hamilton framework for the equations of motion provided by mechanical systems described by second-order derivative actions with a linear dependence in the accelerations. We stress out the peculiar…
We investigate the dynamics of labial constriction trajectories during the production of /b/ and /m/ in English and Mandarin. We find that, across languages and contexts, the ratio of instantaneous displacement to instantaneous velocity…