Related papers: From Adam to Adam-Like Lagrangians: Second-Order N…
In this paper, we revisit the augmented Lagrangian method for a class of nonsmooth convex optimization. We present the Lagrange optimality system of the augmented Lagrangian associated with the problems, and establish its connections with…
The n-dimensional extension of the one dimensional Position-dependent mass (PDM) Lagrangians under the nonlocal point transformations by Mustafa <cite>38</cite> is introduced. The invariance of the n-dimensional PDM Euler-Lagrange equations…
Adaptive gradient optimization methods, such as Adam, are prevalent in training deep neural networks across diverse machine learning tasks due to their ability to achieve faster convergence. However, these methods often suffer from…
This article includes a short survey of selected averaging and dimension reduction techniques for deterministic fast-slow systems. This survey includes, among others, classical techniques, such as the WKB approximation or the averaging…
A simple general theorem is used as a tool that generates nonlocal constants of motion for Lagrangian systems. We review some cases where the constants that we find are useful in the study of the systems: the homogeneous potentials of…
In this paper, we survey our recent results on the variational formulation of nonequilibrium thermodynamics for the finite dimensional case of discrete systems as well as for the infinite dimensional case of continuum systems. Starting with…
We prove that higher-derivative and genuinely nonlocal Lagrangian systems can be Lyapunov-stable even when their Hamiltonians lack a lower bound. Explicit free and coupled Pais-Uhlenbeck oscillators, together with a genuine nonlocal model,…
We propose a novel second-order ODE as the continuous-time limit of a Riemannian accelerated gradient-based method on a manifold with curvature bounded from below. This ODE can be seen as a generalization of the ODE derived for Euclidean…
The first-order optimality conditions for a generic nonlinear optimization problem are generated as part of the terminal transversality conditions of an optimal control problem. It is shown that the Lagrangian of the optimization problem is…
Simulating nonlinear classical dynamics on a quantum computer is an inherently challenging task due to the linear operator formulation of quantum mechanics. In this work, we provide a systematic approach to alleviate this difficulty by…
We develop a method for systematically constructing Lagrangian functions for dissipative mechanical, electrical and, mechatronic systems. We derive the equations of motion for some typical mechatronic systems using deterministic principles…
An interlaced method to learn and control nonlinear system dynamics from a set of demonstrations is proposed, under a constrained optimization framework for the unsupervised learning process. The nonlinear system is modelled as a mixture of…
We develop two new variants of alternating direction methods of multipliers (ADMM) and two parallel primal-dual decomposition algorithms to solve a wide range class of constrained convex optimization problems. Our approach relies on a novel…
In this paper, we study all transport coefficients of second-order dissipative fluid dynamics derived by V. E. Ambrus et al. [Phys. Rev. D 106, 076005 (2022)] from the relativistic Boltzmann equation in the relaxation-time approximation for…
We introduce a class of non-local Lagrangians which allow for the variational derivation of non-local conser- vation laws in a self-consistent manner. The formalism developed here generalizes previous approaches, used in the context of…
Adam is widely adopted in practical applications due to its fast convergence. However, its theoretical analysis is still far from satisfactory. Existing convergence analyses for Adam rely on the bounded smoothness assumption, referred to as…
This paper addresses problems of second-order cone programming important in optimization theory and applications. The main attention is paid to the augmented Lagrangian method (ALM) for such problems considered in both exact and inexact…
In this article, we present a brief overview of some of the recent progress made in identifying and generating finite dimensional integrable nonlinear dynamical systems, exhibiting interesting oscillatory and other solution properties,…
We extensively develop a perturbation theory for nonlinear cosmological dynamics, based on the Lagrangian description of hydrodynamics. We solve hydrodynamic equations for a self-gravitating fluid with pressure, given by a polytropic…
The existence of a Lagrangian description for the second-order Riccati equation is analyzed and the results are applied to the study of two different nonlinear systems both related with the generalized Riccati equation. The Lagrangians are…