English
Related papers

Related papers: Fast symplectic integrator for Nesterov-type accel…

200 papers

In this work we propose a differential geometric motivation for Nesterov's accelerated gradient method (AGM) for strongly-convex problems. By considering the optimization procedure as occurring on a Riemannian manifold with a natural…

Machine Learning · Computer Science 2019-11-21 Aaron Defazio

The existence of explicit symplectic integrators for general nonseparable Hamiltonian systems is an open and important problem in both numerical analysis and computing in science and engineering, as explicit integrators are usually more…

Numerical Analysis · Mathematics 2025-04-18 Lijie Mei , Xinyuan Wu , Yaolin Jiang

Recent research on accelerated gradient methods of use in optimization has demonstrated that these methods can be derived as discretizations of dynamical systems. This, in turn, has provided a basis for more systematic investigations,…

Optimization and Control · Mathematics 2022-10-18 Alessandro Bravetti , Maria L. Daza-Torres , Hugo Flores-Arguedas , Michael Betancourt

The rapid advancements in high-dimensional statistics and machine learning have increased the use of first-order methods. Many of these methods can be regarded as instances of the proximal point algorithm. Given the importance of the…

Optimization and Control · Mathematics 2024-11-05 Ya-xiang Yuan , Yi Zhang

We present a new symplectic integrator designed for collisional gravitational $N$-body problems which makes use of Kepler solvers. The integrator is also reversible and conserves 9 integrals of motion of the $N$-body problem to machine…

Instrumentation and Methods for Astrophysics · Physics 2017-03-03 David M. Hernandez , Edmund Bertschinger

We study the instability properties of Nesterov's ODE in non-conservative settings, where the driving term is not necessarily the gradient of a potential function. While convergence properties under Nesterov's ODE are well-characterized for…

Optimization and Control · Mathematics 2025-10-09 Daniel E. Ochoa , Mahmoud Abdelgalil , Jorge I. Poveda

Hamiltonian systems are differential equations which describe systems in classical mechanics, plasma physics, and sampling problems. They exhibit many structural properties, such as a lack of attractors and the presence of conservation…

Numerical Analysis · Mathematics 2022-01-14 Christian Offen , Sina Ober-Blöbaum

We implement and investigate the numerical properties of a new family of integrators connecting both variants of the symplectic Euler schemes, and including an alternative to the classical symplectic mid-point scheme, with some additional…

Numerical Analysis · Mathematics 2015-08-14 Hugo Jiménez-Pérez , Jean-Pierre Vilotte , Barbara Romanowicz

We study symplectic numerical integration of mechanical systems with a Hamiltonian specified in non-canonical coordinates and its application to guiding-center motion of charged plasma particles in magnetic confinement devices. The…

Computational Physics · Physics 2020-01-29 Christopher G. Albert , Sergei V. Kasilov , Winfried Kernbichler

The kinetic term of the $N$-body Hamiltonian system defined on the surface of the sphere is non-separable. As a result, standard explicit symplectic integrators are inapplicable. We exploit an underlying hierarchy in the structure of the…

Numerical Analysis · Mathematics 2021-04-23 Ana Silva , Eitan Ben Av , Efi Efrati

We present a multiscale integrator for Hamiltonian systems with slowly varying quadratic stiff potentials that uses coarse timesteps (analogous to what the impulse method uses for constant quadratic stiff potentials). This method is based…

Numerical Analysis · Mathematics 2011-04-14 Molei Tao , Houman Owhadi , Jerrold E. Marsden

Dependable numerical results from long-time simulations require stable numerical integration schemes. For Hamiltonian systems, this is achieved with symplectic integrators, which conserve the symplectic condition and exactly solve for the…

Plasma Physics · Physics 2015-06-17 Stephen D. Webb

We present a class of symplectic integrators adapted for the integration of perturbed Hamiltonian systems of the form $H=A+\epsilon B$. We give a constructive proof that for all integer $p$, there exists an integrator with positive steps…

Astrophysics · Physics 2023-07-19 J. Laskar , P. Robutel

We prove a Nekhoroshev-type theorem for nearly integrable symplectic map. As an application of the theorem, we obtain the exponential stability symplectic algorithms. Meanwhile, we can get the bounds for the perturbation, the variation of…

Dynamical Systems · Mathematics 2018-05-10 Zhaodong Ding , Zaijiu Shang , Bo Xie

A new method is proposed for integrating the equations of motion of an elastic filament. In the standard finite-difference and finite-element formulations the continuum equations of motion are discretized in space and time, but it is then…

Computational Physics · Physics 2009-11-13 Anthony JC Ladd , Gaurav Misra

Accelerated gradient methods have had significant impact in machine learning -- in particular the theoretical side of machine learning -- due to their ability to achieve oracle lower bounds. But their heuristic construction has hindered…

Computation · Statistics 2018-02-16 Michael Betancourt , Michael I. Jordan , Ashia C. Wilson

Viewing optimization methods as numerical integrators for ordinary differential equations (ODEs) provides a thought-provoking modern framework for studying accelerated first-order optimizers. In this literature, acceleration is often…

Optimization and Control · Mathematics 2021-02-24 Peiyuan Zhang , Antonio Orvieto , Hadi Daneshmand , Thomas Hofmann , Roy Smith

We construct a symplectic integrator for non-separable Hamiltonian systems combining an extended phase space approach of Pihajoki and the symmetric projection method. The resulting method is semiexplicit in the sense that the main time…

Numerical Analysis · Mathematics 2023-03-24 Buddhika Jayawardana , Tomoki Ohsawa

Symplectic integrators are a foundation to the study of dynamical $N$-body phenomena, at scales ranging from from planetary to cosmological. These integrators preserve the Poincar\'e invariants of Hamiltonian dynamics. The $N$-body…

Earth and Planetary Astrophysics · Physics 2019-10-09 David M. Hernandez

We propose to use the properties of the Lie algebra of the angular momentum to build symplectic integrators dedicated to the Hamiltonian of the free rigid body. By introducing a dependence of the coefficients of integrators on the moments…

Instrumentation and Methods for Astrophysics · Physics 2019-05-07 J. Laskar , T. Vaillant