English
Related papers

Related papers: Accelerated Optimization on Riemannian Manifolds v…

200 papers

Stochastic gradient methods (SGMs) have been widely used for solving stochastic optimization problems. A majority of existing works assume no constraints or easy-to-project constraints. In this paper, we consider convex stochastic…

Optimization and Control · Mathematics 2022-01-03 Yonggui Yan , Yangyang Xu

This paper proposes an interior-point framework for constrained optimization problems whose decision variables evolve on matrix Lie groups. The proposed method, termed the Matrix Lie Group Interior-Point Method (MLG-IPM), operates directly…

Optimization and Control · Mathematics 2026-03-31 Aclécio J. Santos , Jean C. Pereira , Guilherme V. Raffo

We propose to use the properties of the Lie algebra of the angular momentum to build symplectic integrators dedicated to the Hamiltonian of the free rigid body. By introducing a dependence of the coefficients of integrators on the moments…

Instrumentation and Methods for Astrophysics · Physics 2019-05-07 J. Laskar , T. Vaillant

We study the convergence rate of Bregman gradient methods for convex optimization in the space of measures on a $d$-dimensional manifold. Under basic regularity assumptions, we show that the suboptimality gap at iteration $k$ is in…

Optimization and Control · Mathematics 2023-03-15 Lénaïc Chizat

Stochastic optimisation in Riemannian manifolds, especially the Riemannian stochastic gradient method, has attracted much recent attention. The present work applies stochastic optimisation to the task of recursive estimation of a…

Statistics Theory · Mathematics 2020-01-08 Jialun Zhou , Salem Said

Generating motions for robots interacting with objects of various shapes is a complex challenge, further complicated by the robot geometry and multiple desired behaviors. While current robot programming tools (such as inverse kinematics,…

Robotics · Computer Science 2025-06-19 Xuemin Chi , Hakan Girgin , Tobias Löw , Yangyang Xie , Teng Xue , Jihao Huang , Cheng Hu , Zhitao Liu , Sylvain Calinon

We investigate a distributed optimization problem over a cooperative multi-agent time-varying network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-24 Chuanye Gu , Zhiyou Wu , Jueyou Li

Formation control of autonomous agents can be seen as a physical system of individuals interacting with local potentials, and whose evolution can be described by a Lagrangian function. In this paper, we construct and implement forced…

Systems and Control · Electrical Eng. & Systems 2020-10-02 Leonardo Colombo , Hector Garcia de Marina

The techniques and analysis presented in this paper provide new methods to solve optimization problems posed on Riemannian manifolds. A new point of view is offered for the solution of constrained optimization problems. Some classical…

Optimization and Control · Mathematics 2018-04-12 Steven Thomas Smith

In this paper, we propose new accelerated methods for smooth convex optimization, called contracting proximal methods. At every step of these methods, we need to minimize a contracted version of the objective function augmented by a…

Optimization and Control · Mathematics 2021-05-21 Nikita Doikov , Yurii Nesterov

Accelerated gradient methods play a central role in optimization, achieving optimal rates in many settings. While many generalizations and extensions of Nesterov's original acceleration method have been proposed, it is not yet clear what is…

Optimization and Control · Mathematics 2022-06-08 Andre Wibisono , Ashia C. Wilson , Michael I. Jordan

An implicit mass-matrix penalization (IMMP) of Hamiltonian dynamics is proposed, and associated dynamical integrators, as well as sampling Monte-Carlo schemes, are analyzed for systems with multiple time scales. The penalization is based on…

Numerical Analysis · Mathematics 2009-06-01 Petr Plechac , Mathias Rousset

Riemannian manifold Hamiltonian Monte Carlo (RMHMC) is a sampling algorithm that seeks to adapt proposals to the local geometry of the posterior distribution. The specific form of the Hamiltonian used in RMHMC necessitates {\it…

Computation · Statistics 2021-11-22 James A. Brofos , Roy R. Lederman

The work explores a specific scenario for structural computational optimization based on the following elements: (a) a relaxed optimization setting considering the ersatz (bi-material) approximation, (b) a treatment based on a nonsmoothed…

Computational Engineering, Finance, and Science · Computer Science 2021-08-06 J. Oliver , D. Yago , J. Cante , O. Lloberas-Valls

In this work we investigate the practicality of stochastic gradient descent and recently introduced variants with variance-reduction techniques in imaging inverse problems. Such algorithms have been shown in the machine learning literature…

Optimization and Control · Mathematics 2021-01-26 Junqi Tang , Karen Egiazarian , Mohammad Golbabaee , Mike Davies

We introduce a new approach to develop stochastic optimization algorithms for a class of stochastic composite and possibly nonconvex optimization problems. The main idea is to combine two stochastic estimators to create a new hybrid one. We…

Optimization and Control · Mathematics 2020-05-05 Quoc Tran-Dinh , Nhan H. Pham , Dzung T. Phan , Lam M. Nguyen

We show that symplectic and linearly-implicit integrators proposed by [Zhang and Skeel, 1997] are variational linearizations of Newmark methods. When used in conjunction with penalty methods (i.e., methods that replace constraints by stiff…

Numerical Analysis · Mathematics 2014-12-08 Molei Tao , Houman Owhadi

The time evolution of quantum many-body systems is one of the most promising applications for near-term quantum computers. However, the utility of current quantum devices is strongly hampered by the proliferation of hardware errors. The…

Quantum Physics · Physics 2024-05-21 Maurits S. J. Tepaske , David J. Luitz , Dominik Hahn

We significantly enhance the simulation accuracy of initial Trotter circuits for Hamiltonian simulation of quantum systems by integrating first-order Riemannian optimization with tensor network methods. Unlike previous approaches, our…

Quantum Physics · Physics 2025-12-30 Isabel Nha Minh Le , Shuo Sun , Christian B. Mendl

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg