English
Related papers

Related papers: Understanding Riemannian Acceleration via a Proxim…

200 papers

We introduce a unified framework for iterative reasoning that leverages non-Euclidean geometry via Bregman divergences, higher-order operator averaging, and adaptive feedback mechanisms. Our analysis establishes that, under mild smoothness…

Machine Learning · Computer Science 2025-02-07 Jacob Fein-Ashley

Shape optimization is of great significance in structural engineering, as an efficient geometry leads to better performance of structures. However, the application of gradient-based shape optimization for structural and architectural design…

Mathematical Software · Computer Science 2023-06-30 Gaoyuan Wu

In this paper, we propose an efficient and flexible algorithm to solve dynamic mean-field planning problems based on an accelerated proximal gradient method. Besides an easy-to-implement gradient descent step in this algorithm, a crucial…

Optimization and Control · Mathematics 2021-03-01 Jiajia Yu , Rongjie Lai , Wuchen Li , Stanley Osher

Data-driven Riemannian geometry has emerged as a powerful tool for interpretable representation learning, offering improved efficiency in downstream tasks. Moving forward, it is crucial to balance cheap manifold mappings with efficient…

Machine Learning · Computer Science 2025-05-26 Willem Diepeveen , Georgios Batzolis , Zakhar Shumaylov , Carola-Bibiane Schönlieb

We consider the proximal gradient method on Riemannian manifolds for functions that are possibly not geodesically convex. Starting from the forward-backward-splitting, we define an intrinsic variant of the proximal gradient method that uses…

Optimization and Control · Mathematics 2025-06-12 Ronny Bergmann , Hajg Jasa , Paula John , Max Pfeffer

In this paper, we extend the proximal point algorithm for vector optimization from the Euclidean space to the Riemannian context. Under suitable assumptions on the objective function the well definition and full convergence of the method to…

Optimization and Control · Mathematics 2015-12-21 G. C. Bento , O. P. Ferreira , Y. R. L. Pereira

This paper introduces a new interpretation of the Variational Autoencoder framework by taking a fully geometric point of view. We argue that vanilla VAE models unveil naturally a Riemannian structure in their latent space and that taking…

Machine Learning · Statistics 2022-11-04 Clément Chadebec , Stéphanie Allassonnière

Gradient descent methods are fundamental first-order optimization algorithms in both Euclidean spaces and Riemannian manifolds. However, the exact gradient is not readily available in many scenarios. This paper proposes a novel inexact…

Optimization and Control · Mathematics 2024-09-18 Juan Zhou , Kangkang Deng , Hongxia Wang , Zheng Peng

The proximal point method (PPM) is a fundamental method in optimization that is often used as a building block for designing optimization algorithms. In this work, we use the PPM method to provide conceptually simple derivations along with…

Optimization and Control · Mathematics 2022-06-03 Kwangjun Ahn , Suvrit Sra

Following the seminal work of Nesterov, accelerated optimization methods have been used to powerfully boost the performance of first-order, gradient-based parameter estimation in scenarios where second-order optimization strategies are…

Numerical Analysis · Computer Science 2017-11-28 Anthony Yezzi , Ganesh Sundaramoorthi

We propose a machine learning framework to accelerate numerical computations of time-dependent ODEs and PDEs. Our method is based on recasting (generalizations of) existing numerical methods as artificial neural networks, with a set of…

Numerical Analysis · Mathematics 2019-03-08 Siddhartha Mishra

Riemannian metric learning is an emerging field in machine learning, unlocking new ways to encode complex data structures beyond traditional distance metric learning. While classical approaches rely on global distances in Euclidean space,…

Machine Learning · Statistics 2025-10-01 Samuel Gruffaz , Josua Sassen

In recent years, the proximal gradient method and its variants have been generalized to Riemannian manifolds for solving optimization problems with an additively separable structure, i.e., $f + h$, where $f$ is continuously differentiable,…

Optimization and Control · Mathematics 2024-04-04 Wutao Si , P. -A. Absil , Wen Huang , Rujun Jiang , Simon Vary

The energy preserving discrete gradient methods are generalized to finite-dimensional Riemannian manifolds by definition of a discrete approximation to the Riemannian gradient, a retraction, and a coordinate center function. The resulting…

Numerical Analysis · Mathematics 2018-05-22 Elena Celledoni , Sølve Eidnes , Brynjulf Owren , Torbjørn Ringholm

We develop a new Riemannian descent algorithm that relies on momentum to improve over existing first-order methods for geodesically convex optimization. In contrast, accelerated convergence rates proved in prior work have only been shown to…

Optimization and Control · Mathematics 2021-02-16 Foivos Alimisis , Antonio Orvieto , Gary Bécigneul , Aurelien Lucchi

Many head pose estimation (HPE) methods promise the ability to create full-range datasets, theoretically allowing the estimation of the rotation and positioning of the head from various angles. However, these methods are only accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Huei-Chung Hu , Xuyang Wu , Haowei Liu , Ting-Ruen Wei , Hsin-Tai Wu

Moving horizon estimation (MHE) is a widely studied state estimation approach in several practical applications. In the MHE problem, the state estimates are obtained via the solution of an approximated nonlinear optimization problem.…

Optimization and Control · Mathematics 2023-06-26 Tianchen Liu , Kushal Chakrabarti , Nikhil Chopra

Riemannian optimization uses local methods to solve optimization problems whose constraint set is a smooth manifold. A linear step along some descent direction usually leaves the constraints, and hence retraction maps are used to…

Statistics Theory · Mathematics 2023-01-19 Alexander Heaton , Matthias Himmelmann

Proximal methods are known to identify the underlying substructure of nonsmooth optimization problems. Even more, in many interesting situations, the output of a proximity operator comes with its structure at no additional cost, and…

Optimization and Control · Mathematics 2023-02-10 Gilles Bareilles , Franck Iutzeler , Jérôme Malick

The problem of determining the configuration of points from partial distance information, known as the Euclidean Distance Geometry (EDG) problem, is fundamental to many tasks in the applied sciences. In this paper, we propose two algorithms…

Optimization and Control · Mathematics 2024-10-10 Chandler Smith , HanQin Cai , Abiy Tasissa