English
Related papers

Related papers: Riemannian optimization with a preconditioning sch…

200 papers

Riemannian meta-optimization provides a promising approach to solving non-linear constrained optimization problems, which trains neural networks as optimizers to perform optimization on Riemannian manifolds. However, existing Riemannian…

Machine Learning · Computer Science 2025-02-07 Peilin Yu , Yuwei Wu , Zhi Gao , Xiaomeng Fan , Yunde Jia

This paper aims to investigate the distributed stochastic optimization problems on compact embedded submanifolds (in the Euclidean space) for multi-agent network systems. To address the manifold structure, we propose a distributed…

Optimization and Control · Mathematics 2025-10-28 Jishu Zhao , Xi Wang , Jinlong Lei , Shixiang Chen

We study the properties of stochastic approximation applied to a tame nondifferentiable function subject to constraints defined by a Riemannian manifold. The objective landscape of tame functions, arising in o-minimal topology extended to a…

Machine Learning · Computer Science 2025-08-13 Johannes Aspman , Vyacheslav Kungurtsev , Reza Roohi Seraji

We introduce a novel geometric approach to the image labeling problem. Abstracting from specific labeling applications, a general objective function is defined on a manifold of stochastic matrices, whose elements assign prior data that are…

Computer Vision and Pattern Recognition · Computer Science 2017-01-16 Freddie Åström , Stefania Petra , Bernhard Schmitzer , Christoph Schnörr

Meta-learning problem is usually formulated as a bi-level optimization in which the task-specific and the meta-parameters are updated in the inner and outer loops of optimization, respectively. However, performing the optimization in the…

Machine Learning · Computer Science 2024-06-04 Hadi Tabealhojeh , Soumava Kumar Roy , Peyman Adibi , Hossein Karshenas

The conjugate gradient method is a crucial first-order optimization method that generally converges faster than the steepest descent method, and its computational cost is much lower than that of second-order methods. However, while various…

Optimization and Control · Mathematics 2024-03-13 Jun Chen , Haishan Ye , Mengmeng Wang , Tianxin Huang , Guang Dai , Ivor W. Tsang , Yong Liu

The isometric embedding problem for Riemannian manifolds, which connects intrinsic and extrinsic geometry, is a central question in differential geometry with deep theoretical significance and wide-ranging applications. Despite extensive…

Numerical Analysis · Mathematics 2026-02-24 Guangwei Gao , Kaibo Hu , Buyang Li , Ganghui Zhang

Decentralized optimization on Riemannian manifolds is foundational for many modern machine learning and signal processing applications in which data are non-Euclidean and generated and processed in a distributed manner. Although intrinsic…

Optimization and Control · Mathematics 2026-03-19 Duc Toan Nguyen , César A. Uribe

Statistical shape analysis can be done in a Riemannian framework by endowing the set of shapes with a Riemannian metric. Sobolev metrics of order two and higher on shape spaces of parametrized or unparametrized curves have several desirable…

Differential Geometry · Mathematics 2016-10-18 Martin Bauer , Martins Bruveris , Philipp Harms , Jakob Møller-Andersen

Riemannian accelerated gradient methods have been well studied for smooth optimization, typically treating geodesically convex and geodesically strongly convex cases separately. However, their extension to nonsmooth problems on manifolds…

Optimization and Control · Mathematics 2025-09-29 Shuailing Feng , Yuhang Jiang , Wen Huang , Shihui Ying

In this work, we present a novel approach for solving stochastic shape optimization problems. Our method is the extension of the classical stochastic gradient method to infinite-dimensional shape manifolds. We prove convergence of the…

Optimization and Control · Mathematics 2020-11-03 Caroline Geiersbach , Estefania Loayza-Romero , Kathrin Welker

We study the geometric Whitney problem on how a Riemannian manifold $(M,g)$ can be constructed to approximate a metric space $(X,d_X)$. This problem is closely related to manifold reconstruction where a smooth $n$-dimensional submanifold…

Differential Geometry · Mathematics 2019-11-18 Charles Fefferman , Sergei Ivanov , Yaroslav Kurylev , Matti Lassas , Hariharan Narayanan

Riemannian manifolds provide a principled way to model nonlinear geometric structure inherent in data. A Riemannian metric on said manifolds determines geometry-aware shortest paths and provides the means to define statistical models…

Machine Learning · Computer Science 2021-06-11 Christian Fröhlich , Alexandra Gessner , Philipp Hennig , Bernhard Schölkopf , Georgios Arvanitidis

We propose Riemannian Flow Matching (RFM), a simple yet powerful framework for training continuous normalizing flows on manifolds. Existing methods for generative modeling on manifolds either require expensive simulation, are inherently…

Machine Learning · Computer Science 2024-02-27 Ricky T. Q. Chen , Yaron Lipman

The real symplectic Stiefel manifold is the manifold of symplectic bases of symplectic subspaces of a fixed dimension. It features in a large variety of applications in physics and engineering. In this work, we study this manifold with the…

Differential Geometry · Mathematics 2021-08-31 Thomas Bendokat , Ralf Zimmermann

The generalized partially linear models on Riemannian manifolds are introduced. These models, like ordinary generalized linear models, are a generalization of partially linear models on Riemannian manifolds that allow for response variables…

Methodology · Statistics 2018-03-09 Amelia Simó , M. Victoria Ibáñez , Irene Epifanio , Vicent Gimeno

We develop a new Riemannian descent algorithm that relies on momentum to improve over existing first-order methods for geodesically convex optimization. In contrast, accelerated convergence rates proved in prior work have only been shown to…

Optimization and Control · Mathematics 2021-02-16 Foivos Alimisis , Antonio Orvieto , Gary Bécigneul , Aurelien Lucchi

In this paper, we propose a general algorithmic framework to solve a class of optimization problems on the product of complex Stiefel manifolds based on the matrix polar decomposition. We establish the weak convergence, global convergence…

Numerical Analysis · Mathematics 2020-06-16 Jianze Li , Shuzhong Zhang

This paper addresses the problems of spline interpolation on smooth Riemannian manifolds, with or without the inclusion of least-squares fitting. Our unified approach utilizes gradient flows for successively connected curves or networks,…

Optimization and Control · Mathematics 2025-10-29 Chun-Chi Lin , Dung The Tran

A variational formulation of accelerated optimization on normed spaces was recently introduced by considering a specific family of time-dependent Bregman Lagrangian and Hamiltonian systems whose corresponding trajectories converge to the…

Optimization and Control · Mathematics 2022-01-11 Valentin Duruisseaux , Melvin Leok