English
Related papers

Related papers: Riemannian Zeroth-Order Gradient Estimation with S…

200 papers

High-dimensional data with intrinsic low-dimensional structure is ubiquitous in machine learning and data science. While various approaches allow one to learn a data manifold with a Riemannian structure from finite samples, performing…

Optimization and Control · Mathematics 2026-05-07 Willem Diepeveen , Melanie Weber

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng

Geodesics become an essential element of the geometry of a semi-Riemannian manifold. In fact, their differences and similarities with the (positive definite) Riemannian case, constitute the first step to understand semi-Riemannian Geometry.…

Differential Geometry · Mathematics 2010-03-23 Anna Maria Candela , Miguel Sánchez

Smooth, non-convex optimization problems on Riemannian manifolds occur in machine learning as a result of orthonormality, rank or positivity constraints. First- and second-order necessary optimality conditions state that the Riemannian…

Optimization and Control · Mathematics 2019-10-24 Chris Criscitiello , Nicolas Boumal

We propose a novel Riemannian manifold preconditioning approach for the tensor completion problem with rank constraint. A novel Riemannian metric or inner product is proposed that exploits the least-squares structure of the cost function…

Machine Learning · Computer Science 2016-05-27 Hiroyuki Kasai , Bamdev Mishra

We consider Riemannian optimization problems with inequality and equality constraints and analyze a class of Riemannian interior point methods for solving them. The algorithm of interest consists of outer and inner iterations. We show that,…

Optimization and Control · Mathematics 2026-05-12 Mitsuaki Obara , Takayuki Okuno , Akiko Takeda

We propose a novel second-order ODE as the continuous-time limit of a Riemannian accelerated gradient-based method on a manifold with curvature bounded from below. This ODE can be seen as a generalization of the ODE derived for Euclidean…

Optimization and Control · Mathematics 2020-03-10 Foivos Alimisis , Antonio Orvieto , Gary Bécigneul , Aurelien Lucchi

Riemannian optimization is concerned with problems, where the independent variable lies on a smooth manifold. There is a number of problems from numerical linear algebra that fall into this category, where the manifold is usually specified…

Numerical Analysis · Mathematics 2024-06-27 Rasmus Jensen , Ralf Zimmermann

We study the Riemannian optimization methods on the embedded manifold of low rank matrices for the problem of matrix completion, which is about recovering a low rank matrix from its partial entries. Assume $m$ entries of an $n\times n$ rank…

Numerical Analysis · Mathematics 2016-04-12 Ke Wei , Jian-Feng Cai , Tony F. Chan , Shingyu Leung

We propose a new Riemannian geometry for fixed-rank matrices that is specifically tailored to the low-rank matrix completion problem. Exploiting the degree of freedom of a quotient space, we tune the metric on our search space to the…

Machine Learning · Computer Science 2012-11-13 B. Mishra , K. Adithya Apuroop , R. Sepulchre

Motivated by energy based analyses for descent methods in the Euclidean setting, we investigate a generalisation of such analyses for descent methods over Riemannian manifolds. In doing so, we find that it is possible to derive…

Optimization and Control · Mathematics 2022-12-13 Vishwak Srinivasan , Ashia Wilson

In this paper we investigate possible extensions of the idea of geodesic completeness in complex manifolds, following two directions: metrics are somewhere allowed not to be of maximum rank, or to have 'poles' somewhere else. Geodesics are…

Complex Variables · Mathematics 2007-05-23 Claudio Meneghini

We consider minimizing a nonconvex, smooth function $f$ on a Riemannian manifold $\mathcal{M}$. We show that a perturbed version of Riemannian gradient descent algorithm converges to a second-order stationary point (and hence is able to…

Optimization and Control · Mathematics 2019-06-19 Yue Sun , Nicolas Flammarion , Maryam Fazel

We introduce the concept of ODD ('$\mathbf{O}$rthogonally $\mathbf{D}$egenerating on a $\mathbf{D}$ivisor') Riemannian metrics on real analytic manifolds $M$. These semipositive symmetric $2$-tensors may degenerate on a finite collection of…

Differential Geometry · Mathematics 2022-11-28 Lukas Braun

In this work, we present a novel approach for solving stochastic shape optimization problems. Our method is the extension of the classical stochastic gradient method to infinite-dimensional shape manifolds. We prove convergence of the…

Optimization and Control · Mathematics 2020-11-03 Caroline Geiersbach , Estefania Loayza-Romero , Kathrin Welker

This paper starts by introducing results from geometric measure theory to prove symmetric decreasing rearrangement inequalities on $\mathbb{R}^n$, which give multiple proofs of the isoperimetric and P\'{o}lya-Szeg\H{o} inequalities. Then we…

Differential Geometry · Mathematics 2024-11-26 Richard Stone

We extend the classical primal-dual interior point method from the Euclidean setting to the Riemannian one. Our method, named the Riemannian interior point method, is for solving Riemannian constrained optimization problems. We establish…

Optimization and Control · Mathematics 2024-03-06 Zhijian Lai , Akiko Yoshise

Euclidean gradient descent algorithms barely capture the geometry of objective function-induced hypersurfaces and risk driving update trajectories off the hypersurfaces. Riemannian gradient descent algorithms address these issues but fail…

Machine Learning · Computer Science 2026-03-10 Liwei Hu , Guangyao Li , Wenyong Wang , Xiaoming Zhang , Yu Xiang

In this paper we give a natural condition for when a volumorphism on a Riemannian manifold $(M,g)$ is actually an isometry with respect to some other, optimal, Riemannian metric $h$. We consider the natural action of volumorphisms on the…

Differential Geometry · Mathematics 2012-12-18 Tony Liimatainen

This paper proposes a Riemannian Multiobjective Proximal Gradient Method (RMPGM) for composite optimization problems on manifolds. Unlike scalarization-based approaches, the proposed framework directly handles vector-valued objectives and…

Optimization and Control · Mathematics 2026-05-19 Kangming Chen