English
Related papers

Related papers: A Riemannian Framework for Low-Rank Structured Ell…

200 papers

We present a Riemannian optimization framework for Hartree-Fock theory formulated directly in the Sobolev space $H^1$. The orthonormality constraints are interpreted geometrically via infinite-dimensional Stiefel and Grassmann manifolds…

Quantum Physics · Physics 2026-03-18 Evgueni Dinvay

In this study, we investigate stochastic optimization on Riemannian manifolds, focusing on the crucial variance reduction mechanism used in both Euclidean and Riemannian settings. Riemannian variance-reduced methods usually involve a…

Machine Learning · Computer Science 2024-03-12 Yury Demidovich , Grigory Malinovsky , Peter Richtárik

We study the Riemannian geometry of the Deep Linear Network (DLN) as a foundation for a thermodynamic description of the learning process. The main tools are the use of group actions to analyze overparametrization and the use of Riemannian…

Machine Learning · Computer Science 2026-05-22 Govind Menon , Tianmin Yu

We propose a computational framework for computing low-rank approximations to the ensemble of solutions of a parametrized system of the form $A(\xi)x(\xi)+g(x(\xi))=b(\xi)$ for multiple parameter values. The central idea is to reinterpret…

Numerical Analysis · Mathematics 2026-04-09 Marco Sutti , Tommaso Vanzan

In many robot motion planning problems, task objectives and physical constraints induce non-Euclidean geometry on the configuration space, yet many planners operate using Euclidean distances that ignore this structure. We address the…

Robotics · Computer Science 2026-05-15 Phone Thiha Kyaw , Jonathan Kelly

As observed by Auderset et al. (2005) and Wiesel (2012), viewing covariance matrices as elements of a Riemannian manifold and using the concept of geodesic convexity provide useful tools for studying M-estimators of multivariate scatter. In…

Methodology · Statistics 2016-07-27 Lutz Duembgen , David E. Tyler

Since the popularization of the Stiefel manifold for numerical applications in 1998 in a seminal paper from Edelman et al., it has been exhibited to be a key to solve many problems from optimization, statistics and machine learning. In…

Numerical Analysis · Mathematics 2024-12-30 Simon Mataigne , Ralf Zimmermann , Nina Miolane

We investigate the geometrical structure of probabilistic generative dimensionality reduction models using the tools of Riemannian geometry. We explicitly define a distribution over the natural metric given by the models. We provide the…

Machine Learning · Statistics 2014-12-01 Alessandra Tosi , Søren Hauberg , Alfredo Vellido , Neil D. Lawrence

Solving the inverse kinematics problem is a fundamental challenge in motion planning, control, and calibration for articulated robots. Kinematic models for these robots are typically parametrized by joint angles, generating a complicated…

Robotics · Computer Science 2023-12-12 Filip Marić , Matthew Giamou , Adam W. Hall , Soroush Khoubyarian , Ivan Petrović , Jonathan Kelly

Covariance matrices have proven highly effective across many scientific fields. Since these matrices lie within the Symmetric Positive Definite (SPD) manifold - a Riemannian space with intrinsic non-Euclidean geometry, the primary challenge…

Machine Learning · Computer Science 2025-04-02 Rui Wang , Shaocheng Jin , Ziheng Chen , Xiaoqing Luo , Xiao-Jun Wu

We study curvature invariants of a sub-Riemannian manifold (i.e., a manifold with a Riemannian metric on a non-holonomic distribution) related to mutual curvature of several pairwise orthogonal subspaces of the distribution, and prove…

Differential Geometry · Mathematics 2022-12-27 Vladimir Rovenski

We study a type of Riemannian gradient descent (RGD) algorithm, designed through Riemannian preconditioning, for optimization on $\mathcal{M}_k^{m\times n}$ -- the set of $m\times n$ real matrices with a fixed rank $k$. Our analysis is…

Optimization and Control · Mathematics 2024-08-15 Shuyu Dong , Bin Gao , Wen Huang , Kyle A. Gallivan

Conjugate gradient (CG) methods are widely acknowledged as efficient for minimizing continuously differentiable functions in Euclidean spaces. In recent years, various CG methods have been extended to Riemannian manifold optimization, but…

Optimization and Control · Mathematics 2026-05-26 Chunming Tang , Shaohui Liang , Huangyue Chen

Linear discriminant analysis (LDA) is a widely used algorithm in machine learning to extract a low-dimensional representation of high-dimensional data, it features to find the orthogonal discriminant projection subspace by using the Fisher…

Machine Learning · Computer Science 2021-07-21 Wanguang Yin , Zhengming Ma , Quanying Liu

We show Riemannian geometry could be studied by identifying the tangent bundle of a Riemannian manifold $\mathcal{M}$ with a subbundle of the trivial bundle $\mathcal{M} \times \mathcal{E}$, obtained by embedding $\mathcal{M}$…

Differential Geometry · Mathematics 2021-05-05 Du Nguyen

This paper studies large-scale optimization problems on Riemannian manifolds whose objective function is a finite sum of negative log-probability losses. Such problems arise in various machine learning and signal processing applications. By…

Optimization and Control · Mathematics 2022-07-18 Jiang Hu , Ruicheng Ao , Anthony Man-Cho So , Minghan Yang , Zaiwen Wen

In this paper, we introduce the notion of generalized $\epsilon$-stationarity for a class of nonconvex and nonsmooth composite minimization problems on compact Riemannian submanifold embedded in Euclidean space. To find a generalized…

Optimization and Control · Mathematics 2023-10-31 Zheng Peng , Weihe Wu , Jiang Hu , Kangkang Deng

We consider problems of estimation of structured covariance matrices, and in particular of matrices with a Toeplitz structure. We follow a geometric viewpoint that is based on some suitable notion of distance. To this end, we overview and…

Optimization and Control · Mathematics 2011-10-18 Lipeng Ning , Xianhua Jiang , Tryphon Georgiou

In this paper, we give explicit descriptions of versions of (Local-) Backtracking Gradient Descent and New Q-Newton's method to the Riemannian setting.Here are some easy to state consequences of results in this paper, where X is a general…

Optimization and Control · Mathematics 2020-09-01 Tuyen Trung Truong

We consider two Riemannian geometries for the manifold $\mathcal{M}(p,m\times n)$ of all $m\times n$ matrices of rank $p$. The geometries are induced on $\mathcal{M}(p,m\times n)$ by viewing it as the base manifold of the submersion…

Optimization and Control · Mathematics 2012-09-04 P. -A. Absil , Luca Amodei , Gilles Meyer