English
Related papers

Related papers: From Manifold to Manifold: Geometry-Aware Dimensio…

200 papers

Learning with symmetric positive definite (SPD) matrices has many applications in machine learning. Consequently, understanding the Riemannian geometry of SPD matrices has attracted much attention lately. A particular Riemannian geometry of…

Functional Analysis · Mathematics 2023-06-12 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Junbin Gao

The paper addresses the problem of learning a regression model parameterized by a fixed-rank positive semidefinite matrix. The focus is on the nonlinear nature of the search space and on scalability to high-dimensional problems. The…

Machine Learning · Computer Science 2011-02-01 Gilles Meyer , Silvere Bonnabel , Rodolphe Sepulchre

Motivated by the problem of learning a linear regression model whose parameter is a large fixed-rank non-symmetric matrix, we consider the optimization of a smooth cost function defined on the set of fixed-rank matrices. We adopt the…

Machine Learning · Computer Science 2013-04-25 B. Mishra , G. Meyer , S. Bonnabel , R. Sepulchre

In this paper we demonstrate how sub-Riemannian geometry can be used for manifold learning and surface reconstruction by combining local linear approximations of a point cloud to obtain lower dimensional bundles. Local approximations…

Methodology · Statistics 2023-07-07 Morten Akhøj , James Benn , Erlend Grong , Stefan Sommer , Xavier Pennec

Gradient-based dimension reduction decreases the cost of Bayesian inference and probabilistic modeling by identifying maximally informative (and informed) low-dimensional projections of the data and parameters, allowing high-dimensional…

Computation · Statistics 2025-06-02 Ricardo Baptista , Michael Brennan , Youssef Marzouk

Data-driven Riemannian geometry has emerged as a powerful tool for interpretable representation learning, offering improved efficiency in downstream tasks. Moving forward, it is crucial to balance cheap manifold mappings with efficient…

Machine Learning · Computer Science 2025-05-26 Willem Diepeveen , Georgios Batzolis , Zakhar Shumaylov , Carola-Bibiane Schönlieb

While the existence of low-dimensional embedding manifolds has been shown in patterns of collective motion, the current battery of nonlinear dimensionality reduction methods are not amenable to the analysis of such manifolds. This is mainly…

Numerical Analysis · Mathematics 2017-07-21 Kelum Gajamannage , Sachit Butail , Maurizio Porfiri , Erik M. Bollt

Riemannian meta-optimization provides a promising approach to solving non-linear constrained optimization problems, which trains neural networks as optimizers to perform optimization on Riemannian manifolds. However, existing Riemannian…

Machine Learning · Computer Science 2025-02-07 Peilin Yu , Yuwei Wu , Zhi Gao , Xiaomeng Fan , Yunde Jia

Graph-based multi-view spectral clustering methods have achieved notable progress recently, yet they often fall short in either oversimplifying pairwise relationships or struggling with inefficient spectral decompositions in…

Machine Learning · Computer Science 2025-11-14 Murong Yang , Shihui Ying , Xin-Jian Xu , Yue Gao

Manifold learning is used for dimensionality reduction, with the goal of finding a projection subspace to increase and decrease the inter- and intraclass variances, respectively. However, a bottleneck for subspace learning methods often…

Machine Learning · Computer Science 2021-05-26 Parisa Abdolrahim Poorheravi , Vincent Gaudet

We study optimization over Riemannian embedded submanifolds, where the objective function is relatively smooth in the ambient Euclidean space. Such problems have broad applications but are still largely unexplored. We introduce two…

Optimization and Control · Mathematics 2025-08-08 Chang He , Jiaxiang Li , Bo Jiang , Shiqian Ma , Shuzhong Zhang

The knowledge that data lies close to a particular submanifold of the ambient Euclidean space may be useful in a number of ways. For instance, one may want to automatically mark any point far away from the submanifold as an outlier or to…

Riemannian diffusion models draw inspiration from standard Euclidean space diffusion models to learn distributions on general manifolds. Unfortunately, the additional geometric complexity renders the diffusion transition term inexpressible…

Machine Learning · Computer Science 2023-11-01 Aaron Lou , Minkai Xu , Stefano Ermon

In a previous work, we proposed a geometric framework to study a deep neural network, seen as sequence of maps between manifolds, employing singular Riemannian geometry. In this paper, we present an application of this framework, proposing…

Machine Learning · Computer Science 2022-09-26 Alessandro Benfenati , Alessio Marta

We propose a rank-one Riemannian subspace descent algorithm for computing symmetric positive definite (SPD) solutions to nonlinear matrix equations arising in control theory, dynamic programming, and stochastic filtering. For solution…

Numerical Analysis · Mathematics 2026-01-22 Yogesh Darmwal , Ketan Rajawat

Numerous problems in optics, quantum physics, stability analysis, and control of dynamical systems can be brought to an optimization problem with matrix variable subjected to the symplecticity constraint. As this constraint nicely forms a…

Optimization and Control · Mathematics 2022-11-18 Bin Gao , Nguyen Thanh Son , Tatjana Stykel

This paper advocates a novel framework for segmenting a dataset in a Riemannian manifold $M$ into clusters lying around low-dimensional submanifolds of $M$. Important examples of $M$, for which the proposed clustering algorithm is…

Machine Learning · Statistics 2014-10-02 Xu Wang , Konstantinos Slavakis , Gilad Lerman

Neural models learn representations of high-dimensional data on low-dimensional manifolds. Multiple factors, including stochasticities in the training process, model architectures, and additional inductive biases, may induce different…

Machine Learning · Computer Science 2025-12-02 Hanlin Yu , Berfin Inal , Georgios Arvanitidis , Soren Hauberg , Francesco Locatello , Marco Fumero

In this paper, we study the problem of facial expression recognition using a novel space-time geometric representation. We describe the temporal evolution of facial landmarks as parametrized trajectories on the Riemannian manifold of…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Anis Kacem , Mohamed Daoudi , Boulbaba Ben Amor , Juan Carlos Alvarez-Paiva

This paper proposes an original Riemmanian geometry for low-rank structured elliptical models, i.e., when samples are elliptically distributed with a covariance matrix that has a low-rank plus identity structure. The considered geometry is…

Differential Geometry · Mathematics 2020-01-07 Florent Bouchard , Arnaud Breloy , Guillaume Ginolhac , Alexandre Renaux , Frédéric Pascal