English
Related papers

Related papers: A Manifold Approach to Learning Mutually Orthogona…

200 papers

Several important algorithms for machine learning and data analysis use pairwise distances as input. On Riemannian manifolds these distances may be prohibitively costly to compute, in particular for large datasets. To tackle this problem,…

Differential Geometry · Mathematics 2019-04-29 Philipp Harms , Elodie Maignant , Stefan Schlager

Orthogonality constraints naturally appear in many machine learning problems, from principal component analysis to robust neural network training. They are usually solved using Riemannian optimization algorithms, which minimize the…

Machine Learning · Statistics 2025-08-08 Pierre Ablin , Simon Vary , Bin Gao , P. -A. Absil

In image set classification, a considerable advance has been made by modeling the original image sets by second order statistics or linear subspace, which typically lie on the Riemannian manifold. Specifically, they are Symmetric Positive…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Rui Wang , Xiao-Jun Wu , Kai-Xuan Chen , Josef Kittler

We propose a novel algorithm for supervised dimensionality reduction named Manifold Partition Discriminant Analysis (MPDA). It aims to find a linear embedding space where the within-class similarity is achieved along the direction that is…

Machine Learning · Computer Science 2020-11-24 Yang Zhou , Shiliang Sun

In this work, we present a novel approach for solving stochastic shape optimization problems. Our method is the extension of the classical stochastic gradient method to infinite-dimensional shape manifolds. We prove convergence of the…

Optimization and Control · Mathematics 2020-11-03 Caroline Geiersbach , Estefania Loayza-Romero , Kathrin Welker

The knowledge that data lies close to a particular submanifold of the ambient Euclidean space may be useful in a number of ways. For instance, one may want to automatically mark any point far away from the submanifold as an outlier or to…

Optimal transport (OT) has recently found widespread interest in machine learning. It allows to define novel distances between probability measures, which have shown promise in several applications. In this work, we discuss how to…

Machine Learning · Computer Science 2021-10-11 Bamdev Mishra , N T V Satyadev , Hiroyuki Kasai , Pratik Jawanpuria

Optimization with constraints is a typical problem in quantum physics and quantum information science that becomes especially challenging for high-dimensional systems and complex architectures like tensor networks. Here we use ideas of…

Quantum Physics · Physics 2021-11-18 Ilia A. Luchnikov , Mikhail E. Krechetov , Sergey N. Filippov

The techniques and analysis presented in this thesis provide new methods to solve optimization problems posed on Riemannian manifolds. These methods are applied to the subspace tracking problem found in adaptive signal processing and…

Optimization and Control · Mathematics 2013-05-09 Steven Thomas Smith

In this paper, we develop a new classification method for manifold-valued data in the framework of probabilistic learning vector quantization. In many classification scenarios, the data can be naturally represented by symmetric positive…

Machine Learning · Computer Science 2021-02-02 Fengzhen Tang , Haifeng Feng , Peter Tino , Bailu Si , Daxiong Ji

The effectiveness of dimensionality reduction with quadratic manifolds hinges on the choice of a reduced basis and the associated quadratic correction terms. Existing approaches typically rely on subspaces spanned by the leading principal…

Numerical Analysis · Mathematics 2026-05-27 Gavin Paxton , Seunghee Cheon , Rudy Geelen , Shane A. McQuarrie

Riemannian submanifold optimization with momentum is computationally challenging because, to ensure that the iterates remain on the submanifold, we often need to solve difficult differential equations. Here, we simplify such difficulties…

Machine Learning · Statistics 2024-03-19 Wu Lin , Valentin Duruisseaux , Melvin Leok , Frank Nielsen , Mohammad Emtiyaz Khan , Mark Schmidt

Linear discriminant analysis (LDA) is a widely used algorithm in machine learning to extract a low-dimensional representation of high-dimensional data, it features to find the orthogonal discriminant projection subspace by using the Fisher…

Machine Learning · Computer Science 2021-07-21 Wanguang Yin , Zhengming Ma , Quanying Liu

Algorithms proposed for solving high-dimensional optimization problems with no derivative information frequently encounter the "curse of dimensionality," becoming ineffective as the dimension of the parameter space grows. One feature of a…

Optimization and Control · Mathematics 2020-04-28 Dmitry Pozharskiy , Noah J. Wichrowski , Andrew B. Duncan , Grigorios A. Pavliotis , Ioannis G. Kevrekidis

Fitting an unknown number of hyperplanes to data is a fundamental yet challenging problem in machine learning, characterized by its non-convexity, non-differentiability, and unknown model order. Existing approaches often struggle with local…

Machine Learning · Computer Science 2026-05-28 Zhiqin Cheng , Yu Zhan , Mingjin Zhang , Lingbo Liu , Liang Lin

We extend our study of Motion Planning via Manifold Samples (MMS), a general algorithmic framework that combines geometric methods for the exact and complete analysis of low-dimensional configuration spaces with sampling-based approaches…

Robotics · Computer Science 2015-09-17 Oren Salzman , Michael Hemmer , Dan Halperin

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

We propose a novel Riemannian method for solving the Extreme multi-label classification problem that exploits the geometric structure of the sparse low-dimensional local embedding models. A constrained optimization problem is formulated as…

Optimization and Control · Mathematics 2021-10-01 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

Tensor networks, which are originally developed for characterizing complex quantum many-body systems, have recently emerged as a powerful framework for capturing high-dimensional probability distributions with strong physical…

Machine Learning · Computer Science 2026-03-13 Haotong Duan , Zhongming Chen , Ngai Wong

Riemannian geometry provides the fundamental framework for optimization on nonlinear spaces such as matrix manifolds, which arise in machine learning, signal processing, and robotics. While the underlying theory is classical, existing…

Differential Geometry · Mathematics 2026-05-05 Benyamin Ghojogh