English
Related papers

Related papers: Principal subbundles for dimension reduction

200 papers

One of the main challenges in modern deep learning is to understand why such over-parameterized models perform so well when trained on finite data. A way to analyze this generalization concept is through the properties of the associated…

Machine Learning · Computer Science 2023-07-11 Alison Pouplin , Hrittik Roy , Sidak Pal Singh , Georgios Arvanitidis

For a Riemannian manifold $(N,g)$, we construct a scalar flat metric $G$ in the tangent bundle $TN$. It is locally conformally flat if and only if either, $N$ is a 2-dimensional manifold or, $(N,g)$ is a real space form. It is also shown…

Differential Geometry · Mathematics 2023-09-20 Nikos Georgiou , Brendan Guilfoyle

In this paper, we propose a novel lower dimensional representation of a shape sequence. The proposed dimension reduction is invertible and computationally more efficient in comparison to other related works. Theoretically, the differential…

Computer Vision and Pattern Recognition · Computer Science 2011-08-02 Sheng Yi , Hamid Krim , Larry K. Norris

Principal Component Analysis (PCA) and Kernel Principal Component Analysis (KPCA) are fundamental methods in machine learning for dimensionality reduction. The former is a technique for finding this approximation in finite dimensions and…

Machine Learning · Computer Science 2018-07-11 Rudrasis Chakraborty , Søren Hauberg , Baba C. Vemuri

In the domain of image-set based classification, a considerable advance has been made by representing original image sets as covariance matrices which typical lie in a Riemannian manifold. Specifically, it is a Symmetric Positive Definite…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Rui Wang , Xiao-Jun Wu , Josef Kittler

This paper investigates the generalization of Principal Component Analysis (PCA) to Riemannian manifolds. We first propose a new and general type of family of subspaces in manifolds that we call barycentric subspaces. They are implicitly…

Statistics Theory · Mathematics 2017-10-05 Xavier Pennec

A geometry with parallel skew-symmetric torsion is a Riemannian manifold carrying a metric connection with parallel skew-symmetric torsion. Besides the trivial case of the Levi-Civita connection, geometries with non-vanishing parallel…

Differential Geometry · Mathematics 2021-06-15 Richard Cleyton , Andrei Moroianu , Uwe Semmelmann

One develops a fast computational methodology for principal component analysis on manifolds. Instead of estimating intrinsic principal components on an object space with a Riemannian structure, one embeds the object space in a numerical…

Methodology · Statistics 2024-10-04 Ka Chun Wong , Vic Patrangenaru , Robert L. Paige , Mihaela Pricop Jeckstadt

It is proven that encoding images and videos through Symmetric Positive Definite (SPD) matrices, and considering the Riemannian geometry of the resulting space, can lead to increased classification performance. Taking into account manifold…

Computer Vision and Pattern Recognition · Computer Science 2016-03-16 Azadeh Alavi , Vishal M Patel , Rama Chellappa

Manifold learning is a popular and quickly-growing subfield of machine learning based on the assumption that one's observed data lie on a low-dimensional manifold embedded in a higher-dimensional space. This thesis presents a mathematical…

Machine Learning · Computer Science 2020-11-04 Luke Melas-Kyriazi

It is often of interest to infer lower-dimensional structure underlying complex data. As a flexible class of non-linear structures, it is common to focus on Riemannian manifolds. Most existing manifold learning algorithms replace the…

Machine Learning · Statistics 2026-01-27 David B Dunson , Nan Wu

We study the properties of stochastic approximation applied to a tame nondifferentiable function subject to constraints defined by a Riemannian manifold. The objective landscape of tame functions, arising in o-minimal topology extended to a…

Machine Learning · Computer Science 2025-08-13 Johannes Aspman , Vyacheslav Kungurtsev , Reza Roohi Seraji

Latent variable models are powerful tools for learning low-dimensional manifolds from high-dimensional data. However, when dealing with constrained data such as unit-norm vectors or symmetric positive-definite matrices, existing approaches…

Machine Learning · Computer Science 2025-03-10 Leonel Rozo , Miguel González-Duque , Noémie Jaquier , Søren Hauberg

Consider the geometric inverse problem: There is a set of delta-sources in spacetime that emit waves travelling at unit speed. If we know all the arrival times at the boundary cylinder of the spacetime, can we reconstruct the space, a…

Differential Geometry · Mathematics 2023-08-09 Maarten V. de Hoop , Joonas Ilmavirta , Matti Lassas , Teemu Saksala

Kernel-based non-linear dimensionality reduction methods, such as Local Linear Embedding (LLE) and Laplacian Eigenmaps, rely heavily upon pairwise distances or similarity scores, with which one can construct and study a weighted graph…

Statistics Theory · Mathematics 2019-08-06 Tingran Gao

This paper proposes an original Riemmanian geometry for low-rank structured elliptical models, i.e., when samples are elliptically distributed with a covariance matrix that has a low-rank plus identity structure. The considered geometry is…

Differential Geometry · Mathematics 2020-01-07 Florent Bouchard , Arnaud Breloy , Guillaume Ginolhac , Alexandre Renaux , Frédéric Pascal

A common belief in high-dimensional data analysis is that data are concentrated on a low-dimensional manifold. This motivates simultaneous dimension reduction and regression on manifolds. We provide an algorithm for learning gradients on…

Statistics Theory · Mathematics 2010-02-24 Sayan Mukherjee , Qiang Wu , Ding-Xuan Zhou

We present a general framework of semi-supervised dimensionality reduction for manifold learning which naturally generalizes existing supervised and unsupervised learning frameworks which apply the spectral decomposition. Algorithms derived…

Machine Learning · Computer Science 2009-07-29 Ratthachat Chatpatanasiri , Boonserm Kijsirikul

These notes on Riemannian geometry use the bases bundle and frame bundle, as in Geometry of Manifolds, to express the geometric structures. It has more problems and omits the background material. It starts with the definition of Riemannian…

Differential Geometry · Mathematics 2013-07-30 Richard L. Bishop

Laplacian-based methods are popular for the dimensionality reduction of data lying in $\mathbb{R}^N$. Several theoretical results for these algorithms depend on the fact that the Euclidean distance locally approximates the geodesic distance…

Machine Learning · Computer Science 2025-09-24 Liane Xu , Amit Singer