English
Related papers

Related papers: Extrinsic Principal Component Analysis

200 papers

Probabilistic Manifold Decomposition (PMD)\cite{doi:10.1137/25M1738863}, developed in our earlier work, provides a nonlinear model reduction by embedding high-dimensional dynamics onto low-dimensional probabilistic manifolds. The PMD has…

Numerical Analysis · Mathematics 2026-01-13 Jiaming Guo , Dunhui Xiao

The intrinsic dimensionality refers to the ``true'' dimensionality of the data, as opposed to the dimensionality of the data representation. For example, when attributes are highly correlated, the intrinsic dimensionality can be much lower…

Machine Learning · Statistics 2020-11-30 Erik Thordsen , Erich Schubert

We propose a principal components regression method based on maximizing a joint pseudo-likelihood for responses and predictors. Our method uses both responses and predictors to select linear combinations of the predictors relevant for the…

Methodology · Statistics 2021-08-10 Karl Oskar Ekvall

High-dimensional data poses unique challenges in outlier detection process. Most of the existing algorithms fail to properly address the issues stemming from a large number of features. In particular, outlier detection algorithms perform…

Machine Learning · Computer Science 2020-09-22 Firuz Kamalov , Ho Hon Leung

Functional data analysis offers a diverse toolkit of statistical methods tailored for analyzing samples of real-valued random functions. Recently, samples of time-varying random objects, such as time-varying networks, have been increasingly…

Methodology · Statistics 2025-03-10 Jiazhen Xu , Andrew T. A. Wood , Tao Zou

Multidimensional functional data streams arise in diverse scientific fields, yet their analysis poses significant challenges. We propose a novel online framework for functional principal component analysis that enables efficient and…

Methodology · Statistics 2025-05-06 Muye Nanshan , Nan Zhang , Jiguo Cao

In this paper, we study linear regression applied to data structured on a manifold. We assume that the data manifold is smooth and is embedded in a Euclidean space, and our objective is to reveal the impact of the data manifold's extrinsic…

Machine Learning · Computer Science 2023-07-25 Liangchen Liu , Juncai He , Richard Tsai

Principal component analysis (PCA) is one of the most fundamental procedures in exploratory data analysis and is the basic step in applications ranging from quantitative finance and bioinformatics to image analysis and neuroscience.…

Data Structures and Algorithms · Computer Science 2019-05-13 Fedor V. Fomin , Petr A. Golovach , Fahad Panolan , Kirill Simonov

The success of machine learning models relies heavily on effectively representing high-dimensional data. However, ensuring data representations capture human-understandable concepts remains difficult, often requiring the incorporation of…

Machine Learning · Statistics 2024-11-01 Jiayu Su , David A. Knowles , Raul Rabadan

Latent variable models are powerful tools for learning low-dimensional manifolds from high-dimensional data. However, when dealing with constrained data such as unit-norm vectors or symmetric positive-definite matrices, existing approaches…

Machine Learning · Computer Science 2025-03-10 Leonel Rozo , Miguel González-Duque , Noémie Jaquier , Søren Hauberg

The principal component analysis approach is employed to extract the principal components contained in nuclear mass models for the first time. The effects coming from different nuclear mass models are reintegrated and reorganized in the…

Nuclear Theory · Physics 2024-05-27 X. H. Wu , P. W. Zhao

In NMR spectroscopy, undersampling in the indirect dimensions causes reconstruction artifacts whose size can be bounded using the so-called {\it coherence}. In experiments with multiple indirect dimensions, new undersampling approaches were…

Applications · Statistics 2017-02-08 Hatef Monajemi , David L. Donoho , Jeffrey C. Hoch , Adam D. Schuyler

High dimensional data can have a surprising property: pairs of data points may be easily separated from each other, or even from arbitrary subsets, with high probability using just simple linear classifiers. However, this is more of a rule…

Machine Learning · Computer Science 2023-11-15 Oliver J. Sutton , Qinghua Zhou , Alexander N. Gorban , Ivan Y. Tyukin

We present a technique to perform dimensionality reduction on data that is subject to uncertainty. Our method is a generalization of traditional principal component analysis (PCA) to multivariate probability distributions. In comparison to…

Machine Learning · Computer Science 2019-10-14 Jochen Görtler , Thilo Spinner , Dirk Streeb , Daniel Weiskopf , Oliver Deussen

Estimating the intrinsic dimensionality (ID) of data is a fundamental problem in machine learning and computer vision, providing insight into the true degrees of freedom underlying high-dimensional observations. Existing methods often rely…

Machine Learning · Computer Science 2026-03-12 Eng-Jon Ong , Omer Bobrowski , Gesine Reinert , Primoz Skraba

Robust principal component analysis (RPCA) is a critical tool in modern machine learning, which detects outliers in the task of low-rank matrix reconstruction. In this paper, we propose a scalable and learnable non-convex approach for…

Machine Learning · Computer Science 2023-02-28 HanQin Cai , Jialin Liu , Wotao Yin

This paper extends robust principal component analysis (RPCA) to nonlinear manifolds. Suppose that the observed data matrix is the sum of a sparse component and a component drawn from some low dimensional manifold. Is it possible to…

Machine Learning · Computer Science 2019-11-12 He Lyu , Ningyu Sha , Shuyang Qin , Ming Yan , Yuying Xie , Rongrong Wang

We consider the classification problem and focus on nonlinear methods for classification on manifolds. For multivariate datasets lying on an embedded nonlinear Riemannian manifold within the higher-dimensional ambient space, we aim to…

Machine Learning · Statistics 2019-04-02 Zhigang Yao , Zhenyue Zhang

We consider the problem of reconstructing an embedding of a compact connected Riemannian manifold in a Euclidean space up to an almost isometry, given the information on intrinsic distances between points from its ``sufficiently large''…

Optimization and Control · Mathematics 2024-01-26 Nikita Puchkin , Vladimir Spokoiny , Eugene Stepanov , Dario Trevisan

This paper is concerned with the approximation of tensors using tree-based tensor formats, which are tensor networks whose graphs are dimension partition trees. We consider Hilbert tensor spaces of multivariate functions defined on a…

Numerical Analysis · Mathematics 2019-09-11 Anthony Nouy