English
Related papers

Related papers: Beyond Explained Variance: A Cautionary Tale of PC…

200 papers

Principal Component Analysis (PCA) is a powerful tool in statistics and machine learning. While existing study of PCA focuses on the recovery of principal components and their associated eigenvalues, there are few precise characterizations…

Statistics Theory · Mathematics 2022-04-12 Emmanuel Abbe , Jianqing Fan , Kaizheng Wang

We present an efficient and accurate algorithm for principal component analysis (PCA) of a large set of two dimensional images, and, for each image, the set of its uniform rotations in the plane and its reflection. The algorithm starts by…

Computer Vision and Pattern Recognition · Computer Science 2014-02-17 Zhizhen Zhao , Amit Singer

Topological Data Analysis (TDA) is a novel statistical technique, particularly powerful for the analysis of large and high dimensional data sets. Much of TDA is based on the tool of persistent homology, represented visually via persistence…

Applications · Statistics 2017-11-07 Sarit Agami , Robert J. Adler

Sparse Principal Component Analysis (PCA) is a dimensionality reduction technique wherein one seeks a low-rank representation of a data matrix with additional sparsity constraints on the obtained representation. We consider two…

Information Theory · Computer Science 2014-05-06 Yash Deshpande , Andrea Montanari

A system with many degrees of freedom can be characterized by a covariance matrix; principal components analysis (PCA) focuses on the eigenvalues of this matrix, hoping to find a lower dimensional description. But when the spectrum is…

Biological Physics · Physics 2017-04-26 Serena Bradde , William Bialek

For multivariate data, tandem clustering is a well-known technique aiming to improve cluster identification through initial dimension reduction. Nevertheless, the usual approach using principal component analysis (PCA) has been criticized…

Methodology · Statistics 2024-03-26 Andreas Alfons , Aurore Archimbaud , Klaus Nordhausen , Anne Ruiz-Gazen

Dimensionality reduction algorithms like principal component analysis (PCA) are workhorses of machine learning and neuroscience, but each has well-known limitations. Variants of PCA are simple and interpretable, but not flexible enough to…

Machine Learning · Computer Science 2025-12-01 John J. Vastola , Samuel J. Gershman , Kanaka Rajan

Handwritten digit images lie in a high-dimensional pixel space but exhibit strong geometric and statistical structure. This paper investigates the latent organization of handwritten digits in the MNIST dataset using three complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jyotiraditya Gupta

Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA to non-Gaussian…

Machine Learning · Statistics 2019-10-28 Jean P. Chereau , Bruno Scalzo Dees , Danilo P. Mandic

Artificial neural networks that learn to perform Principal Component Analysis (PCA) and related tasks using strictly local learning rules have been previously derived based on the principle of similarity matching: similar pairs of inputs…

Computation · Statistics 2018-11-06 Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

This paper proposes a probabilistic model of subspaces based on the probabilistic principal component analysis (PCA). Given a sample of vectors in the embedding space -- commonly known as a snapshot matrix -- this method uses quantities…

Computational Engineering, Finance, and Science · Computer Science 2025-10-07 Akash Yadav , Ruda Zhang

Principal Component Analysis (PCA) is a powerful and popular dimensionality reduction technique. However, due to its linear nature, it often fails to capture the complex underlying structure of real-world data. While Kernel PCA (kPCA)…

Machine Learning · Computer Science 2026-02-05 Thomas Uriot , Elise Chung

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

Statistics Theory · Mathematics 2009-08-26 Arash A. Amini , Martin J. Wainwright

Principal components analysis (PCA) is a widely used dimension reduction technique with an extensive range of applications. In this paper, an online distributed algorithm is proposed for recovering the principal eigenspaces. We further…

Machine Learning · Statistics 2019-05-20 Davoud Ataee Tarzanagh , Mohamad Kazem Shirani Faradonbeh , George Michailidis

Principal Component Analysis (PCA) is a well-known multivariate technique used to decorrelate a set of vectors. PCA has been extensively applied in the past to the classification of stellar and galaxy spectra. Here we apply PCA to the…

Astrophysics · Physics 2007-05-23 I. Ferreras , B. Rogers , O. Lahav , .

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Motivation: Although principal component analysis (PCA) is widely used for the dimensional reduction of biomedical data, interpretation of PCA results remains daunting. Most existing methods attempt to explain each principal component (PC)…

Quantitative Methods · Quantitative Biology 2015-08-24 H. Robert Frost , Zhigang Li , Jason H. Moore

In contrast to classical techniques for exploratory analysis of high-dimensional data sets, such as principal component analysis (PCA), neighbor embedding (NE) techniques tend to better preserve the local structure/topology of…

Machine Learning · Statistics 2022-09-07 Roman Josef Rainer , Michael Mayr , Johannes Himmelbauer , Ramin Nikzad-Langerodi

With the development of modern technologies such as IFUs, it is possible to obtain data cubes in which one produces images with spectral resolution. To extract information from them can be quite complex, and hence the development of new…

Astrophysics of Galaxies · Physics 2015-05-18 J. E. Steiner , R. B. Menezes , T. V. Ricci , A. S. Oliveira

We introduce an extension to local principal component analysis for learning symmetric manifolds. In particular, we use a spectral method to approximate the Lie algebra corresponding to the symmetry group of the underlying manifold. We…

Machine Learning · Computer Science 2020-09-15 Jameson Cahill , Dustin G. Mixon , Hans Parshall