English
Related papers

Related papers: Intrinsic dimension estimation of data by principa…

200 papers

Principal component analysis (PCA) is a fundamental tool for analyzing multivariate data. Here the focus is on dimension reduction to the principal subspace, characterized by its projection matrix. The classical principal subspace can be…

Methodology · Statistics 2026-05-29 Fabio Centofanti , Mia Hubert , Peter J. Rousseeuw

Principal Component Analysis (PCA) is a highly useful topic within an introductory Linear Algebra course, especially since it can be used to incorporate a number of applied projects. This method represents an essential application and…

History and Overview · Mathematics 2016-04-19 Stephen Pankavich , Rebecca Swanson

In this brief note, we formulate Principal Component Analysis (PCA) over datasets consisting not of points but of distributions, characterized by their location and covariance. Just like the usual PCA on points can be equivalently derived…

Machine Learning · Statistics 2023-06-26 Vlad Niculae

We discuss the problem of estimating the number of principal components in Principal Com- ponents Analysis (PCA). Despite of the importance of the problem and the multitude of solutions proposed in the literature, it comes as a surprise…

Methodology · Statistics 2016-07-06 Piotr Sobczyk , Malgorzata Bogdan , Julie Josse

Often the relation between the variables constituting a multivariate data space might be characterized by one or more of the terms: ``nonlinear'', ``branched'', ``disconnected'', ``bended'', ``curved'', ``heterogeneous'', or, more general,…

Astrophysics · Physics 2007-09-12 Jochen Einbeck , Ludger Evers , Coryn Bailer-Jones

We consider the problem of decomposing a large covariance matrix into the sum of a low-rank matrix and a diagonally dominant matrix, and we call this problem the "Diagonally-Dominant Principal Component Analysis (DD-PCA)". DD-PCA is an…

Methodology · Statistics 2019-06-04 Zheng Tracy Ke , Lingzhou Xue , Fan Yang

This article establishes a new and comprehensive estimation and inference theory for principal component analysis (PCA) under the weak factor model that allow for cross-sectional dependent idiosyncratic components under the nearly minimal…

Methodology · Statistics 2024-10-02 Jianqing Fan , Yuling Yan , Yuheng Zheng

We develop asymptotic theory for principal component analysis (PCA) of a high-dimensional factor model in which the working dimension $R$ is fixed and only required to satisfy $R \ge r$, where $r$ is the true number of factors. Building on…

Statistics Theory · Mathematics 2026-05-19 Yuan Liao , Xin Tong , Wanjie Wang , Dacheng Xiu

Revisiting PCA for Time Series Reduction in Temporal Dimension; Jiaxin Gao, Wenbo Hu, Yuntian Chen; Deep learning has significantly advanced time series analysis (TSA), enabling the extraction of complex patterns for tasks like…

Machine Learning · Computer Science 2024-12-30 Jiaxin Gao , Wenbo Hu , Yuntian Chen

Principal component analysis (PCA) is a longstanding and well-studied approach for dimension reduction. It rests upon the assumption that the underlying signal in the data has low rank, and thus can be well-summarized using a small number…

Methodology · Statistics 2025-08-14 Ronan Perry , Snigdha Panigrahi , Jacob Bien , Daniela Witten

Real-time or near real-time hyperspectral detection and identification are extremely useful and needed in many fields. These data sets can be quite large, and the algorithms can require numerous computations that slow the process down. A…

Image and Video Processing · Electrical Eng. & Systems 2023-11-27 Abigail Basener , Meagan Herald

Principal component analysis (PCA) is a widely used method for dimension reduction. In high dimensional data, the "signal" eigenvalues corresponding to weak principal components (PCs) do not necessarily separate from the bulk of the "noise"…

Statistics Theory · Mathematics 2017-10-03 Edgar Dobriban

The main shortage of principle component analysis (PCA) based anomaly detection models is their interpretability. In this paper, our goal is to propose an interpretable PCA-based model for anomaly detection and interpretation. The propose…

Numerical Analysis · Computer Science 2016-05-17 Xingyan Bin , Ying Zhao , Bilong Shen

We tackle the challenges of modeling high-dimensional data sets, particularly those with latent low-dimensional structures hidden within complex, non-linear, and noisy relationships. Our approach enables a seamless integration of concepts…

Machine Learning · Statistics 2025-03-17 Zichuan Guo , Mihai Cucuringu , Alexander Y. Shestopaloff

We propose a new approach to analyze data that naturally lie on manifolds. We focus on a special class of manifolds, called direct product manifolds, whose intrinsic dimension could be very high. Our method finds a low-dimensional…

Applications · Statistics 2011-04-19 Sungkyu Jung , Mark Foskey , J. S. Marron

Principal component analysis (PCA) is a classical and ubiquitous method for reducing data dimensionality, but it is suboptimal for heterogeneous data that are increasingly common in modern applications. PCA treats all samples uniformly so…

Statistics Theory · Mathematics 2021-12-02 David Hong , Kyle Gilman , Laura Balzano , Jeffrey A. Fessler

Principal component analysis (PCA) is a well-established method commonly used to explore and visualise data. A classical PCA model is the fixed effect model where data are generated as a fixed structure of low rank corrupted by noise. Under…

Methodology · Statistics 2013-05-13 Marie Verbanck , Julie Josse , François Husson

This paper presents a new framework for manifold learning based on a sequence of principal polynomials that capture the possibly nonlinear nature of the data. The proposed Principal Polynomial Analysis (PPA) generalizes PCA by modeling the…

Machine Learning · Statistics 2016-02-02 Valero Laparra , Sandra Jiménez , Devis Tuia , Gustau Camps-Valls , Jesús Malo

Principal Component Analysis (PCA) is the most common nonparametric method for estimating the volatility structure of Gaussian interest rate models. One major difficulty in the estimation of these models is the fact that forward rate curves…

Statistical Finance · Quantitative Finance 2014-08-28 Marcio Laurini , Alberto Ohashi

Principal Component Analysis (PCA) is a pivotal technique widely utilized in the realms of machine learning and data analysis. It aims to reduce the dimensionality of a dataset while minimizing the loss of information. In recent years,…

Cryptography and Security · Computer Science 2024-02-06 Xirong Ma