English
Related papers

Related papers: Principal Component Analysis for Multivariate Extr…

200 papers

Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the…

Methodology · Statistics 2025-08-22 Zhongyuan Lyu , Ming Yuan

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

Statistics Theory · Mathematics 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu

In this work, we develop a novel principal component analysis (PCA) for semimartingales by introducing a suitable spectral analysis for the quadratic variation operator. Motivated by high-dimensional complex systems typically found in…

Statistics Theory · Mathematics 2016-03-10 Alberto Ohashi , Alexandre B Simas

Principal Component Analysis (PCA) is the most widely used tool for linear dimensionality reduction and clustering. Still it is highly sensitive to outliers and does not scale well with respect to the number of data samples. Robust PCA…

Computer Vision and Pattern Recognition · Computer Science 2015-04-24 Nauman Shahid , Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

Principal component analysis (PCA) is very popular to perform dimension reduction. The selection of the number of significant components is essential but often based on some practical heuristics depending on the application. Only few works…

Machine Learning · Statistics 2017-09-19 Clément Elvira , Pierre Chainais , Nicolas Dobigeon

Principal component analysis (PCA) is a popular dimension reduction technique often used to visualize high-dimensional data structures. In genomics, this can involve millions of variables, but only tens to hundreds of observations.…

Statistics Theory · Mathematics 2020-06-11 Kristoffer Hellton , Magne Thoresen

We introduce a class of copulas that we call Principal Component Copulas (PCCs). This class combines the strong points of copula-based techniques with principal component analysis (PCA), which results in flexibility when modelling tail…

Risk Management · Quantitative Finance 2025-09-09 K. B. Gubbels , J. Y. Ypma , C. W. Oosterlee

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

Principal Component analysis (PCA) is a useful statistical technique that is commonly used for multivariate analysis of correlated variables. It is usually applied as a dimension reduction method: the top principal components (PCs)…

In this paper, we develop new statistical theory for probabilistic principal component analysis models in high dimensions. The focus is the estimation of the noise variance, which is an important and unresolved issue when the number of…

Statistics Theory · Mathematics 2014-06-23 Damien Passemier , Zhaoyuan Li , Jian-Feng Yao

Principal Component Analysis (PCA) is an efficient tool to optimize the multiparameter tests of general relativity (GR) where one tests for simultaneous deviations in multiple post-Newtonian (PN) phasing coefficients by introducing…

General Relativity and Quantum Cosmology · Physics 2022-08-17 Sayantani Datta , M. Saleem , K. G. Arun , B. S. Sathyaprakash

We present a technique to perform dimensionality reduction on data that is subject to uncertainty. Our method is a generalization of traditional principal component analysis (PCA) to multivariate probability distributions. In comparison to…

Machine Learning · Computer Science 2019-10-14 Jochen Görtler , Thilo Spinner , Dirk Streeb , Daniel Weiskopf , Oliver Deussen

This paper proposes a probabilistic model of subspaces based on the probabilistic principal component analysis (PCA). Given a sample of vectors in the embedding space -- commonly known as a snapshot matrix -- this method uses quantities…

Computational Engineering, Finance, and Science · Computer Science 2025-10-07 Akash Yadav , Ruda Zhang

We extend the principal component analysis (PCA) to second-order stationary vector time series in the sense that we seek for a contemporaneous linear transformation for a $p$-variate time series such that the transformed series is segmented…

Methodology · Statistics 2018-12-21 Jinyuan Chang , Bin Guo , Qiwei Yao

Principal component analysis (PCA) frequently suffers from the disturbance of outliers and thus a spectrum of robust extensions and variations of PCA have been developed. However, existing extensions of PCA treat all samples equally even…

Machine Learning · Computer Science 2021-03-23 Rui Zhang , Hongyuan Zhang , Xuelong Li

We study principal components regression (PCR) in an asymptotic high-dimensional regression setting, where the number of data points is proportional to the dimension. We derive exact limiting formulas for the estimation and prediction…

Statistics Theory · Mathematics 2025-09-18 Alden Green , Elad Romanov

We analyse the reconstruction error of principal component analysis (PCA) and prove non-asymptotic upper bounds for the corresponding excess risk. These bounds unify and improve existing upper bounds from the literature. In particular, they…

Statistics Theory · Mathematics 2019-04-01 Markus Reiß , Martin Wahl

When modeling multivariate data, one might have an extra parameter of contextual information that could be used to treat some observations as more similar to others. For example, images of faces can vary by age, and one would expect the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Ajay Gupta , Adrian Barbu

Principal Component Analysis (PCA) is an important tool of dimension reduction especially when the dimension (or the number of variables) is very high. Asymptotic studies where the sample size is fixed, and the dimension grows [i.e., High…

Statistics Theory · Mathematics 2009-11-20 Sungkyu Jung , J. S. Marron

In probabilistic principal component analysis (PPCA), an observed vector is modeled as a linear transformation of a low-dimensional Gaussian factor plus isotropic noise. We generalize PPCA to tensors by constraining the loading operator to…

Statistics Theory · Mathematics 2025-10-23 Yaoming Zhen , Piotr Zwiernik