English
Related papers

Related papers: Sharp detection in PCA under correlations: all eig…

200 papers

Conventional principal component analysis (PCA) finds a principal vector that maximizes the sum of second powers of principal components. We consider a generalized PCA that aims at maximizing the sum of an arbitrary convex function of…

Machine Learning · Computer Science 2019-11-19 Samuele Battaglino , Erdem Koyuncu

Dimension reduction is useful for exploratory data analysis. In many applications, it is of interest to discover variation that is enriched in a "foreground" dataset relative to a "background" dataset. Recently, contrastive principal…

Methodology · Statistics 2021-05-04 Didong Li , Andrew Jones , Barbara Engelhardt

Feature extraction and dimensionality reduction are important tasks in many fields of science dealing with signal processing and analysis. The relevance of these techniques is increasing as current sensory devices are developed with ever…

Machine Learning · Statistics 2013-10-21 Jerónimo Arenas-García , Kaare Brandt Petersen , Gustavo Camps-Valls , Lars Kai Hansen

Deep neural networks perform remarkably well on image classification tasks but remain vulnerable to carefully crafted adversarial perturbations. This work revisits linear dimensionality reduction as a simple, data-adapted defense. We…

Machine Learning · Computer Science 2025-10-08 Killian Steunou , Théo Druilhe , Sigurd Saue

In the context of sparse principal component detection, we bring evidence towards the existence of a statistical price to pay for computational efficiency. We measure the performance of a test by the smallest signal strength that it can…

Statistics Theory · Mathematics 2013-04-29 Quentin Berthet , Philippe Rigollet

Given a matrix of observed data, Principal Components Analysis (PCA) computes a small number of orthogonal directions that contain most of its variability. Provably accurate solutions for PCA have been in use for a long time. However, to…

Machine Learning · Computer Science 2016-11-01 Namrata Vaswani , Han Guo

Given a matrix of observed data, Principal Components Analysis (PCA) computes a small number of orthogonal directions that contain most of its variability. Provably accurate solutions for PCA have been in use for a long time. However, to…

Machine Learning · Computer Science 2016-11-03 Namrata Vaswani , Han Guo

Principal component analysis (PCA) has achieved great success in unsupervised learning by identifying covariance correlations among features. If the data collection fails to capture the covariance information, PCA will not be able to…

Computational Physics · Physics 2021-08-24 Ziming Liu , Sitian Qian , Yixuan Wang , Yuxuan Yan , Tianyi Yang

The study of stability and sensitivity of statistical methods or algorithms with respect to their data is an important problem in machine learning and statistics. The performance of the algorithm under resampling of the data is a…

Statistics Theory · Mathematics 2023-02-15 Haoyu Wang

The topic of this tutorial is Least Squares Sparse Principal Components Analysis (LS SPCA) which is a simple method for computing approximated Principal Components which are combinations of only a few of the observed variables. Analogously…

Methodology · Statistics 2021-05-31 Giovanni Maria Merola

In this paper, we study the problem of sparse Principal Component Analysis (PCA) in the high-dimensional setting with missing observations. Our goal is to estimate the first principal component when we only have access to partial…

Statistics Theory · Mathematics 2012-06-04 Karim Lounici

Principal component analysis (PCA) is a key tool in the field of data dimensionality reduction that is useful for various data science problems. However, many applications involve heterogeneous data that varies in quality due to noise…

Machine Learning · Statistics 2023-11-14 Javier Salazar Cavazos , Jeffrey A. Fessler , Laura Balzano

To mitigate the severe information loss arising from widely adopted linear scale cuts in constraints on modified gravity parameterisations with Weak Lensing (WL) and Large-Scale Structure (LSS) data, we introduce a novel alternative method…

Cosmology and Nongalactic Astrophysics · Physics 2026-03-10 C. M. A. Zanoletti , C. D. Leonard

Principal Component Analysis is a novel way of of dimensionality reduction. This problem essentially boils down to finding the top k eigen vectors of the data covariance matrix. A considerable amount of literature is found on algorithms…

Machine Learning · Computer Science 2019-01-08 Jian Vora

In this work we investigate the Principal Component Analysis (PCA) sensitivity to the velocity power spectrum in high opacity regimes of the interstellar medium (ISM). For our analysis we use synthetic Position-Position-Velocity (PPV) cubes…

Principal component analysis (PCA) is an essential algorithm for dimensionality reduction in many data science domains. We address the problem of performing a federated PCA on private data distributed among multiple data providers while…

Principal component analysis (PCA) plays an important role in the analysis of cryo-EM images for various tasks such as classification, denoising, compression, and ab-initio modeling. We introduce a fast method for estimating a compressed…

Numerical Analysis · Mathematics 2022-11-01 Nicholas F. Marshall , Oscar Mickelin , Yunpeng Shi , Amit Singer

We study principal component analysis (PCA) for mean zero i.i.d. Gaussian observations $X_1,\dots, X_n$ in a separable Hilbert space $\mathbb{H}$ with unknown covariance operator $\Sigma.$ The complexity of the problem is characterized by…

Statistics Theory · Mathematics 2019-01-21 Vladimir Koltchinskii , Matthias Löffler , Richard Nickl

We study the problem of high-dimensional Principal Component Analysis (PCA) with missing observations. In simple, homogeneous missingness settings with a noise level of constant order, we show that an existing inverse-probability weighted…

Methodology · Statistics 2019-07-01 Ziwei Zhu , Tengyao Wang , Richard J. Samworth

Principal components analysis (PCA) is a standard tool for identifying good low-dimensional approximations to data in high dimension. Many data sets of interest contain private or sensitive information about individuals. Algorithms which…

Machine Learning · Statistics 2013-08-09 Kamalika Chaudhuri , Anand D. Sarwate , Kaushik Sinha