English
Related papers

Related papers: Penalized Principal Component Analysis Using Smoot…

200 papers

Principal Component Analysis (PCA) is a popular tool for dimensionality reduction and feature extraction in data analysis. There is a probabilistic version of PCA, known as Probabilistic PCA (PPCA). However, standard PCA and PPCA are not…

Machine Learning · Computer Science 2019-04-16 Bowen Zhao , Xi Xiao , Wanpeng Zhang , Bin Zhang , Shutao Xia

Principal component analysis (PCA) is a classical and ubiquitous method for reducing data dimensionality, but it is suboptimal for heterogeneous data that are increasingly common in modern applications. PCA treats all samples uniformly so…

Statistics Theory · Mathematics 2021-12-02 David Hong , Kyle Gilman , Laura Balzano , Jeffrey A. Fessler

Principal Component Analysis (PCA) has been used to study the pathogenesis of diseases. To enhance the interpretability of classical PCA, various improved PCA methods have been proposed to date. Among these, a typical method is the…

Machine Learning · Computer Science 2019-05-29 Chun-Mei Feng , Yong Xu , Jin-Xing Liu , Ying-Lian Gao , Chun-Hou Zheng

Principal Component Analysis (PCA) is a very successful dimensionality reduction technique, widely used in predictive modeling. A key factor in its widespread use in this domain is the fact that the projection of a dataset onto its first…

Machine Learning · Statistics 2017-05-19 Xianghui Luo , Robert J. Durrant

Principal Component Analysis (PCA) is a pivotal technique widely utilized in the realms of machine learning and data analysis. It aims to reduce the dimensionality of a dataset while minimizing the loss of information. In recent years,…

Cryptography and Security · Computer Science 2024-02-06 Xirong Ma

We study distributed principal component analysis (PCA) in high-dimensional settings under the spiked model. In such regimes, sample eigenvectors can deviate significantly from population ones, introducing a persistent bias. Existing…

Methodology · Statistics 2025-05-29 Weiming Li , Zeng Li , Siyu Wang , Yanqing Yin , Junpeng Zhu

With the development of high-throughput technologies, principal component analysis (PCA) in the high-dimensional regime is of great interest. Most of the existing theoretical and methodological results for high-dimensional PCA are based on…

Statistics Theory · Mathematics 2019-03-11 Rounak Dey , Seunggeun Lee

We introduce a novel algorithm that computes the $k$-sparse principal component of a positive semidefinite matrix $A$. Our algorithm is combinatorial and operates by examining a discrete set of special vectors lying in a low-dimensional…

Machine Learning · Statistics 2014-05-09 Dimitris S. Papailiopoulos , Alexandros G. Dimakis , Stavros Korokythakis

Sparse principal component analysis (sPCA) has become one of the most widely used techniques for dimensionality reduction in high-dimensional datasets. The main challenge underlying sPCA is to estimate the first vector of loadings of the…

Methodology · Statistics 2018-02-01 Jana Janková , Sara van de Geer

Principal Component Analysis (PCA) is one of the most commonly used statistical methods for data exploration, and for dimensionality reduction wherein the first few principal components account for an appreciable proportion of the…

Methodology · Statistics 2024-01-11 Caren Marzban , Ulvi Yurtsever , Michael Richman

The problem of recovering a low-rank matrix from a set of observations corrupted with gross sparse error is known as the robust principal component analysis (RPCA) and has many applications in computer vision, image processing and web data…

Optimization and Control · Mathematics 2013-09-27 Necdet Serhat Aybat , Donald Goldfarb , Shiqian Ma

Principal component regression (PCR) is a two-stage procedure that selects some principal components and then constructs a regression model regarding them as new explanatory variables. Note that the principal components are obtained from…

Machine Learning · Statistics 2015-05-12 Shuichi Kawano , Hironori Fujisawa , Toyoyuki Takada , Toshihiko Shiroishi

This paper introduces a Projected Principal Component Analysis (Projected-PCA), which employs principal component analysis to the projected (smoothed) data matrix onto a given linear space spanned by covariates. When it applies to…

Methodology · Statistics 2016-01-18 Jianqing Fan , Yuan Liao , Weichen Wang

Sparse Principal Component Analysis (SPCA) is an important technique for high-dimensional data analysis, improving interpretability by imposing sparsity on principal components. However, existing methods often fail to simultaneously…

Machine Learning · Computer Science 2026-03-03 Difei Cheng , Qiao Hu

Principal component analysis (PCA) is a widespread technique for data analysis that relies on the covariance-correlation matrix of the analyzed data. However to properly work with high-dimensional data, PCA poses severe mathematical…

Quantitative Methods · Quantitative Biology 2018-10-18 Luigi Leonardo Palese

We consider the Sparse Principal Component Analysis (SPCA) problem under the well-known spiked covariance model. Recent work has shown that the SPCA problem can be reformulated as a Mixed Integer Program (MIP) and can be solved to global…

Methodology · Statistics 2026-04-06 Kayhan Behdin , Rahul Mazumder

Learning augmented is a machine learning concept built to improve the performance of a method or model, such as enhancing its ability to predict and generalize data or features, or testing the reliability of the method by introducing noise…

Machine Learning · Computer Science 2024-01-09 Issam K. O Jabari , Shofiyah , Pradiptya Kahvi S , Novi Nur Putriwijaya , Novanto Yudistira

Data collection often results in records that have missing values or variables. This investigation compares 3 different data imputation models and identifies their merits by using accuracy measures. Autoencoder Neural Networks, Principal…

Artificial Intelligence · Computer Science 2007-09-18 Vukosi N. Marivate , Fulufhelo V. Nelwamodo , Tshilidzi Marwala

In this paper, Kernel PCA is reinterpreted as the solution to a convex optimization problem. Actually, there is a constrained convex problem for each principal component, so that the constraints guarantee that the principal component is…

Machine Learning · Computer Science 2017-10-25 Carlos M. Alaíz , Michaël Fanuel , Johan A. K. Suykens

Principal component analysis (PCA) is a widely used unsupervised dimensionality reduction technique in machine learning, applied across various fields such as bioinformatics, computer vision and finance. However, when the response variables…

Applications · Statistics 2025-06-25 Theodosios Papazoglou , Guosheng Yin