English
Related papers

Related papers: Fair principal component analysis (PCA): minorizat…

200 papers

Factor models have been widely used in economics and finance. However, the heavy-tailed nature of macroeconomic and financial data is often neglected in the existing literature. To address this issue and achieve robustness, we propose an…

Methodology · Statistics 2023-03-30 Yong He , Lingxiao Li , Dong Liu , Wen-Xin Zhou

Mining useful clusters from high dimensional data has received significant attention of the computer vision and pattern recognition community in the recent years. Linear and non-linear dimensionality reduction has played an important role…

Computer Vision and Pattern Recognition · Computer Science 2016-05-25 Nauman Shahid , Nathanael Perraudin , Vassilis Kalofolias , Gilles Puy , Pierre Vandergheynst

We study the fairness of dimensionality reduction methods for recommendations. We focus on the fundamental method of principal component analysis (PCA), which identifies latent components and produces a low-rank approximation via the…

Machine Learning · Computer Science 2025-05-30 David Liu , Jackie Baek , Tina Eliassi-Rad

Dimensionality reduction is a classical technique widely used for data analysis. One foundational instantiation is Principal Component Analysis (PCA), which minimizes the average reconstruction error. In this paper, we introduce the…

Discrete Mathematics · Computer Science 2020-06-17 Uthaipon Tantipongpipat , Samira Samadi , Mohit Singh , Jamie Morgenstern , Santosh Vempala

We describe and analyze a simple algorithm for principal component analysis and singular value decomposition, VR-PCA, which uses computationally cheap stochastic iterations, yet converges exponentially fast to the optimal solution. In…

Machine Learning · Computer Science 2015-08-03 Ohad Shamir

Principal component analysis (PCA) is a widely employed statistical tool used primarily for dimensionality reduction. However, it is known to be adversely affected by the presence of outlying observations in the sample, which is quite…

Methodology · Statistics 2023-09-26 Subhrajyoty Roy , Ayanendranath Basu , Abhik Ghosh

Sparse principal component analysis (SPCA) is widely used for dimensionality reduction and feature extraction in high-dimensional data analysis. Despite many methodological and theoretical developments in the past two decades, the…

Statistics Theory · Mathematics 2023-05-01 Teng Zhang , Haoyi Yang , Lingzhou Xue

Principal component analysis (PCA) is widely used for dimensionality reduction, with well-documented merits in various applications involving high-dimensional data, including computer vision, preference measurement, and bioinformatics. In…

Machine Learning · Statistics 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

It is well known that Principal Component Analysis (PCA) is strongly affected by outliers and a lot of effort has been put into robustification of PCA. In this paper we present a new algorithm for robust PCA minimizing the trimmed…

Machine Learning · Statistics 2015-06-02 Anastasia Podosinnikova , Simon Setzer , Matthias Hein

We consider the problem of outlier robust PCA (OR-PCA) where the goal is to recover principal directions despite the presence of outlier data points. That is, given a data matrix $M^*$, where $(1-\alpha)$ fraction of the points are noisy…

Machine Learning · Computer Science 2017-02-21 Yeshwanth Cherapanamjeri , Prateek Jain , Praneeth Netrapalli

We study robust PCA for the fully observed setting, which is about separating a low rank matrix $\boldsymbol{L}$ and a sparse matrix $\boldsymbol{S}$ from their sum $\boldsymbol{D}=\boldsymbol{L}+\boldsymbol{S}$. In this paper, a new…

Information Theory · Computer Science 2021-06-29 HanQin Cai , Jian-Feng Cai , Ke Wei

In this paper, we consider the sparse eigenvalue problem wherein the goal is to obtain a sparse solution to the generalized eigenvalue problem. We achieve this by constraining the cardinality of the solution to the generalized eigenvalue…

Machine Learning · Statistics 2009-10-13 Bharath Sriperumbudur , David Torres , Gert Lanckriet

The linearly constrained matrix rank minimization problem is widely applicable in many fields such as control, signal processing and system identification. The tightest convex relaxation of this problem is the linearly constrained nuclear…

Optimization and Control · Mathematics 2009-05-12 Shiqian Ma , Donald Goldfarb , Lifeng Chen

Robust Principal Component Analysis (RPCA) is a fundamental technique for decomposing data into low-rank and sparse components, which plays a critical role for applications such as image processing and anomaly detection. Traditional RPCA…

Machine Learning · Computer Science 2024-12-20 Kexin Li , You-wei Wen , Xu Xiao , Mingchao Zhao

In the context of sparse principal component detection, we bring evidence towards the existence of a statistical price to pay for computational efficiency. We measure the performance of a test by the smallest signal strength that it can…

Statistics Theory · Mathematics 2013-04-29 Quentin Berthet , Philippe Rigollet

Regularized variants of Principal Components Analysis, especially Sparse PCA and Functional PCA, are among the most useful tools for the analysis of complex high-dimensional data. Many examples of massive data, have both sparse and…

Machine Learning · Statistics 2019-08-21 Genevera I. Allen , Michael Weylandt

Principal Component Analysis (PCA) is widely used for dimensionality reduction and data analysis. However, PCA results are adversely affected by outliers often observed in real-world data. Existing robust PCA methods are often…

Computational Engineering, Finance, and Science · Computer Science 2025-06-23 Timbwaoga Aime Judicael Ouermi , Jixian Li , Chris R. Johnson

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise, Sigma = (sigma^2)*I. The maximum likelihood solution for the model is an…

Machine Learning · Statistics 2011-06-23 Alfredo A. Kalaitzis , Neil D. Lawrence

Principal Component Analysis (PCA) is known to be the most widely applied dimensionality reduction approach. A lot of improvements have been done on the traditional PCA, in order to obtain optimal results in the dimensionality reduction of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-28 Chisom Ezinne Ogbuanya

Robust principal component analysis (RPCA) is a widely used technique for recovering low-rank structure from matrices with missing entries and sparse, possibly large-magnitude corruptions. Although numerous algorithms achieve accurate point…

Methodology · Statistics 2026-03-17 Liangliang Yuan , Lei Wang , Quan Kong , Liuhua Peng
‹ Prev 1 3 4 5 6 7 10 Next ›