English
Related papers

Related papers: Riemannian CUR Decompositions for Robust Principal…

200 papers

A principal component analysis (PCA) of clean microcalorimeter pulse records can be a first step beyond statistically optimal linear filtering of pulses towards a fully non-linear analysis. For PCA to be practical on spectrometers with…

Data Analysis, Statistics and Probability · Physics 2020-01-08 J. W. Fowler , B. K. Alpert , Y. -I. Joe , G. C. O'Neil , D. S. Swetz , J. N. Ullom

Principal Component Analysis (PCA) is a transform for finding the principal components (PCs) that represent features of random data. PCA also provides a reconstruction of the PCs to the original data. We consider an extension of PCA which…

Methodology · Statistics 2021-11-05 Pablo Soto-Quiros , Anatoli Torokhti

Recent methods for learning a linear subspace from data corrupted by outliers are based on convex $\ell_1$ and nuclear norm optimization and require the dimension of the subspace and the number of outliers to be sufficiently small. In sharp…

Machine Learning · Computer Science 2018-12-27 Zhihui Zhu , Yifan Wang , Daniel P. Robinson , Daniel Q. Naiman , Rene Vidal , Manolis C. Tsakiris

Recovering intrinsic low dimensional subspaces from data distributed on them is a key preprocessing step to many applications. In recent years, there has been a lot of work that models subspace recovery as low rank minimization problems. We…

Machine Learning · Computer Science 2014-12-09 Hongyang Zhang , Zhouchen Lin , Chao Zhang , Junbin Gao

Robust principal component analysis (RPCA) is a powerful method for learning low-rank feature representation of various visual data. However, for certain types as well as significant amount of error corruption, it fails to yield…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Niannan Xue , Jiankang Deng , Shiyang Cheng , Yannis Panagakis , Stefanos Zafeiriou

The CUR decomposition is a technique for low-rank approximation that selects small subsets of the columns and rows of a given matrix to use as bases for its column and rowspaces. It has recently attracted much interest, as it has several…

Numerical Analysis · Mathematics 2022-06-06 Yijun Dong , Per-Gunnar Martinsson

In this paper, we study the problem of recovering a low-rank matrix (the principal components) from a high-dimensional data matrix despite both small entry-wise noise and gross sparse errors. Recently, it has been shown that a convex…

Information Theory · Computer Science 2010-01-15 Zihan Zhou , Xiaodong Li , John Wright , Emmanuel Candes , Yi Ma

The CUR matrix decomposition is an important extension of Nystr\"{o}m approximation to a general matrix. It approximates any data matrix in terms of a small number of its columns and rows. In this paper we propose a novel randomized CUR…

Machine Learning · Computer Science 2012-10-05 Shusen Wang , Zhihua Zhang , Jian Li

We consider the problem of outlier robust PCA (OR-PCA) where the goal is to recover principal directions despite the presence of outlier data points. That is, given a data matrix $M^*$, where $(1-\alpha)$ fraction of the points are noisy…

Machine Learning · Computer Science 2017-02-21 Yeshwanth Cherapanamjeri , Prateek Jain , Praneeth Netrapalli

Probabilistic principal component analysis (PPCA) is a probabilistic reformulation of principal component analysis (PCA), under the framework of a Gaussian latent variable model. To improve the robustness of PPCA, it has been proposed to…

Methodology · Statistics 2023-11-28 Yiping Guo , Howard D. Bondell

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approximately sparse after…

Machine Learning · Statistics 2023-08-07 Fan Chen , Karl Rohe

The study of stability and sensitivity of statistical methods or algorithms with respect to their data is an important problem in machine learning and statistics. The performance of the algorithm under resampling of the data is a…

Statistics Theory · Mathematics 2023-02-15 Haoyu Wang

This work studies the recursive robust principal components analysis (PCA) problem. If the outlier is the signal-of-interest, this problem can be interpreted as one of recursively recovering a time sequence of sparse vectors, $S_t$, in the…

Information Theory · Computer Science 2014-03-28 Chenlu Qiu , Namrata Vaswani , Brian Lois , Leslie Hogben

Principal component analysis (PCA), along with its extensions to manifolds and outlier contaminated data, have been indispensable in computer vision and machine learning. In this work, we present a unifying formalism for PCA and its…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Nathan Mankovich , Gustau Camps-Valls , Tolga Birdal

Unsupervised learning techniques in computer vision often require learning latent representations, such as low-dimensional linear and non-linear subspaces. Noise and outliers in the data can frustrate these approaches by obscuring the…

Principal components analysis (PCA) is a widely used dimension reduction technique with an extensive range of applications. In this paper, an online distributed algorithm is proposed for recovering the principal eigenspaces. We further…

Machine Learning · Statistics 2019-05-20 Davoud Ataee Tarzanagh , Mohamad Kazem Shirani Faradonbeh , George Michailidis

Dimension reduction is often an important step in the analysis of high-dimensional data. PCA is a popular technique to find the best low-dimensional approximation of high-dimensional data. However, classical PCA is very sensitive to…

Computation · Statistics 2019-01-14 Holger Cevallos-Valdiviezo , Stefan Van Aelst

Recent advances have sparked significant interest in the development of privacy-preserving Principal Component Analysis (PCA). However, many existing approaches rely on restrictive assumptions, such as assuming sub-Gaussian data or being…

Methodology · Statistics 2025-07-22 Minwoo Kim , Sungkyu Jung

The performance of the standard Online Robust Principal Component Analysis (OR-PCA) technique depends on the optimum tuning of the explicit regularizers and this tuning is dataset sensitive. We aim to remove the dependency on these tuning…

Machine Learning · Computer Science 2025-08-15 Lakshmi Jayalal , Gokularam Muthukrishnan , Sheetal Kalyani

Principal component analysis (PCA) is one of the most fundamental procedures in exploratory data analysis and is the basic step in applications ranging from quantitative finance and bioinformatics to image analysis and neuroscience.…

Data Structures and Algorithms · Computer Science 2019-05-13 Fedor V. Fomin , Petr A. Golovach , Fahad Panolan , Kirill Simonov