English
Related papers

Related papers: Robust PCA for Anomaly Detection and Data Imputati…

200 papers

We consider estimation of large approximate factor models in high-dimensional panels of stationary time series using Principal Component Analysis (PCA). We review the key results establishing the necessary and sufficient conditions for…

Econometrics · Economics 2026-02-13 Matteo Barigozzi

Data quality (DQ) remains a fundamental concern in big data pipelines, especially when aggregations occur at multiple hierarchical levels. Traditional DQ validation rules often fail to scale or generalize across dimensions such as user…

Databases · Computer Science 2025-04-22 Preetam Kumar Ojha

Principal component analysis (PCA) is a well-established tool in machine learning and data processing. The principal axes in PCA were shown to be equivalent to the maximum marginal likelihood estimator of the factor loading matrix in a…

Methodology · Statistics 2019-10-25 Mengyang Gu , Weining Shen

Principal component analysis (PCA) is an exploratory tool widely used in data analysis to uncover dominant patterns of variability within a population. Despite its ability to represent a data set in a low-dimensional space, the…

Principal Component Analysis (PCA) has wide applications in machine learning, text mining and computer vision. Classical PCA based on a Gaussian noise model is fragile to noise of large magnitude. Laplace noise assumption based PCA methods…

Machine Learning · Computer Science 2014-12-22 Pengtao Xie , Eric Xing

Principal component analysis (PCA) is known to be sensitive to outliers, so that various robust PCA variants were proposed in the literature. A recent model, called REAPER, aims to find the principal components by solving a convex…

Numerical Analysis · Mathematics 2021-03-19 Robert Beinert , Gabriele Steidl

We study principal component analysis (PCA), where given a dataset in $\mathbb{R}^d$ from a distribution, the task is to find a unit vector $v$ that approximately maximizes the variance of the distribution after being projected along $v$.…

Machine Learning · Computer Science 2023-05-05 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas

Principal component analysis (PCA) is a fundamental tool in multivariate statistics, yet its sensitivity to outliers and limitations in distributed environments restrict its effectiveness in modern large-scale applications. To address these…

Methodology · Statistics 2025-10-16 Hung Hung , Zhi-Yu Jou , Su-Yun Huang , Shinto Eguchi

Principal component analysis (PCA) is a classical and widely used method for dimensionality reduction, with applications in data compression, computer vision, pattern recognition, and signal processing. However, PCA is designed for…

Methodology · Statistics 2025-10-01 Wenhui Wu , Changchun Shang , Jianhua Zhao , Xuan Ma , Yue Wang

This paper introduces a novel sparse latent factor modeling framework using sparse asymptotic Principal Component Analysis (APCA) to analyze the co-movements of high-dimensional panel data over time. Unlike existing methods based on sparse…

Methodology · Statistics 2025-08-08 Zhaoxing Gao

In this paper we analyze different ways of performing principal component analysis throughout three different approaches: robust covariance and correlation matrix estimation, projection pursuit approach and non-parametric maximum entropy…

Statistics Theory · Mathematics 2019-03-04 María Camila Vásquez-Correa , Henry Laniado Rodas

Sparse versions of principal component analysis (PCA) have imposed themselves as simple, yet powerful ways of selecting relevant features of high-dimensional data in an unsupervised manner. However, when several sparse principal components…

Machine Learning · Statistics 2019-05-22 Charles Bouveyron , Pierre Latouche , Pierre-Alexandre Mattei

Principal component analysis (PCA) is a statistical technique commonly used in multivariate data analysis. However, PCA can be difficult to interpret and explain since the principal components (PCs) are linear combinations of the original…

Mathematical Software · Computer Science 2013-12-24 W. Liu , H. Zhang , D. Tao , Y. Wang , K. Lu

In this paper, we study the problem of recovering a low-rank matrix (the principal components) from a high-dimensional data matrix despite both small entry-wise noise and gross sparse errors. Recently, it has been shown that a convex…

Information Theory · Computer Science 2010-01-15 Zihan Zhou , Xiaodong Li , John Wright , Emmanuel Candes , Yi Ma

Robust principal component analysis (RPCA) is a powerful method for learning low-rank feature representation of various visual data. However, for certain types as well as significant amount of error corruption, it fails to yield…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Niannan Xue , Jiankang Deng , Shiyang Cheng , Yannis Panagakis , Stefanos Zafeiriou

A major concern when dealing with financial time series involving a wide variety ofmarket risk factors is the presence of anomalies. These induce a miscalibration of the models used toquantify and manage risk, resulting in potential…

Statistical Finance · Quantitative Finance 2022-10-26 Stéphane Crépey , Lehdili Noureddine , Nisrine Madhar , Maud Thomas

We propose a new method for robust PCA -- the task of recovering a low-rank matrix from sparse corruptions that are of unknown value and support. Our method involves alternating between projecting appropriate residuals onto the set of…

Information Theory · Computer Science 2014-10-29 Praneeth Netrapalli , U N Niranjan , Sujay Sanghavi , Animashree Anandkumar , Prateek Jain

Robust principal component analysis (RPCA) is a widely used tool for dimension reduction. In this work, we propose a novel non-convex algorithm, coined Iterated Robust CUR (IRCUR), for solving RPCA problems, which dramatically improves the…

Machine Learning · Statistics 2021-02-09 HanQin Cai , Keaton Hamm , Longxiu Huang , Jiaqi Li , Tao Wang

Robust principal component analysis (RPCA) has been widely used for recovering low-rank matrices in many data mining and machine learning problems. It separates a data matrix into a low-rank part and a sparse part. The convex approach has…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Chong Peng , Zhao Kang , Qiang Chen

Many machine learning systems are vulnerable to small perturbations made to inputs either at test time or at training time. This has received much recent interest on the empirical front due to applications where reliability and security are…

Data Structures and Algorithms · Computer Science 2021-08-16 Pranjal Awasthi , Vaggos Chatziafratis , Xue Chen , Aravindan Vijayaraghavan