English
Related papers

Related papers: Provable Dynamic Robust PCA or Robust Subspace Tra…

200 papers

This paper delivers improved theoretical guarantees for the convex programming approach in low-rank matrix estimation, in the presence of (1) random noise, (2) gross sparse outliers, and (3) missing data. This problem, often dubbed as…

Machine Learning · Statistics 2022-09-13 Yuxin Chen , Jianqing Fan , Cong Ma , Yuling Yan

When synthesizing multi-source high-dimensional data, a key objective is to extract low-dimensional representations that effectively approximate the original features across different sources. Such representations facilitate the discovery…

Machine Learning · Computer Science 2026-03-10 Zhenyu Wang , Molei Liu , Jing Lei , Francis Bach , Zijian Guo

Robust Principal Component Analysis (PCA) has received massive attention in recent years. It aims to recover a low-rank matrix and a sparse matrix from their sum. This paper proposes a novel nonconvex Robust PCA algorithm, coined Riemannian…

Machine Learning · Statistics 2023-02-28 Keaton Hamm , Mohamed Meskini , HanQin Cai

Principal Component Analysis (PCA) is a popular tool for dimensionality reduction and feature extraction in data analysis. There is a probabilistic version of PCA, known as Probabilistic PCA (PPCA). However, standard PCA and PPCA are not…

Machine Learning · Computer Science 2019-04-16 Bowen Zhao , Xi Xiao , Wanpeng Zhang , Bin Zhang , Shutao Xia

Principal component analysis (PCA) is known to be sensitive to outliers, so that various robust PCA variants were proposed in the literature. A recent model, called REAPER, aims to find the principal components by solving a convex…

Numerical Analysis · Mathematics 2021-03-19 Robert Beinert , Gabriele Steidl

In this paper, we propose a novel robust Principal Component Analysis (PCA) for high-dimensional data in the presence of various heterogeneities, especially the heavy-tailedness and outliers. A transformation motivated by the characteristic…

Methodology · Statistics 2022-04-05 Lingyu He , Yanrong Yang , Bo Zhang

High dimensional data has introduced challenges that are difficult to address when attempting to implement classical approaches of statistical process control. This has made it a topic of interest for research due in recent years. However,…

Applications · Statistics 2019-04-23 Mohammad Nabhan , Yajun Mei , Jianjun Shi

An increasing number of data science and machine learning problems rely on computation with tensors, which better capture the multi-way relationships and interactions of data than matrices. When tapping into this critical advantage, a key…

Machine Learning · Statistics 2023-02-23 Harry Dong , Tian Tong , Cong Ma , Yuejie Chi

Sparse Principal Component Analysis (PCA) methods are efficient tools to reduce the dimension (or the number of variables) of complex data. Sparse principal components (PCs) are easier to interpret than conventional PCs, because most…

Statistics Theory · Mathematics 2011-04-22 Dan Shen , Haipeng Shen , J. S. Marron

Robust Principal Component Analysis (RPCA) is a fundamental technique for decomposing data into low-rank and sparse components, which plays a critical role for applications such as image processing and anomaly detection. Traditional RPCA…

Machine Learning · Computer Science 2024-12-20 Kexin Li , You-wei Wen , Xu Xiao , Mingchao Zhao

This paper introduces a robust approach to functional principal component analysis (FPCA) for relative data, particularly density functions. While recent papers have studied density data within the Bayes space framework, there has been…

This paper presents a remarkably simple, yet powerful, algorithm termed Coherence Pursuit (CoP) to robust Principal Component Analysis (PCA). As inliers lie in a low dimensional subspace and are mostly correlated, an inlier is likely to…

Machine Learning · Computer Science 2017-11-28 Mostafa Rahmani , George Atia

Most high-dimensional matrix recovery problems are studied under the assumption that the target matrix has certain intrinsic structures. For image data related matrix recovery problems, approximate low-rankness and smoothness are the two…

Machine Learning · Statistics 2021-04-08 Long Feng , Junhui Wang

In this paper, we explore the theoretical properties of subspace recovery using Winsorized Principal Component Analysis (WPCA), utilizing a common data transformation technique that caps extreme values to mitigate the impact of outliers.…

Machine Learning · Statistics 2025-02-25 Sangil Han , Kyoowon Kim , Sungkyu Jung

Recovering intrinsic low dimensional subspaces from data distributed on them is a key preprocessing step to many applications. In recent years, there has been a lot of work that models subspace recovery as low rank minimization problems. We…

Machine Learning · Computer Science 2014-12-09 Hongyang Zhang , Zhouchen Lin , Chao Zhang , Junbin Gao

Principal Component Analysis (PCA) is a method for estimating a subspace given noisy samples. It is useful in a variety of problems ranging from dimensionality reduction to anomaly detection and the visualization of high dimensional data.…

Statistics Theory · Mathematics 2019-06-14 David Hong , Laura Balzano , Jeffrey A. Fessler

Subspace tracking is a fundamental problem in signal processing, where the goal is to estimate and track the underlying subspace that spans a sequence of data streams over time. In high-dimensional settings, data samples are often corrupted…

Random projection is widely used as a method of dimension reduction. In recent years, its combination with standard techniques of regression and classification has been explored. Here we examine its use with principal component analysis…

Methodology · Statistics 2012-04-13 Qi Ding , Eric D. Kolaczyk

We consider the problem of outlier robust PCA (OR-PCA) where the goal is to recover principal directions despite the presence of outlier data points. That is, given a data matrix $M^*$, where $(1-\alpha)$ fraction of the points are noisy…

Machine Learning · Computer Science 2017-02-21 Yeshwanth Cherapanamjeri , Prateek Jain , Praneeth Netrapalli

In this paper, a new method is proposed for sparse PCA based on the recursive divide-and-conquer methodology. The main idea is to separate the original sparse PCA problem into a series of much simpler sub-problems, each having a closed-form…

Computer Vision and Pattern Recognition · Computer Science 2012-12-03 Qian Zhao , Deyu Meng , Zongben Xu