English
Related papers

Related papers: Closed-Form, Provable, and Robust PCA via Leverage…

200 papers

Principal component analysis (PCA) is a widely used dimension reduction method, but its performance is known to be non-robust to outliers. Recently, product-PCA (PPCA) has been shown to possess the efficiency-loss free ordering-robustness…

Statistics Theory · Mathematics 2024-12-17 Hung Hung , Chi-Chun Yeh , Su-Yun Huang

The PC algorithm is the state-of-the-art algorithm for causal structure discovery on observational data. It can be computationally expensive in the worst case due to the conditional independence tests are performed in an…

Machine Learning · Computer Science 2021-09-13 Kai Zhang , Chao Tian , Kun Zhang , Todd Johnson , Xiaoqian Jiang

In many machine learning tasks, a common approach for dealing with large-scale data is to build a small summary, {\em e.g.,} coreset, that can efficiently represent the original input. However, real-world datasets usually contain outliers…

Machine Learning · Computer Science 2022-01-24 Zixiu Wang , Yiwen Guo , Hu Ding

PCA is one of the most widely used dimension reduction techniques. A related easier problem is "subspace learning" or "subspace estimation". Given relatively clean data, both are easily solved via singular value decomposition (SVD). The…

Information Theory · Computer Science 2020-06-25 Namrata Vaswani , Thierry Bouwmans , Sajid Javed , Praneeth Narayanamurthy

We study robust PCA for the fully observed setting, which is about separating a low rank matrix $\boldsymbol{L}$ and a sparse matrix $\boldsymbol{S}$ from their sum $\boldsymbol{D}=\boldsymbol{L}+\boldsymbol{S}$. In this paper, a new…

Information Theory · Computer Science 2021-06-29 HanQin Cai , Jian-Feng Cai , Ke Wei

In this paper we propose a new iterative algorithm to solve the fair PCA (FPCA) problem. We start with the max-min fair PCA formulation originally proposed in [1] and derive a simple and efficient iterative algorithm which is based on the…

Machine Learning · Statistics 2023-05-11 Prabhu Babu , Petre Stoica

Distributed algorithms and theories are called for in this era of big data. Under weaker local signal-to-noise ratios, we improve upon the celebrated one-round distributed principal component analysis (PCA) algorithm designed in the spirit…

Methodology · Statistics 2025-07-01 ZeYu Li , Xinsheng Zhang , Wang Zhou

Classical discriminant analysis (DA) is based on the mean and empirical covariance matrix of each class, both of which are sensitive to outliers in the data. In the past the focus was on casewise outliers, that is, datapoints that lie far…

Methodology · Statistics 2026-05-29 Fabio Centofanti , Can Hakan Dagidir , Mia Hubert , Peter J. Rousseeuw

We consider the problem of principal component analysis (PCA) in the presence of outliers. Given a matrix $A$ ($d \times n$) and parameters $k, m$, the goal is to remove a set of at most $m$ columns of $A$ (known as outliers), so as to…

Data Structures and Algorithms · Computer Science 2018-05-14 Aditya Bhaskara , Srivatsan Kumar

Often the challenge associated with tasks like fraud and spam detection[1] is the lack of all likely patterns needed to train suitable supervised learning models. In order to overcome this limitation, such tasks are attempted as outlier or…

Machine Learning · Computer Science 2018-08-22 Utkarsh Porwal , Smruthi Mukund

We propose a novel exemplar selection approach based on Principal Component Analysis (PCA) and median sampling, and a neural network training regime in the setting of class-incremental learning. This approach avoids the pitfalls due to…

Machine Learning · Computer Science 2023-12-18 Sahil Nokhwal , Nirman Kumar

In this work, we address the problem of outlier detection for robust motion estimation by using modern sparse-low-rank decompositions, i.e., Robust PCA-like methods, to impose global rank constraints. Robust decompositions have shown to be…

Computer Vision and Pattern Recognition · Computer Science 2014-10-23 German Ros , Jose Alvarez , Julio Guerrero

Robust PCA has drawn significant attention in the last decade due to its success in numerous application domains, ranging from bio-informatics, statistics, and machine learning to image and video processing in computer vision. Robust PCA…

Optimization and Control · Mathematics 2018-06-12 Shiqian Ma , Necdet Serhat Aybat

Principal component analysis (PCA) is known to be sensitive to outliers, so that various robust PCA variants were proposed in the literature. A recent model, called REAPER, aims to find the principal components by solving a convex…

Numerical Analysis · Mathematics 2021-03-19 Robert Beinert , Gabriele Steidl

The task of robust linear estimation in the presence of outliers is of particular importance in signal processing, statistics and machine learning. Although the problem has been stated a few decades ago and solved using classical…

Information Theory · Computer Science 2023-07-19 George Papageorgiou , Pantelis Bouboulis , Sergios Theodoridis , Kostantinos Themelis

This paper studies the subspace clustering problem in which data points collected from high-dimensional ambient space lie in a union of linear subspaces. Subspace clustering becomes challenging when the dimension of intersection between…

Machine Learning · Computer Science 2021-08-17 Weiwei Li , Mostafa Rahmani , Ping Li

Principal component analysis (PCA) has been widely applied to dimensionality reduction and data pre-processing for different applications in engineering, biology and social science. Classical PCA and its variants seek for linear projections…

Machine Learning · Computer Science 2017-07-11 Xiaojun Chang , Feiping Nie , Yi Yang , Heng Huang

We consider the problem of robust compressed sensing whose objective is to recover a high-dimensional sparse signal from compressed measurements corrupted by outliers. A new sparse Bayesian learning method is developed for robust compressed…

Machine Learning · Statistics 2016-10-24 Qian Wan , Huiping Duan , Jun Fang , Hongbin Li

Multilinear Principal Component Analysis (MPCA) is an important tool for analyzing tensor data. It performs dimension reduction similar to PCA for multivariate data. However, standard MPCA is sensitive to outliers. It is highly influenced…

Methodology · Statistics 2026-03-18 Mehdi Hirari , Fabio Centofanti , Mia Hubert , Stefan Van Aelst

As a widely used method in machine learning, principal component analysis (PCA) shows excellent properties for dimensionality reduction. It is a serious problem that PCA is sensitive to outliers, which has been improved by numerous Robust…

Machine Learning · Computer Science 2020-11-24 Shenglan Liu , Yang Yu
‹ Prev 1 3 4 5 6 7 10 Next ›