English
Related papers

Related papers: Closed-Form, Provable, and Robust PCA via Leverage…

200 papers

Principal component analysis (PCA) is widely used to analyze high-dimensional data, but it is very sensitive to outliers. Robust PCA methods seek fits that are unaffected by the outliers and can therefore be trusted to reveal them. FastHCS…

Methodology · Statistics 2015-09-25 E. Schmitt , K. Vakili

Principal Component Analysis (PCA) is a popular tool for dimensionality reduction and feature extraction in data analysis. There is a probabilistic version of PCA, known as Probabilistic PCA (PPCA). However, standard PCA and PPCA are not…

Machine Learning · Computer Science 2019-04-16 Bowen Zhao , Xi Xiao , Wanpeng Zhang , Bin Zhang , Shutao Xia

Unsupervised learning methods are well established in the area of anomaly detection and achieve state of the art performances on outlier datasets. Outliers play a significant role, since they bear the potential to distort the predictions of…

Machine Learning · Computer Science 2024-07-02 Andreas Lohrer , Daniyal Kazempour , Maximilian Hünemörder , Peer Kröger

We explore the connection between outlier-robust high-dimensional statistics and non-convex optimization in the presence of sparsity constraints, with a focus on the fundamental tasks of robust sparse mean estimation and robust sparse PCA.…

Machine Learning · Computer Science 2022-11-15 Yu Cheng , Ilias Diakonikolas , Rong Ge , Shivam Gupta , Daniel M. Kane , Mahdi Soltanolkotabi

A principal component analysis (PCA) of clean microcalorimeter pulse records can be a first step beyond statistically optimal linear filtering of pulses towards a fully non-linear analysis. For PCA to be practical on spectrometers with…

Data Analysis, Statistics and Probability · Physics 2020-01-08 J. W. Fowler , B. K. Alpert , Y. -I. Joe , G. C. O'Neil , D. S. Swetz , J. N. Ullom

Principal component analysis (PCA) is a widely used method for data processing, such as for dimension reduction and visualization. Standard PCA is known to be sensitive to outliers, and thus, various robust PCA methods have been proposed.…

Machine Learning · Statistics 2020-08-11 Keishi Sando , Hideitsu Hino

Principal Component Analysis (PCA) finds a linear mapping and maximizes the variance of the data which makes PCA sensitive to outliers and may cause wrong eigendirection. In this paper, we propose techniques to solve this problem; we use…

Artificial Intelligence · Computer Science 2012-07-03 Peratham Wiriyathammabhum , Boonserm Kijsirikul

Recently, the robustification of principal component analysis has attracted lots of attention from statisticians, engineers and computer scientists. In this work we study the type of outliers that are not necessarily apparent in the…

Methodology · Statistics 2016-01-29 Yiyuan She , Shijie Li , Dapeng Wu

Principal component analysis (PCA) is a popular dimension reduction technique for vector data. Factored PCA (FPCA) is a probabilistic extension of PCA for matrix data, which can substantially reduce the number of parameters in PCA while…

Machine Learning · Statistics 2023-12-19 Xuan Ma , Jianhua Zhao , Yue Wang

In this paper, we propose a novel robust Principal Component Analysis (PCA) for high-dimensional data in the presence of various heterogeneities, especially the heavy-tailedness and outliers. A transformation motivated by the characteristic…

Methodology · Statistics 2022-04-05 Lingyu He , Yanrong Yang , Bo Zhang

Principal Component Analysis (PCA) has been widely used for dimensionality reduction and feature extraction. Robust PCA (RPCA), under different robust distance metrics, such as l1-norm and l2, p-norm, can deal with noise or outliers to some…

Machine Learning · Computer Science 2021-06-29 Zhao Kang , Hongfei Liu , Jiangxin Li , Xiaofeng Zhu , Ling Tian

Many traditional methods for identifying changepoints can struggle in the presence of outliers, or when the noise is heavy-tailed. Often they will infer additional changepoints in order to fit the outliers. To overcome this problem, data…

Methodology · Statistics 2017-07-12 Paul Fearnhead , Guillem Rigaill

We propose a novel unsupervised outlier detection method based on Randomized Principal Component Analysis (PCA). Motivated by the performance of Randomized PCA (RPCA) Forest in approximate K-Nearest Neighbor (KNN) search, we develop a novel…

Machine Learning · Computer Science 2026-05-12 Muhammad Rajabinasab , Farhad Pakdaman , Moncef Gabbouj , Peter Schneider-Kamp , Arthur Zimek

Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA to non-Gaussian…

Machine Learning · Statistics 2019-10-28 Jean P. Chereau , Bruno Scalzo Dees , Danilo P. Mandic

Principal component analysis (PCA) is one of the most fundamental procedures in exploratory data analysis and is the basic step in applications ranging from quantitative finance and bioinformatics to image analysis and neuroscience.…

Data Structures and Algorithms · Computer Science 2019-05-13 Fedor V. Fomin , Petr A. Golovach , Fahad Panolan , Kirill Simonov

Robust principal component analysis (RPCA) is a critical tool in modern machine learning, which detects outliers in the task of low-rank matrix reconstruction. In this paper, we propose a scalable and learnable non-convex approach for…

Machine Learning · Computer Science 2023-02-28 HanQin Cai , Jialin Liu , Wotao Yin

A first proposal of a sparse and cellwise robust PCA method is presented. Robustness to single outlying cells in the data matrix is achieved by substituting the squared loss function for the approximation error by a robust version. The…

Computation · Statistics 2024-08-29 Pia Pfeiffer , Laura Vana-Gür , Peter Filzmoser

Notwithstanding the popularity of conventional clustering algorithms such as K-means and probabilistic clustering, their clustering results are sensitive to the presence of outliers in the data. Even a few outliers can compromise the…

Machine Learning · Statistics 2015-05-27 Pedro A. Forero , Vassilis Kekatos , Georgios B. Giannakis

This article studies the robustness of the eigenvalue ordering, an important issue when estimating the leading eigen-subspace by principal component analysis (PCA). In Yata and Aoshima (2010), cross-data-matrix PCA (CDM-PCA) was proposed…

Methodology · Statistics 2025-03-24 Hung Hung , Su-Yun Huang

The combination of the Internet of Things and the Edge Computing gives many opportunities to support innovative applications close to end users. Numerous devices present in both infrastructures can collect data upon which various processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-02 Kostas Kolomvatsos , Christos Anagnostopoulos