English
Related papers

Related papers: Sparse Kernel PCA for Outlier Detection

200 papers

We develop a new principal components analysis (PCA) type dimension reduction method for binary data. Different from the standard PCA which is defined on the observed data, the proposed PCA is defined on the logit transform of the success…

Applications · Statistics 2010-11-17 Seokho Lee , Jianhua Z. Huang , Jianhua Hu

We consider the following multi-component sparse PCA problem: given a set of data points, we seek to extract a small number of sparse components with disjoint supports that jointly capture the maximum possible variance. These components can…

In the field of unsupervised feature selection, sparse principal component analysis (SPCA) methods have attracted more and more attention recently. Compared to spectral-based methods, SPCA methods don't rely on the construction of a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Junjing Zheng , Xinyu Zhang , Yongxiang Liu , Weidong Jiang , Kai Huo , Li Liu

Regularized variants of Principal Components Analysis, especially Sparse PCA and Functional PCA, are among the most useful tools for the analysis of complex high-dimensional data. Many examples of massive data, have both sparse and…

Machine Learning · Statistics 2019-08-21 Genevera I. Allen , Michael Weylandt

Spectral PCA (sPCA), in contrast to classical PCA, offers the advantage of identifying organized spatio-temporal patterns within specific frequency bands and extracting dynamical modes. However, the unavoidable tradeoff between frequency…

Systems and Control · Electrical Eng. & Systems 2021-02-03 Clément Guilloteau , Antonios Mamalakis , Lawrence Vulis , Tryphon T. Georgiou , Efi Foufoula-Georgiou

Cancer is one of the most challenging diseases because of its complexity, variability, and diversity of causes. It has been one of the major research topics over the past decades, yet it is still poorly understood. To this end, multifaceted…

Quantitative Methods · Quantitative Biology 2022-12-22 Ehtisham Fazal , Muhammad Sohail Ibrahim , Seongyong Park , Imran Naseem , Abdul Wahab

This article focuses on the robust principal component analysis (PCA) of high-dimensional data with elliptical distributions. We investigate the PCA of the sample spatial-sign covariance matrix in both nonsparse and sparse contexts,…

Methodology · Statistics 2025-07-08 Ping Zhao , Hongfei Wang , Long Feng

Principal Component Analysis (PCA) is a workhorse of modern data science. While PCA assumes the data conforms to Euclidean geometry, for specific data types, such as hierarchical and cyclic data structures, other spaces are more…

Machine Learning · Statistics 2024-07-11 Puoya Tabaghi , Michael Khanzadeh , Yusu Wang , Sivash Mirarab

Given a multivariate data set, sparse principal component analysis (SPCA) aims to extract several linear combinations of the variables that together explain the variance in the data as much as possible, while controlling the number of…

Machine Learning · Statistics 2020-05-08 Peter Richtárik , Majid Jahani , Selin Damla Ahipaşaoğlu , Martin Takáč

We present a new straightforward principal component analysis (PCA) method based on the diagonalization of the weighted variance-covariance matrix through two spectral decomposition methods: power iteration and Rayleigh quotient iteration.…

Instrumentation and Methods for Astrophysics · Physics 2014-12-16 Ludovic Delchambre

PCA is one of the most widely used dimension reduction techniques. A related easier problem is "subspace learning" or "subspace estimation". Given relatively clean data, both are easily solved via singular value decomposition (SVD). The…

Information Theory · Computer Science 2020-06-25 Namrata Vaswani , Thierry Bouwmans , Sajid Javed , Praneeth Narayanamurthy

Principal Component Analysis (PCA) is a method for estimating a subspace given noisy samples. It is useful in a variety of problems ranging from dimensionality reduction to anomaly detection and the visualization of high dimensional data.…

Statistics Theory · Mathematics 2019-06-14 David Hong , Laura Balzano , Jeffrey A. Fessler

Principal component regression (PCR) is a useful method for regularizing linear regression. Although conceptually simple, straightforward implementations of PCR have high computational costs and so are inappropriate when learning with large…

Numerical Analysis · Mathematics 2019-03-08 Liron Mor-Yosef , Haim Avron

We address the problem of defining a group sparse formulation for Principal Components Analysis (PCA) - or its equivalent formulations as Low Rank approximation or Dictionary Learning problems - which achieves a compromise between…

Machine Learning · Statistics 2021-01-15 Marie Chavent , Guy Chavent

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise. The maximum likelihood solution for the model is an eigenvalue problem on the…

Machine Learning · Computer Science 2012-06-22 Alfredo Kalaitzis , Neil Lawrence

We consider the Sparse Principal Component Analysis (SPCA) problem under the well-known spiked covariance model. Recent work has shown that the SPCA problem can be reformulated as a Mixed Integer Program (MIP) and can be solved to global…

Methodology · Statistics 2026-04-06 Kayhan Behdin , Rahul Mazumder

In many real-world applications, data come with corruptions, large errors or outliers. One popular approach is to use L1-norm function. However, the robustness of L1-norm function is not well understood so far. In this paper, we present a…

Computer Vision and Pattern Recognition · Computer Science 2017-05-30 Chris Ding , Bo Jiang

Sparse Principal Component Analysis (PCA) is a prevalent tool across a plethora of subfields of applied statistics. While several results have characterized the recovery error of the principal eigenvectors, these are typically in spectral…

Statistics Theory · Mathematics 2022-02-09 Joshua Agterberg , Jeremias Sulam

Methods for supervised principal component analysis (SPCA) aim to incorporate label information into principal component analysis (PCA), so that the extracted features are more useful for a prediction task of interest. Prior work on SPCA…

Machine Learning · Statistics 2022-08-18 Alexander Ritchie , Laura Balzano , Daniel Kessler , Chandra S. Sripada , Clayton Scott

Principal component analysis (PCA) is one of the most widely used dimensionality reduction tools in data analysis. The PCA direction is a linear combination of all features with nonzero loadings -- this impedes interpretability. Sparse PCA…

Optimization and Control · Mathematics 2021-08-18 Santanu S. Dey , Rahul Mazumder , Guanyi Wang