English
Related papers

Related papers: Efficient L1-Norm Principal-Component Analysis via…

200 papers

We give an $\tilde{O}(n^{7/5} \log (nC))$-time algorithm to compute a minimum-cost maximum cardinality matching (optimal matching) in $K_h$-minor free graphs with $h=O(1)$ and integer edge weights having magnitude at most $C$. This improves…

Data Structures and Algorithms · Computer Science 2018-07-16 Nathaniel Lahn , Sharath Raghvendra

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks

Matrices are exceptionally useful in various fields of study as they provide a convenient framework to organize and manipulate data in a structured manner. However, modern matrices can involve billions of elements, making their storage and…

Machine Learning · Computer Science 2023-10-18 Rajarshi Saha , Varun Srivastava , Mert Pilanci

Principal component analysis has been widely adopted to reduce the dimension of data while preserving the information. The quantum version of PCA (qPCA) can be used to analyze an unknown low-rank density matrix by rapidly revealing the…

Quantum Physics · Physics 2022-01-26 Zhaokai Li , Zihua Chai , Yuhang Guo , Wentao Ji , Mengqi Wang , Fazhan Shi , Ya Wang , Seth Lloyd , Jiangfeng Du

We study the Principal Component Analysis (PCA) problem in the distributed and streaming models of computation. Given a matrix $A \in R^{m \times n},$ a rank parameter $k < rank(A)$, and an accuracy parameter $0 < \epsilon < 1$, we want to…

Data Structures and Algorithms · Computer Science 2016-07-13 Christos Boutsidis , David P. Woodruff , Peilin Zhong

We consider the problem of computing sample points in each connected component of a semi-algebraic set defined by the non-vanishing or the positivity of an n-variate polynomial of degree d, with rational coefficients of bit size bounded by…

Symbolic Computation · Computer Science 2026-05-27 Jérémy Berthomieu , Edern Gillot , Mohab Safey El Din

We propose a systematic method for constructing a sparse data reconstruction algorithm in compressed sensing at a relatively low computational cost for general observation matrix. It is known that the cost of l1-norm minimization using a…

Information Theory · Computer Science 2014-04-10 Koujin Takeda , Yoshiyuki Kabashima

Principal components analysis (PCA) is a standard tool for identifying good low-dimensional approximations to data in high dimension. Many data sets of interest contain private or sensitive information about individuals. Algorithms which…

Machine Learning · Statistics 2013-08-09 Kamalika Chaudhuri , Anand D. Sarwate , Kaushik Sinha

In this paper, we propose a low complexity quantum principal component analysis (qPCA) algorithm. Similar to the state-of-the-art qPCA, it achieves dimension reduction by extracting principal components of the data matrix, rather than all…

Quantum Physics · Physics 2021-01-14 Chen He , Jiazhen Li , Weiqi Liu , Z. Jane Wang

Principal Component Analysis (PCA) is a fundamental data preprocessing tool in the world of machine learning. While PCA is often thought of as a dimensionality reduction method, the purpose of PCA is actually two-fold: dimension reduction…

Machine Learning · Computer Science 2023-01-25 Arpita Gang , Waheed U. Bajwa

The computation of the sparse principal component of a matrix is equivalent to the identification of its principal submatrix with the largest maximum eigenvalue. Finding this optimal submatrix is what renders the problem…

Information Theory · Computer Science 2013-12-23 Megasthenis Asteris , Dimitris S. Papailiopoulos , George N. Karystinos

We present a federated, asynchronous, and $(\varepsilon, \delta)$-differentially private algorithm for PCA in the memory-limited setting. Our algorithm incrementally computes local model updates using a streaming procedure and adaptively…

Machine Learning · Computer Science 2020-10-26 Andreas Grammenos , Rodrigo Mendoza-Smith , Jon Crowcroft , Cecilia Mascolo

This paper is about a curious phenomenon. Suppose we have a data matrix, which is the superposition of a low-rank component and a sparse component. Can we recover each component individually? We prove that under some suitable assumptions,…

Information Theory · Computer Science 2009-12-21 Emmanuel J. Candes , Xiaodong Li , Yi Ma , John Wright

A popular robust alternative of the classic principal component analysis (PCA) is the $\ell_1$-norm PCA (L1-PCA), which aims to find a subspace that captures the most variation in a dataset as measured by the $\ell_1$-norm. L1-PCA has shown…

Optimization and Control · Mathematics 2021-07-16 Peng Wang , Huikang Liu , Anthony Man-Cho So

Many statistical problems involve the estimation of a $\left(d\times d\right)$ orthogonal matrix $\textbf{Q}$. Such an estimation is often challenging due to the orthonormality constraints on $\textbf{Q}$. To cope with this problem, we…

Methodology · Statistics 2019-06-04 Luca Bagnato , Antonio Punzo

Principal component analysis (PCA) is not only a fundamental dimension reduction method, but is also a widely used network anomaly detection technique. Traditionally, PCA is performed in a centralized manner, which has poor scalability for…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-22 Ni An , Steven Weber

Tucker decomposition is a common method for the analysis of multi-way/tensor data. Standard Tucker has been shown to be sensitive against heavy corruptions, due to its L2-norm-based formulation which places squared emphasis to peripheral…

Numerical Analysis · Computer Science 2019-04-16 Dimitris G. Chachlakis , Ashley Prater-Bennette , Panos P. Markopoulos

We propose a new (theoretical) computational model for the study of massive data processing with limited computational resources. Our model measures the complexity of reading the very large data sets in terms of the data size N and analyzes…

Data Structures and Algorithms · Computer Science 2020-03-09 Jianer Chen , Ying Guo , Qin Huang

Principal component analysis (PCA) is a widely employed statistical tool used primarily for dimensionality reduction. However, it is known to be adversely affected by the presence of outlying observations in the sample, which is quite…

Methodology · Statistics 2023-09-26 Subhrajyoty Roy , Ayanendranath Basu , Abhik Ghosh

Principal component analysis (PCA) is a widely used dimension reduction tool in the analysis of many kind of high-dimensional data. It is used in signal processing, mechanical engineering, psychometrics, and other fields under different…

Methodology · Statistics 2014-01-15 Ngoc Mai Tran , Maria Osipenko , Wolfgang Karl Haerdle