中文
相关论文

相关论文: NP-Hardness and Inapproximability of Sparse PCA

200 篇论文

In this paper we propose a new iterative algorithm to solve the fair PCA (FPCA) problem. We start with the max-min fair PCA formulation originally proposed in [1] and derive a simple and efficient iterative algorithm which is based on the…

机器学习 · 统计学 2023-05-11 Prabhu Babu , Petre Stoica

Sparse linear regression is the well-studied inference problem where one is given a design matrix $\mathbf{A} \in \mathbb{R}^{M\times N}$ and a response vector $\mathbf{b} \in \mathbb{R}^M$, and the goal is to find a solution $\mathbf{x}…

机器学习 · 计算机科学 2022-02-17 Aparna Gupte , Vinod Vaikuntanathan

In this paper, we study the application of sparse principal component analysis (PCA) to clustering and feature selection problems. Sparse PCA seeks sparse factors, or linear combinations of the data variables, explaining a maximum amount of…

人工智能 · 计算机科学 2008-10-08 Ronny Luss , Alexandre d'Aspremont

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

最优化与控制 · 数学 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Sparse Principal Component Analysis (PCA) methods are efficient tools to reduce the dimension (or the number of variables) of complex data. Sparse principal components (PCs) are easier to interpret than conventional PCs, because most…

统计理论 · 数学 2011-04-22 Dan Shen , Haipeng Shen , J. S. Marron

Sparse Principal Component Analysis (PCA) is a dimensionality reduction technique wherein one seeks a low-rank representation of a data matrix with additional sparsity constraints on the obtained representation. We consider two…

信息论 · 计算机科学 2014-05-06 Yash Deshpande , Andrea Montanari

In this paper, a new method is proposed for sparse PCA based on the recursive divide-and-conquer methodology. The main idea is to separate the original sparse PCA problem into a series of much simpler sub-problems, each having a closed-form…

计算机视觉与模式识别 · 计算机科学 2012-12-03 Qian Zhao , Deyu Meng , Zongben Xu

We give simple deterministic reductions demonstrating the NP-hardness of approximating the nearest codeword problem and minimum distance problem within arbitrary constant factors (and almost-polynomial factors assuming NP cannot be solved…

计算复杂性 · 计算机科学 2025-06-26 Vijay Bhattiprolu , Venkatesan Guruswami , Xuandi Ren

Sparse Principal Component Analysis (sPCA) is a popular matrix factorization approach based on Principal Component Analysis (PCA) that combines variance maximization and sparsity with the ultimate goal of improving data interpretation. When…

机器学习 · 统计学 2020-11-19 J. Camacho , A. K. Smilde , E. Saccenti , J. A. Westerhuis

Principal components analysis (PCA) is the optimal linear auto-encoder of data, and it is often used to construct features. Enforcing sparsity on the principal components can promote better generalization, while improving the…

机器学习 · 计算机科学 2015-02-25 Malik Magdon-Ismail , Christos Boutsidis

Sparse Principal Component Analysis (PCA) is a prevalent tool across a plethora of subfields of applied statistics. While several results have characterized the recovery error of the principal eigenvectors, these are typically in spectral…

统计理论 · 数学 2022-02-09 Joshua Agterberg , Jeremias Sulam

The efficient sparse coding and reconstruction of signal vectors via linear observations has received a tremendous amount of attention over the last decade. In this context, the automated learning of a suitable basis or overcomplete…

信息论 · 计算机科学 2015-06-19 Andreas M. Tillmann

The robust PCA problem, wherein, given an input data matrix that is the superposition of a low-rank matrix and a sparse matrix, we aim to separate out the low-rank and sparse components, is a well-studied problem in machine learning. One…

机器学习 · 计算机科学 2017-07-06 U. N. Niranjan , Arun Rajkumar , Theja Tulabandhula

Principal component analysis (PCA) is a widely used technique for data analysis and dimension reduction with numerous applications in science and engineering. However, the standard PCA suffers from the fact that the principal components…

最优化与控制 · 数学 2009-07-14 Zhaosong Lu , Yong Zhang

We study efficient algorithms for Sparse PCA in standard statistical models (spiked covariance in its Wishart form). Our goal is to achieve optimal recovery guarantees while being resilient to small perturbations. Despite a long history of…

机器学习 · 计算机科学 2020-11-13 Tommaso d'Orsi , Pravesh K. Kothari , Gleb Novikov , David Steurer

We analyze a practical algorithm for sparse PCA on incomplete and noisy data under a general non-random sampling scheme. The algorithm is based on a semidefinite relaxation of the $\ell_1$-regularized PCA problem. We provide theoretical…

机器学习 · 统计学 2023-02-06 Hanbyul Lee , Qifan Song , Jean Honorio

Principal component analysis (PCA) requires the computation of a low-rank approximation to a matrix containing the data being analyzed. In many applications of PCA, the best possible accuracy of any rank-deficient approximation is at most a…

统计计算 · 统计学 2010-06-04 Vladimir Rokhlin , Arthur Szlam , Mark Tygert

Sparse Principal Component Analysis (Sparse PCA) is a pivotal tool in data analysis and dimensionality reduction. However, Sparse PCA is a challenging problem in both theory and practice: it is known to be NP-hard and current exact methods…

机器学习 · 计算机科学 2025-03-06 Alberto Del Pia , Dekun Zhou , Yinglun Zhu

The aim of sparse approximation is to estimate a sparse signal according to the measurement matrix and an observation vector. It is widely used in data analytics, image processing, and communication, etc. Up to now, a lot of research has…

信号处理 · 电气工程与系统科学 2018-05-31 Hao Wang , Ruibin Feng , Chi-Sing Leung

This article contains detailed proofs and additional examples related to the UAI-2013 submission `Learning Sparse Causal Models is not NP-hard'. It describes the FCI+ algorithm: a method for sound and complete causal model discovery in the…

机器学习 · 统计学 2014-11-07 Tom Claassen , Joris M. Mooij , Tom Heskes