中文
相关论文

相关论文: A direct formulation for sparse PCA using semidefi…

200 篇论文

The positive semidefinite Procrustes (PSDP) problem is the following: given rectangular matrices $X$ and $B$, find the symmetric positive semidefinite matrix $A$ that minimizes the Frobenius norm of $AX-B$. No general procedure is known…

最优化与控制 · 数学 2017-12-05 Nicolas Gillis , Punit Sharma

The problem of estimating sparse eigenvectors of a symmetric matrix attracts a lot of attention in many applications, especially those with high dimensional data set. While classical eigenvectors can be obtained as the solution of a…

机器学习 · 统计学 2016-11-03 Konstantinos Benidis , Ying Sun , Prabhu Babu , Daniel P. Palomar

Singular value decomposition (SVD) based principal component analysis (PCA) breaks down in the high-dimensional and limited sample size regime below a certain critical eigen-SNR that depends on the dimensionality of the system and the…

统计理论 · 数学 2019-12-17 Arvind Prasadan , Raj Rao Nadakuditi , Debashis Paul

We consider the problem of minimizing a linear function over an affine section of the cone of positive semidefinite matrices, with the additional constraint that the feasible matrix has prescribed rank. When the rank constraint is active,…

系统与控制 · 计算机科学 2016-11-22 Simone Naldi

Sparsity is a fundamental modeling principle in statistics, signal processing, and data science. However, optimization with sparsity constraints is notoriously difficult. We introduce a new convex relaxation framework for {sparse…

最优化与控制 · 数学 2026-03-20 Diego Cifuentes , Zhuorui Li

The paper proposes a method for constructing a sparse estimator for the inverse covariance (concentration) matrix in high-dimensional settings. The estimator uses a penalized normal likelihood approach and forces sparsity by using a…

统计理论 · 数学 2008-06-26 Adam J. Rothman , Peter J. Bickel , Elizaveta Levina , Ji Zhu

The matching problem between two adjacency matrices can be formulated as the NP-hard quadratic assignment problem (QAP). Previous work on semidefinite programming (SDP) relaxations to the QAP have produced solutions that are often tight in…

最优化与控制 · 数学 2017-03-29 Jose F. S. Bravo Ferreira , Yuehaw Khoo , Amit Singer

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

统计方法学 · 统计学 2025-12-30 Shaoxin Wang , Ziyun Ma

We propose a novel approximation hierarchy for cardinality-constrained, convex quadratic programs that exploits the rank-dominating eigenvectors of the quadratic matrix. Each level of approximation admits a min-max characterization whose…

最优化与控制 · 数学 2021-05-26 Robbie Vreugdenhil , Viet Anh Nguyen , Armin Eftekhari , Peyman Mohajerin Esfahani

In the field of unsupervised feature selection, sparse principal component analysis (SPCA) methods have attracted more and more attention recently. Compared to spectral-based methods, SPCA methods don't rely on the construction of a…

计算机视觉与模式识别 · 计算机科学 2023-09-13 Junjing Zheng , Xinyu Zhang , Yongxiang Liu , Weidong Jiang , Kai Huo , Li Liu

Recent results in compressed sensing show that, under certain conditions, the sparsest solution to an underdetermined set of linear equations can be recovered by solving a linear program. These results either rely on computing sparse…

最优化与控制 · 数学 2010-11-02 Alexandre d'Aspremont , Laurent El Ghaoui

The linearly constrained matrix rank minimization problem is widely applicable in many fields such as control, signal processing and system identification. The tightest convex relaxation of this problem is the linearly constrained nuclear…

最优化与控制 · 数学 2009-05-12 Shiqian Ma , Donald Goldfarb , Lifeng Chen

It is well known that Sparse PCA (Sparse Principal Component Analysis) is NP-hard to solve exactly on worst-case instances. What is the complexity of solving Sparse PCA approximately? Our contributions include: 1) a simple and efficient…

机器学习 · 统计学 2015-07-22 Siu On Chan , Dimitris Papailiopoulos , Aviad Rubinstein

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approximately sparse after…

机器学习 · 统计学 2023-08-07 Fan Chen , Karl Rohe

In this paper we develop a new approach to sparse principal component analysis (sparse PCA). We propose two single-unit and two block optimization formulations of the sparse PCA problem, aimed at extracting a single sparse dominant…

最优化与控制 · 数学 2008-12-01 Michel Journée , Yurii Nesterov , Peter Richtárik , Rodolphe Sepulchre

This paper proposes a new method for estimating sparse precision matrices in the high dimensional setting. It has been popular to study fast computation and adaptive procedures for this problem. We propose a novel approach, called Sparse…

统计方法学 · 统计学 2016-12-23 Weidong Liu , Xi Luo

We propose a novel value function approximation technique for Markov decision processes. We consider the problem of compactly representing the state-action value function using a low-rank and sparse matrix model. The problem is to decompose…

机器学习 · 计算机科学 2015-09-02 Hao Yi Ong

In this paper, we study the estimation of the $k$-dimensional sparse principal subspace of covariance matrix $\Sigma$ in the high-dimensional setting. We aim to recover the oracle principal subspace solution, i.e., the principal subspace…

机器学习 · 计算机科学 2023-12-29 Quanquan Gu , Zhaoran Wang , Han Liu

We study how well one can recover sparse principal components of a data matrix using a sketch formed from a few of its elements. We show that for a wide class of optimization problems, if the sketch is close (in the spectral norm) to the…

机器学习 · 计算机科学 2015-03-16 Abhisek Kundu , Petros Drineas , Malik Magdon-Ismail

We present and analyze a simple, two-step algorithm to approximate the optimal solution of the sparse PCA problem. Our approach first solves a L1 penalized version of the NP-hard sparse PCA optimization problem and then uses a randomized…

数据结构与算法 · 计算机科学 2016-11-24 Kimon Fountoulakis , Abhisek Kundu , Eugenia-Maria Kontopoulou , Petros Drineas