中文
相关论文

相关论文: Sparse principal component analysis for high-dimen…

200 篇论文

We introduce a novel algorithm that computes the $k$-sparse principal component of a positive semidefinite matrix $A$. Our algorithm is combinatorial and operates by examining a discrete set of special vectors lying in a low-dimensional…

机器学习 · 统计学 2014-05-09 Dimitris S. Papailiopoulos , Alexandros G. Dimakis , Stavros Korokythakis

Principal component analysis (PCA) is widely used for dimension reduction and embedding of real data in social network analysis, information retrieval, and natural language processing, etc. In this work we propose a fast randomized PCA…

机器学习 · 计算机科学 2018-10-17 Xu Feng , Yuyang Xie , Mingye Song , Wenjian Yu , Jie Tang

We study high-dimensional regression in principal components space when the predictors are observed with additive measurement error and the response errors may be heavy-tailed. The starting point is the $\ell_1$-penalized…

统计方法学 · 统计学 2026-04-07 Long Feng , Xiaoyi Wang , Le Zhou

Stochastic principal component analysis (SPCA) has become a popular dimensionality reduction strategy for large, high-dimensional datasets. We derive a simplified algorithm, called Lazy SPCA, which has reduced computational complexity and…

机器学习 · 统计学 2017-09-22 Michael Wojnowicz , Dinh Nguyen , Li Li , Xuan Zhao

Sparse sequences of neural spikes are posited to underlie aspects of working memory, motor production, and learning. Discovering these sequences in an unsupervised manner is a longstanding problem in statistical neuroscience. Promising…

机器学习 · 统计学 2020-10-13 Alex H. Williams , Anthony Degleris , Yixin Wang , Scott W. Linderman

Motivation: Although principal component analysis is frequently applied to reduce the dimensionality of matrix data, the method is sensitive to noise and bias and has difficulty with comparability and interpretation. These issues are…

统计方法学 · 统计学 2012-12-27 Tomokazu Konishi

This paper proposes a novel sparse principal component analysis algorithm with self-learning ability for successive modes, where synaptic intelligence is employed to measure the importance of variables and a regularization term is added to…

机器学习 · 计算机科学 2021-08-10 Jingxin Zhang , Donghua Zhou , Maoyin Chen

Given a sample covariance matrix, we examine the problem of maximizing the variance explained by a linear combination of the input variables while constraining the number of nonzero coefficients in this combination. This is known as sparse…

最优化与控制 · 数学 2010-12-24 Youwei Zhang , Alexandre d'Aspremont , Laurent El Ghaoui

The paper proposes a formal estimation procedure for parameters of the fractional Poisson process (fPp). Such procedures are needed to make the fPp model usable in applied situations. The basic idea of fPp, motivated by experimental data…

统计方法学 · 统计学 2018-06-08 Dexter Cahoy , Vladimir V. Uchaikin , Wojbor A. Woyczynski

Many scientific and economic problems involve the analysis of high-dimensional time series datasets. However, theoretical studies in high-dimensional statistics to date rely primarily on the assumption of independent and identically…

统计理论 · 数学 2015-07-31 Sumanta Basu , George Michailidis

Given a sample covariance matrix, we examine the problem of maximizing the variance explained by a linear combination of the input variables while constraining the number of nonzero coefficients in this combination. This is known as sparse…

人工智能 · 计算机科学 2011-11-10 Alexandre d'Aspremont , Francis Bach , Laurent El Ghaoui

This paper gives a comprehensive treatment of the convergence rates of penalized spline estimators for simultaneously estimating several leading principal component functions, when the functional data is sparsely observed. The penalized…

统计理论 · 数学 2024-02-09 Shiyuan He , Jianhua Z. Huang , Kejun He

Principal Component Analysis (PCA) is a cornerstone of dimensionality reduction, yet its classical formulation relies critically on second-order moments and is therefore fragile in the presence of heavy-tailed data and impulsive noise.…

机器学习 · 计算机科学 2026-05-05 Mario Sayde , Christopher Khater , Jihad Fahs , Ibrahim Abou-Faycal

Recently popularized randomized methods for principal component analysis (PCA) efficiently and reliably produce nearly optimal accuracy --- even on parallel processors --- unlike the classical (deterministic) alternatives. We adapt one of…

统计计算 · 统计学 2011-12-23 Nathan Halko , Per-Gunnar Martinsson , Yoel Shkolnisky , Mark Tygert

The topic of this tutorial is Least Squares Sparse Principal Components Analysis (LS SPCA) which is a simple method for computing approximated Principal Components which are combinations of only a few of the observed variables. Analogously…

统计方法学 · 统计学 2021-05-31 Giovanni Maria Merola

We propose a penalized orthogonal-components regression (POCRE) for large p small n data. Orthogonal components are sequentially constructed to maximize, upon standardization, their correlation to the response residuals. A new penalization…

统计方法学 · 统计学 2013-04-18 Dabao Zhang , Yanzhu Lin , Min Zhang

Sparse Principal Components Analysis aims to find principal components with few non-zero loadings. We derive such sparse solutions by adding a genuine sparsity requirement to the original Principal Components Analysis (PCA) objective…

统计方法学 · 统计学 2014-08-19 Giovanni Maria Merola

The computation of the sparse principal component of a matrix is equivalent to the identification of its principal submatrix with the largest maximum eigenvalue. Finding this optimal submatrix is what renders the problem…

信息论 · 计算机科学 2013-12-23 Megasthenis Asteris , Dimitris S. Papailiopoulos , George N. Karystinos

Dimension reduction for high-dimensional compositional data plays an important role in many fields, where the principal component analysis of the basis covariance matrix is of scientific interest. In practice, however, the basis variables…

统计方法学 · 统计学 2021-09-13 Jingru Zhang , Wei Lin

Principal components analysis (PCA) is the optimal linear auto-encoder of data, and it is often used to construct features. Enforcing sparsity on the principal components can promote better generalization, while improving the…

机器学习 · 计算机科学 2015-02-25 Malik Magdon-Ismail , Christos Boutsidis