中文
相关论文

相关论文: Sparsistency and agnostic inference in sparse PCA

200 篇论文

This paper proposes sparse and easy-to-interpret proximate factors to approximate statistical latent factors. Latent factors in a large-dimensional factor model can be estimated by principal component analysis (PCA), but are usually hard to…

统计方法学 · 统计学 2020-08-04 Markus Pelger , Ruoxuan Xiong

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

最优化与控制 · 数学 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Sparse versions of principal component analysis (PCA) have imposed themselves as simple, yet powerful ways of selecting relevant features of high-dimensional data in an unsupervised manner. However, when several sparse principal components…

机器学习 · 统计学 2019-05-22 Charles Bouveyron , Pierre Latouche , Pierre-Alexandre Mattei

We study efficient algorithms for Sparse PCA in standard statistical models (spiked covariance in its Wishart form). Our goal is to achieve optimal recovery guarantees while being resilient to small perturbations. Despite a long history of…

机器学习 · 计算机科学 2020-11-13 Tommaso d'Orsi , Pravesh K. Kothari , Gleb Novikov , David Steurer

Sparsity is a fundamental modeling principle in statistics, signal processing, and data science. However, optimization with sparsity constraints is notoriously difficult. We introduce a new convex relaxation framework for {sparse…

最优化与控制 · 数学 2026-03-20 Diego Cifuentes , Zhuorui Li

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

统计理论 · 数学 2009-01-29 Iain M Johnstone , Arthur Yu Lu

This paper introduces a novel sparse latent factor modeling framework using sparse asymptotic Principal Component Analysis (APCA) to analyze the co-movements of high-dimensional panel data over time. Unlike existing methods based on sparse…

统计方法学 · 统计学 2025-08-08 Zhaoxing Gao

Principal Component Analysis (PCA) is a dimension reduction technique. It produces inconsistent estimators when the dimensionality is moderate to high, which is often the problem in modern large-scale applications where algorithm…

统计计算 · 统计学 2016-01-29 Qiaoya Zhang , Yiyuan She

High dimensional data has introduced challenges that are difficult to address when attempting to implement classical approaches of statistical process control. This has made it a topic of interest for research due in recent years. However,…

应用统计 · 统计学 2019-04-23 Mohammad Nabhan , Yajun Mei , Jianjun Shi

Principal component analysis (PCA) is possibly one of the most widely used statistical tools to recover a low-rank structure of the data. In the high-dimensional settings, the leading eigenvector of the sample covariance can be nearly…

统计理论 · 数学 2015-04-06 Chao Gao , Harrison H. Zhou

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approximately sparse after…

机器学习 · 统计学 2023-08-07 Fan Chen , Karl Rohe

We introduce a novel algorithm that computes the $k$-sparse principal component of a positive semidefinite matrix $A$. Our algorithm is combinatorial and operates by examining a discrete set of special vectors lying in a low-dimensional…

机器学习 · 统计学 2014-05-09 Dimitris S. Papailiopoulos , Alexandros G. Dimakis , Stavros Korokythakis

Principal components analysis (PCA) is the optimal linear auto-encoder of data, and it is often used to construct features. Enforcing sparsity on the principal components can promote better generalization, while improving the…

机器学习 · 计算机科学 2015-02-25 Malik Magdon-Ismail , Christos Boutsidis

In this paper, we study the problem of sparse Principal Component Analysis (PCA) in the high-dimensional setting with missing observations. Our goal is to estimate the first principal component when we only have access to partial…

统计理论 · 数学 2012-06-04 Karim Lounici

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

We propose methodology for statistical inference for low-dimensional parameters of sparse precision matrices in a high-dimensional setting. Our method leads to a non-sparse estimator of the precision matrix whose entries have a Gaussian…

统计理论 · 数学 2015-08-13 Jana Jankova , Sara van de Geer

We propose a "small-uniform" statistic for the inference of the functional PCA estimator in a functional linear regression model. The literature has shown two extreme behaviors: on the one hand, the FPCA estimator does not converge in…

统计理论 · 数学 2021-02-23 Raymond C. W. Leung , Yu-Man Tam

Sparse feature selection is necessary when we fit statistical models, we have access to a large group of features, don't know which are relevant, but assume that most are not. Alternatively, when the number of features is larger than the…

应用统计 · 统计学 2017-04-04 Emiliano Diaz

The problem of constructing confidence sets in the high-dimensional linear model with $n$ response variables and $p$ parameters, possibly $p\ge n$, is considered. Full honest adaptive inference is possible if the rate of sparse estimation…

统计理论 · 数学 2013-12-19 Richard Nickl , Sara van de Geer

Sparse principal component analysis (SPCA) is widely used for dimensionality reduction and feature extraction in high-dimensional data analysis. Despite many methodological and theoretical developments in the past two decades, the…

统计理论 · 数学 2023-05-01 Teng Zhang , Haoyi Yang , Lingzhou Xue