中文
相关论文

相关论文: Optimality and Sub-optimality of PCA I: Spiked Ran…

200 篇论文

Using a low-dimensional parametrization of signals is a generic and powerful way to enhance performance in signal processing and statistical inference. A very popular and widely explored type of dimensionality reduction is sparsity; another…

The problem of estimating a spiked covariance matrix in high dimensions under Frobenius loss, and the parallel problem of estimating the noise in spiked PCA is investigated. We propose an estimator of the noise parameter by minimizing an…

统计理论 · 数学 2014-08-28 Didier Chételat , Martin T. Wells

We study the Order-$k$ ($k \geq 4$) spiked tensor model for the tensor principal component analysis (PCA) problem: given $N$ i.i.d. observations of a $k$-th order tensor generated from the model $\mathbf{T} = \lambda \cdot v_*^{\otimes k} +…

最优化与控制 · 数学 2025-10-17 Shihong Ding , Yihong Gu , Yuanshi Liu , Cong Fang

We consider the Sparse Principal Component Analysis (SPCA) problem under the well-known spiked covariance model. Recent work has shown that the SPCA problem can be reformulated as a Mixed Integer Program (MIP) and can be solved to global…

统计方法学 · 统计学 2026-04-06 Kayhan Behdin , Rahul Mazumder

Sparse PCA is one of the most well-studied problems in high-dimensional statistics. In this problem, we are given samples from a distribution with covariance $\Sigma$, whose top eigenvector $v \in R^d$ is $s$-sparse. Existing sparse PCA…

机器学习 · 统计学 2026-03-04 Syamantak Kumar , Purnamrita Sarkar , Kevin Tian , Peiyuan Zhang

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

数据结构与算法 · 计算机科学 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

This paper delivers improved theoretical guarantees for the convex programming approach in low-rank matrix estimation, in the presence of (1) random noise, (2) gross sparse outliers, and (3) missing data. This problem, often dubbed as…

机器学习 · 统计学 2022-09-13 Yuxin Chen , Jianqing Fan , Cong Ma , Yuling Yan

We study sparse principal components analysis in the high-dimensional setting, where $p$ (the number of variables) can be much larger than $n$ (the number of observations). We prove optimal, non-asymptotic lower and upper bounds on the…

机器学习 · 统计学 2012-02-07 Vincent Q. Vu , Jing Lei

PCA is a classical statistical technique whose simplicity and maturity has seen it find widespread use as an anomaly detection technique. However, it is limited in this regard by being sensitive to gross perturbations of the input, and by…

机器学习 · 计算机科学 2017-08-01 Raghavendra Chalapathy , Aditya Krishna Menon , Sanjay Chawla

Sparse Principal Component Analysis (PCA) methods are efficient tools to reduce the dimension (or the number of variables) of complex data. Sparse principal components (PCs) are easier to interpret than conventional PCs, because most…

统计理论 · 数学 2011-04-22 Dan Shen , Haipeng Shen , J. S. Marron

We study the statistical decision process of detecting the signal from a `signal+noise' type matrix model with an additive Wigner noise. We propose a hypothesis test based on the linear spectral statistics of the data matrix, which does not…

统计理论 · 数学 2021-03-05 Ji Hyung Jung , Hye Won Chung , Ji Oon Lee

Principal component analysis (PCA) is a well-established method commonly used to explore and visualise data. A classical PCA model is the fixed effect model where data are generated as a fixed structure of low rank corrupted by noise. Under…

统计方法学 · 统计学 2013-05-13 Marie Verbanck , Julie Josse , François Husson

A number of settings arise in which it is of interest to predict Principal Component (PC) scores for new observations using data from an initial sample. In this paper, we demonstrate that naive approaches to PC score prediction can be…

统计理论 · 数学 2012-11-14 Seunggeun Lee , Fei Zou , Fred A. Wright

We consider pairs of GOE (Gaussian Orthogonal Ensemble) matrices which are correlated with each others, and subject to additive and multiplicative rank-one perturbations. We focus on the regime of parameters in which the finite-rank…

无序系统与神经网络 · 物理学 2023-09-15 Alessandro Pacco , Valentina Ros

In datasets where the number of parameters is fixed and the number of samples is large, principal component analysis (PCA) is a powerful dimension reduction tool. However, in many contemporary datasets, when the number of parameters is…

概率论 · 数学 2019-02-14 Enrico Au-Yeung , Greg Zanotti

In this article, the joint fluctuations of the extreme eigenvalues and eigenvectors of a large dimensional sample covariance matrix are analyzed when the associated population covariance matrix is a finite-rank perturbation of the identity…

信息论 · 计算机科学 2012-06-20 Romain Couillet , Walid Hachem

For multivariate regularly random vectors of dimension $d$, the dependence structure of the extremes is modeled by the so-called angular measure. When the dimension $d$ is high, estimating the angular measure is challenging because of its…

统计方法学 · 统计学 2025-05-29 Lucas Butsch , Vicky Fasen-Hartmann

Principal component analysis (PCA) is possibly one of the most widely used statistical tools to recover a low-rank structure of the data. In the high-dimensional settings, the leading eigenvector of the sample covariance can be nearly…

统计理论 · 数学 2015-04-06 Chao Gao , Harrison H. Zhou

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

统计理论 · 数学 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu

Principal component analysis (PCA) is a widespread technique for data analysis that relies on the covariance-correlation matrix of the analyzed data. However to properly work with high-dimensional data, PCA poses severe mathematical…

定量方法 · 定量生物学 2018-10-18 Luigi Leonardo Palese