English
Related papers

Related papers: Edgeworth correction for the largest eigenvalue in…

200 papers

Modern datasets are trending towards ever higher dimension. In response, recent theoretical studies of covariance estimation often assume the proportional-growth asymptotic framework, where the sample size $n$ and dimension $p$ are…

Statistics Theory · Mathematics 2023-08-01 David L. Donoho , Michael J. Feldman

In this article, we establish a limiting distribution for eigenvalues of a class of auto-covariance matrices. The same distribution has been found in the literature for a regularized version of these auto-covariance matrices. The original…

Probability · Mathematics 2021-03-23 Jianfeng Yao , Wangjun Yuan

The neighbourhood of the largest eigenvalue $\lambda_{\rm max}$ in the Gaussian unitary ensemble (GUE) and Laguerre unitary ensemble (LUE) is referred to as the soft edge. It is known that there exists a particular centring and scaling such…

Mathematical Physics · Physics 2018-06-13 Peter J Forrester , Allan K Trinh

Given a matrix of observed data, Principal Components Analysis (PCA) computes a small number of orthogonal directions that contain most of its variability. Provably accurate solutions for PCA have been in use for a long time. However, to…

Machine Learning · Computer Science 2016-11-01 Namrata Vaswani , Han Guo

Given a matrix of observed data, Principal Components Analysis (PCA) computes a small number of orthogonal directions that contain most of its variability. Provably accurate solutions for PCA have been in use for a long time. However, to…

Machine Learning · Computer Science 2016-11-03 Namrata Vaswani , Han Guo

In this paper we focus on the finite n probability distribution function of the largest eigenvalue in the classical Gaussian Ensemble of n by n matrices (GEn). We derive the finite n largest eigenvalue probability distribution function for…

Probability · Mathematics 2011-01-28 Leonard N. Choup

We consider a measure $\psi$ k of dispersion which extends the notion of Wilk's generalised variance, or entropy, for a d-dimensional distribution, and is based on the mean squared volume of simplices of dimension k $\le$ d formed by k + 1…

Statistics Theory · Mathematics 2015-06-29 Luc Pronzato , Henry Wynn , Anatoly Zhigljavsky

Principal Component Analysis (PCA) is a cornerstone of dimensionality reduction, yet its classical formulation relies critically on second-order moments and is therefore fragile in the presence of heavy-tailed data and impulsive noise.…

Machine Learning · Computer Science 2026-05-05 Mario Sayde , Christopher Khater , Jihad Fahs , Ibrahim Abou-Faycal

Low-rank matrix recovery problems involving high-dimensional and heterogeneous data appear in applications throughout statistics and machine learning. The contribution of this paper is to establish the fundamental limits of recovery for a…

Machine Learning · Statistics 2022-03-22 Joshua K. Behne , Galen Reeves

The top eigenvalues of rank $r$ spiked real Wishart matrices and additively perturbed Gaussian orthogonal ensembles are known to exhibit a phase transition in the large size limit. We show that they have limiting distributions for…

Probability · Mathematics 2016-09-28 Alex Bloemendal , Bálint Virág

In the context of principal components analysis (PCA), the bootstrap is commonly applied to solve a variety of inference problems, such as constructing confidence intervals for the eigenvalues of the population covariance matrix $\Sigma$.…

Statistics Theory · Mathematics 2022-02-17 Junwen Yao , Miles E. Lopes

Sample covariance matrices from multi-population typically exhibit several large spiked eigenvalues, which stem from differences between population means and are crucial for inference on the underlying data structure. This paper…

Statistics Theory · Mathematics 2024-09-16 Weiming Li , Zeng Li , Junpeng Zhu

We present a novel technique for sparse principal component analysis. This method, named Eigenvectors from Eigenvalues Sparse Principal Component Analysis (EESPCA), is based on the formula for computing squared eigenvector loadings of a…

Methodology · Statistics 2022-05-12 H. Robert Frost

In this paper, we show that the largest and smallest eigenvalues of a sample correlation matrix stemming from $n$ independent observations of a $p$-dimensional time series with iid components converge almost surely to $(1+\sqrt{\gamma})^2$…

Probability · Mathematics 2020-01-31 Johannes Heiny , Thomas Mikosch

We establish the validity of the empirical Edgeworth expansion (EE) for a studentized trimmed mean, under the sole condition that the underlying distribution function of the observations satisfies a local smoothness condition near the two…

Statistics Theory · Mathematics 2011-06-28 Nadezhda Gribkova , Roelof Helmers

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approximately sparse after…

Machine Learning · Statistics 2023-08-07 Fan Chen , Karl Rohe

How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by…

Information Theory · Computer Science 2023-06-05 Jean Barbier , Francesco Camilli , Marco Mondelli , Manuel Saenz

We develop generalized approach to obtaining Edgeworth expansions for $t$-statistics of an arbitrary order using computer algebra and combinatorial algorithms. To incorporate various versions of mean-based statistics, we introduce Adjusted…

Statistics Theory · Mathematics 2021-05-18 Inna Gerlovina , Alan E. Hubbard

Probabilistic principal component analysis (PCA) and its Bayesian variant (BPCA) are widely used for dimension reduction in machine learning and statistics. The main advantage of probabilistic PCA over the traditional formulation is…

Machine Learning · Statistics 2025-05-23 Arghya Datta , Philippe Gagnon , Florian Maire

We investigate the statistics of the largest eigenvalue, $\lambda_{\rm max}$, in an ensemble of $N\times N$ large ($N\gg 1$) sparse adjacency matrices, $A_N$. The most attention is paid to the distribution and typical fluctuations of…

Statistical Mechanics · Physics 2023-06-14 Bogdan Slavov , Kirill Polovnikov , Sergei Nechaev , Nikita Pospelov