English
Related papers

Related papers: Edgeworth correction for the largest eigenvalue in…

200 papers

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

A general framework for principal component analysis (PCA) in the presence of heteroskedastic noise is introduced. We propose an algorithm called HeteroPCA, which involves iteratively imputing the diagonal entries of the sample covariance…

Statistics Theory · Mathematics 2021-04-02 Anru R. Zhang , T. Tony Cai , Yihong Wu

Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the…

Methodology · Statistics 2025-08-22 Zhongyuan Lyu , Ming Yuan

The growing size of modern data sets brings many challenges to the existing statistical estimation approaches, which calls for new distributed methodologies. This paper studies distributed estimation for a fundamental statistical machine…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-04 Xi Chen , Jason D. Lee , He Li , Yun Yang

Sparse Principal Component Analysis (PCA) is a prevalent tool across a plethora of subfields of applied statistics. While several results have characterized the recovery error of the principal eigenvectors, these are typically in spectral…

Statistics Theory · Mathematics 2022-02-09 Joshua Agterberg , Jeremias Sulam

Classical Edgeworth expansions provide asymptotic correction terms to the Central Limit Theorem (CLT) up to an order that depends on the number of moments available. In this paper, we provide subsequent correction terms beyond those given…

Probability · Mathematics 2011-03-23 Henry Lam , Jose Blanchet , Damian Burch , Martin Z. Bazant

We calculate analytically the probability of large deviations from its mean of the largest (smallest) eigenvalue of random matrices belonging to the Gaussian orthogonal, unitary and symplectic ensembles. In particular, we show that the…

Statistical Mechanics · Physics 2009-11-11 David S. Dean , Satya N. Majumdar

This paper provides a finite sample bound for the error term in the Edgeworth expansion for a sum of independent, potentially discrete, nonlattice random vectors, using a uniform-in-$P$ version of the weaker Cram\'{e}r condition in Angst…

Statistics Theory · Mathematics 2019-08-14 Kyungchul Song

In sparse principal component analysis we are given noisy observations of a low-rank matrix of dimension $n\times p$ and seek to reconstruct it under additional sparsity assumptions. In particular, we assume here each of the principal…

Statistics Theory · Mathematics 2016-04-27 Yash Deshpande , Andrea Montanari

We study attention mechanisms through the lens of a canonical unsupervised problem: principal component analysis (PCA). We show that, when trained on Gaussian data, both softmax and linear attention layers learn parameters that align with…

Optimization and Control · Mathematics 2026-05-19 Rodrigo Maulen-Soto , Claire Boyer

Consider the matrix products $G_n: = g_n \ldots g_1$, where $(g_{n})_{n\geq 1}$ is a sequence of independent and identically distributed positive random $d\times d$ matrices. Under the optimal third moment condition, we first establish a…

Probability · Mathematics 2025-02-20 Hui Xiao , Ion Grama , Quansheng Liu

We present a new straightforward principal component analysis (PCA) method based on the diagonalization of the weighted variance-covariance matrix through two spectral decomposition methods: power iteration and Rayleigh quotient iteration.…

Instrumentation and Methods for Astrophysics · Physics 2014-12-16 Ludovic Delchambre

A number of settings arise in which it is of interest to predict Principal Component (PC) scores for new observations using data from an initial sample. In this paper, we demonstrate that naive approaches to PC score prediction can be…

Statistics Theory · Mathematics 2012-11-14 Seunggeun Lee , Fei Zou , Fred A. Wright

I present here a generalization of the maximum likelihood method and the $\chi^2$ method to the cases in which the data are {\it not} assumed to be Gaussian distributed. The method, based on the multivariate Edgeworth expansion, can find…

Astrophysics · Physics 2007-05-23 Luca Amendola

Given a symmetric matrix $A$, we show from the simple sketch $GAG^T$, where $G$ is a Gaussian matrix with $k = O(1/\epsilon^2)$ rows, that there is a procedure for approximating all eigenvalues of $A$ simultaneously to within $\epsilon…

Data Structures and Algorithms · Computer Science 2023-04-20 William Swartworth , David P. Woodruff

This paper is to study a signal-plus-noise model in high dimensional settings when the dimension and the sample size are comparable. Specifically, we assume that the noise has a general covariance matrix that allows for heteroskedasticity,…

Statistics Theory · Mathematics 2025-05-13 Xiaoyu Liu , Yiming Liu , Guangming Pan , Lingyue Zhang , Zhixiang Zhang

In this paper we study the joint distributional convergence of the largest eigenvalues of the sample covariance matrix of a $p$-dimensional time series with iid entries when $p$ converges to infinity together with the sample size $n$. We…

Probability · Mathematics 2016-08-26 Johannes Heiny , Thomas Mikosch

Principal Component Analysis (PCA) is a well known procedure to reduce intrinsic complexity of a dataset, essentially through simplifying the covariance structure or the correlation structure. We introduce a novel algebraic, model-based…

Methodology · Statistics 2021-12-09 Martin Schlather , Felix Reinbott

Principal Component Analysis (PCA) is an important tool of dimension reduction especially when the dimension (or the number of variables) is very high. Asymptotic studies where the sample size is fixed, and the dimension grows [i.e., High…

Statistics Theory · Mathematics 2009-11-20 Sungkyu Jung , J. S. Marron

Finite-width fully connected neural networks with Gaussian-initialized weights deviate from their infinite-width Gaussian limit, exhibiting non-vanishing higher-order cumulants. We approximate these deviations, for a neural network…

Machine Learning · Statistics 2026-05-26 Lucia Celli