English
Related papers

Related papers: Edgeworth correction for the largest eigenvalue in…

200 papers

We show that in a common high-dimensional covariance model, the choice of loss function has a profound effect on optimal estimation. In an asymptotic framework based on the Spiked Covariance model and use of orthogonally invariant…

Statistics Theory · Mathematics 2017-06-06 David L. Donoho , Matan Gavish , Iain M. Johnstone

In this paper, the key objects of interest are the sequential covariance matrices $\mathbf{S}_{n,t}$ and their largest eigenvalues. Here, the matrix $\mathbf{S}_{n,t}$ is computed as the empirical covariance associated with observations…

Statistics Theory · Mathematics 2024-05-01 Nina Dörnemann , Debashis Paul

A large class of statistics can be formulated as smooth functions of sample means of random vectors. In this paper, we propose a general partial Cram\'{e}r's condition (GPCC) and apply it to establish the validity of the Edgeworth expansion…

Probability · Mathematics 2025-11-04 Yashi Wei , Jiang Hu , Zhidong Bai

We analyze the prediction error of principal component regression (PCR) and prove high probability bounds for the corresponding squared risk conditional on the design. Our first main result shows that PCR performs comparably to the oracle…

Statistics Theory · Mathematics 2024-01-03 Laura Hucker , Martin Wahl

Principal Component Analysis (PCA) is a widely used method for dimensionality reduction, but it often overlooks fairness, especially when working with data that includes demographic characteristics. This can lead to biased representations…

Machine Learning · Computer Science 2025-02-25 Vidhi Rathore , Naresh Manwani

We study principal components analyses in multivariate random and mixed effects linear models, assuming a spherical-plus-spikes structure for the covariance matrix of each random effect. We characterize the behavior of outlier sample…

Statistics Theory · Mathematics 2018-06-26 Zhou Fan , Iain M. Johnstone , Yi Sun

This work studies estimation of sparse principal components in high dimensions. Specifically, we consider a class of estimators based on kernel PCA, generalizing the covariance thresholding algorithm proposed by Krauthgamer et al. (2015).…

Statistics Theory · Mathematics 2025-04-10 Michael J. Feldman , Theodor Misiakiewicz , Elad Romanov

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

Principal component analysis (PCA) is a key tool in the field of data dimensionality reduction that is useful for various data science problems. However, many applications involve heterogeneous data that varies in quality due to noise…

Machine Learning · Statistics 2023-11-14 Javier Salazar Cavazos , Jeffrey A. Fessler , Laura Balzano

In this article we generalize the classical Edgeworth expansion for the probability density function (PDF) of sums of a finite number of symmetric independent identically distributed random variables with a finite variance to sums of…

Statistical Mechanics · Physics 2015-05-20 Netanel Hazut , Shlomi Medalion , David A. Kessler , Eli Barkai

We show how to calculate individual terms of the Edgeworth series to approximate the distribution of the Pearson correlation coefficient with the help of a simple Mathematica program. We also demonstrate how to eliminate the corresponding…

Statistics Theory · Mathematics 2022-08-11 Jan Vrbik

We consider matrices formed by a random $N\times N$ matrix drawn from the Gaussian Orthogonal Ensemble (or Gaussian Unitary Ensemble) plus a rank-one perturbation of strength $\theta$, and focus on the largest eigenvalue, $x$, and the…

Probability · Mathematics 2019-04-04 Giulio Biroli , Alice Guionnet

We present a method for performing Principal Component Analysis (PCA) on noisy datasets with missing values. Estimates of the measurement error are used to weight the input data such that compared to classic PCA, the resulting eigenvectors…

Instrumentation and Methods for Astrophysics · Physics 2015-06-11 Stephen Bailey

We generalize the maximum likelihood method to non-Gaussian distribution functions by means of the multivariate Edgeworth expansion. We stress the potential interest of this technique in all those cosmological problems in which the…

Astrophysics · Physics 2007-05-23 Luca Amendola

Principal Component Analysis (PCA) is one of the most commonly used statistical methods for data exploration, and for dimensionality reduction wherein the first few principal components account for an appreciable proportion of the…

Methodology · Statistics 2024-01-11 Caren Marzban , Ulvi Yurtsever , Michael Richman

We consider the limiting location and limiting distribution of the largest eigenvalue in real symmetric ($\beta$ = 1), Hermitian ($\beta$ = 2), and Hermitian self-dual ($\beta$ = 4) random matrix models with rank 1 external source. They are…

Mathematical Physics · Physics 2012-01-31 Dong Wang

In statistics and machine learning, people are often interested in the eigenvectors (or singular vectors) of certain matrices (e.g. covariance matrices, data matrices, etc). However, those matrices are usually perturbed by noises or…

Statistics Theory · Mathematics 2017-06-05 Jianqing Fan , Weichen Wang , Yiqiao Zhong

We consider principal component analysis (PCA) in decomposable Gaussian graphical models. We exploit the prior information in these models in order to distribute its computation. For this purpose, we reformulate the problem in the sparse…

Machine Learning · Statistics 2015-05-13 Ami Wiesel , Alfred O. Hero

In this paper, we consider a data matrix $X_N\in\mathbb{R}^{N\times p}$ where all the rows are i.i.d. samples in $\mathbb{R}^p$ of mean zero and covariance matrix $\Sigma\in\mathbb{R}^{p\times p}$. Here the population matrix $\Sigma$ is of…

Probability · Mathematics 2013-05-06 Dai Shi

Principal Component Analysis (PCA) is a dimension reduction technique. It produces inconsistent estimators when the dimensionality is moderate to high, which is often the problem in modern large-scale applications where algorithm…

Computation · Statistics 2016-01-29 Qiaoya Zhang , Yiyuan She