English
Related papers

Related papers: Statistical inference for principal components of …

200 papers

Many recent works have studied the eigenvalue spectrum of the Conjugate Kernel (CK) defined by the nonlinear feature map of a feedforward neural network. However, existing results only establish weak convergence of the empirical eigenvalue…

Machine Learning · Statistics 2024-02-16 Zhichao Wang , Denny Wu , Zhou Fan

We study the principal components of covariance estimators in multivariate mixed-effects linear models. We show that, in high dimensions, the principal eigenvalues and eigenvectors may exhibit bias and aliasing effects that are not present…

Probability · Mathematics 2020-08-06 Zhou Fan , Yi Sun , Zhichao Wang

A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, introduced by Johnstone, in which a prominent eigenvector (or "spike") is planted into a random matrix. These distributions form…

Statistics Theory · Mathematics 2018-08-29 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira , Ankur Moitra

With the development of high-throughput technologies, principal component analysis (PCA) in the high-dimensional regime is of great interest. Most of the existing theoretical and methodological results for high-dimensional PCA are based on…

Statistics Theory · Mathematics 2019-03-11 Rounak Dey , Seunggeun Lee

For a generalization of Johnstone's spiked model, a covariance matrix with eigenvalues all one but $M$ of them, the number of features $N$ comparable to the number of samples $n: N=N(n), M=M(n), \gamma^{-1} \leq \frac{N}{n} \leq \gamma$…

Statistics Theory · Mathematics 2021-12-15 Simona Diaconu

Recently, inference about high-dimensional integrated covariance matrices (ICVs) based on noisy high-frequency data has emerged as a challenging problem. In the literature, a pre-averaging estimator (PA-RCov) is proposed to deal with the…

Methodology · Statistics 2017-02-14 Keren Shen , Jianfeng Yao , Wai Keung Li

We consider two types of spiked multivariate F distributions: a scaled distribution with the scale matrix equal to a rank-one perturbation of the identity, and a distribution with trivial scale, but rank-one non-centrality. The norm of the…

Statistics Theory · Mathematics 2014-11-17 Prathapasinghe Dharmawansa , Iain M. Johnstone , Alexei Onatski

We consider two-sample tests for high-dimensional data under two disjoint models: the strongly spiked eigenvalue (SSE) model and the non-SSE (NSSE) model. We provide a general test statistic as a function of a positive-semidefinite matrix.…

Statistics Theory · Mathematics 2016-11-28 Makoto Aoshima , Kazuyoshi Yata

A number of settings arise in which it is of interest to predict Principal Component (PC) scores for new observations using data from an initial sample. In this paper, we demonstrate that naive approaches to PC score prediction can be…

Statistics Theory · Mathematics 2012-11-14 Seunggeun Lee , Fei Zou , Fred A. Wright

This paper aims to derive asymptotical distributions of the spiked eigenvalues of the large-dimensional spiked Fisher matrices without Gaussian assumption and the restrictive assumptions on covariance matrices. We first establish invariance…

Statistics Theory · Mathematics 2022-03-29 Dandan Jiang , Zhiqiang Hou , Zhidong Bai , Runze Li

We study principal components regression (PCR) in an asymptotic high-dimensional regression setting, where the number of data points is proportional to the dimension. We derive exact limiting formulas for the estimation and prediction…

Statistics Theory · Mathematics 2025-09-18 Alden Green , Elad Romanov

The classical methods of multivariate analysis are based on the eigenvalues of one or two sample covariance matrices. In many applications of these methods, for example to high dimensional data, it is natural to consider alternative…

Statistics Theory · Mathematics 2014-06-17 Prathapasinghe Dharmawansa , Iain M. Johnstone

In this paper, we establish some new central limit theorems for certain spectral statistics of a high-dimensional sample covariance matrix under a divergent spectral norm population model. This model covers the divergent spiked population…

Statistics Theory · Mathematics 2021-04-09 Yanqing Yin

Estimating a covariance matrix and its associated principal components is a fundamental problem in contemporary statistics. While optimal estimation procedures have been developed with well-understood properties, the increasing demand for…

Statistics Theory · Mathematics 2024-09-30 T. Tony Cai , Dong Xia , Mengyue Zha

In this paper, we consider a data matrix $X\in\mathbb{C}^{N\times M}$ where all the columns are i.i.d. samples being $N$ dimensional complex Gaussian of mean zero and covariance $\Sigma\in\mathbb{C}^{N\times N}$. Here the population matrix…

Probability · Mathematics 2012-07-19 Dai Shi

Consider two $p$-variate populations, not necessarily Gaussian, with covariance matrices $\Sigma_1$ and $\Sigma_2$, respectively, and let $S_1$ and $S_2$ be the sample covariances matrices from samples of the populations with degrees of…

Statistics Theory · Mathematics 2018-01-23 Qinwen Wang , Jianfeng Yao

Spectral methods have myriad applications in high-dimensional statistics and data science, and while previous works have primarily focused on $\ell_2$ or $\ell_{2,\infty}$ eigenvector and singular vector perturbation theory, in many…

Statistics Theory · Mathematics 2026-05-11 Joshua Agterberg

The spiked Fisher matrix is a significant topic for two-sample problems in multivariate statistical inference. This paper is dedicated to testing the number of spikes in a high-dimensional generalized spiked Fisher matrix that relaxes the…

Statistics Theory · Mathematics 2025-02-26 Rui Wang , Dandan Jiang

In a spiked population model, the population covariance matrix has all its eigenvalues equal to units except for a few fixed eigenvalues (spikes). This model is proposed by Johnstone to cope with empirical findings on various data sets. The…

Probability · Mathematics 2008-12-18 Zhidong Bai , Jian-feng Yao

We study two spiked models of random matrices under general frameworks corresponding respectively to additive deformation of random symmetric matrices and multiplicative perturbation of random covariance matrices. In both cases, the…

Probability · Mathematics 2020-10-14 Nathan Noiry