English
Related papers

Related papers: Statistical inference for principal components of …

200 papers

Principal component analysis (PCA) aims at estimating the direction of maximal variability of a high-dimensional dataset. A natural question is: does this task become easier, and estimation more accurate, when we exploit additional…

Information Theory · Computer Science 2014-06-19 Andrea Montanari , Emile Richard

In the spiked population model introduced by Johnstone (2001),the population covariance matrix has all its eigenvalues equal to unit except for a few fixed eigenvalues (spikes). The question is to quantify the effect of the perturbation…

Statistics Theory · Mathematics 2012-06-06 Zhidong Bai , Jian-Feng Yao

We propose a principal components regression method based on maximizing a joint pseudo-likelihood for responses and predictors. Our method uses both responses and predictors to select linear combinations of the predictors relevant for the…

Methodology · Statistics 2021-08-10 Karl Oskar Ekvall

In multivariate statistics, estimating the covariance matrix is essential for understanding the interdependence among variables. In high-dimensional settings, where the number of covariates increases with the sample size, it is well known…

Statistics Theory · Mathematics 2025-10-24 Seongmin Kim , Kwangmin Lee , Sewon Park , Jaeyong Lee

This paper considers sparse spiked covariance matrix models in the high-dimensional setting and studies the minimax estimation of the covariance matrix and the principal subspace as well as the minimax rank detection. The optimal rate of…

Statistics Theory · Mathematics 2016-03-29 Tony Cai , Zongming Ma , Yihong Wu

This paper is to study a signal-plus-noise model in high dimensional settings when the dimension and the sample size are comparable. Specifically, we assume that the noise has a general covariance matrix that allows for heteroskedasticity,…

Statistics Theory · Mathematics 2025-05-13 Xiaoyu Liu , Yiming Liu , Guangming Pan , Lingyue Zhang , Zhixiang Zhang

High-dimensional autocovariance matrices play an important role in dimension reduction for high-dimensional time series. In this article, we establish the central limit theorem (CLT) for spiked eigenvalues of high-dimensional sample…

Statistics Theory · Mathematics 2024-05-14 Daning Bi , Xiao Han , Adam Nie , Yanrong Yang

We prove large deviations principles for spectral measures of perturbed (or spiked) matrix models in the direction of an eigenvector of the perturbation. In each model under study, we provide two approaches, one of which relying on large…

Probability · Mathematics 2021-09-24 Nathan Noiry , Alain Rouault

We investigate the asymptotic behavior of the eigenvalues of spiked perturbations of Wigner matrices when the dimension goes to infinity. The entries of the Hermitian Wigner matrix have a distribution which is symmetric and satisfies a…

Probability · Mathematics 2011-09-19 Mireille Capitaine , Catherine Donati-Martin , Delphine Féral , Maxime Février

A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, in which a prominent eigenvector is planted into a random matrix. These distributions form natural statistical models for principal…

Statistics Theory · Mathematics 2016-12-26 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira , Ankur Moitra

We consider the eigenvalues and eigenvectors of finite, low rank perturbations of random matrices. Specifically, we prove almost sure convergence of the extreme eigenvalues and appropriate projections of the corresponding eigenvectors of…

Probability · Mathematics 2012-03-19 Florent Benaych-Georges , Raj Rao Nadakuditi

We introduce a new random matrix model called distance covariance matrix in this paper, whose normalized trace is equivalent to the distance covariance. We first derive a deterministic limit for the eigenvalue distribution of the distance…

Statistics Theory · Mathematics 2021-05-18 Weiming Li , Qinwen Wang , Jianfeng Yao

We consider a spiked population model, proposed by Johnstone, whose population eigenvalues are all unit except for a few fixed eigenvalues. The question is to determine how the sample eigenvalues depend on the non-unit population ones when…

Statistics Theory · Mathematics 2007-06-13 Jinho Baik , Jack W. Silverstein

Motivated by dimension reduction in regression analysis and signal detection, we investigate the order determination for large dimension matrices including spiked models of which the numbers of covariates are proportional to the sample…

Methodology · Statistics 2019-11-01 Yicheng Zeng , Lixing Zhu

We consider settings where the observations are drawn from a zero-mean multivariate (real or complex) normal distribution with the population covariance matrix having eigenvalues of arbitrary multiplicity. We assume that the eigenvectors of…

Statistics Theory · Mathematics 2009-01-22 N. Raj Rao , James A. Mingo , Roland Speicher , Alan Edelman

Yang and Johnstone (2018) established an Edgeworth correction for the largest sample eigenvalue in a spiked covariance model under the assumption of Gaussian observations, leaving the extension to non-Gaussian settings as an open problem.…

Statistics Theory · Mathematics 2025-07-18 Yashi Wei , Jiang Hu , Zhidong Bai

A class of robust estimators of scatter applied to information-plus-impulsive noise samples is studied, where the sample information matrix is assumed of low rank; this generalizes the study of (Couillet et al., 2013b) to spiked random…

Probability · Mathematics 2014-05-01 Romain Couillet

We consider the five classes of multivariate statistical problems identified by James (1964), which together cover much of classical multivariate analysis, plus a simpler limiting case, symmetric matrix denoising. Each of James' problems…

Statistics Theory · Mathematics 2018-02-06 Iain M. Johnstone , Alexei Onatski

Euclidean random matrices arise in a wide range of physical systems where interactions are determined by spatial configurations, including disordered media and cooperative phenomena in atomic ensembles. Unlike classical random matrix…

Statistical Mechanics · Physics 2026-05-08 Pasquale Casaburi , Pierpaolo Vivo

Given a large, high-dimensional sample from a spiked population, the top sample covariance eigenvalue is known to exhibit a phase transition. We show that the largest eigenvalues have asymptotic distributions near the phase transition in…

Probability · Mathematics 2013-07-24 Alex Bloemendal , Bálint Virág