English
Related papers

Related papers: Testing in high-dimensional spiked models

200 papers

A Wishart matrix is said to be spiked when the underlying covariance matrix has a single eigenvalue $b$ different from unity. As $b$ increases through $b=2$, a gap forms from the largest eigenvalue to the rest of the spectrum, and with…

Mathematical Physics · Physics 2014-07-01 Peter J. Forrester

In the spiked population model introduced by Johnstone (2001),the population covariance matrix has all its eigenvalues equal to unit except for a few fixed eigenvalues (spikes). The question is to quantify the effect of the perturbation…

Statistics Theory · Mathematics 2012-06-06 Zhidong Bai , Jian-Feng Yao

We study principal components analyses in multivariate random and mixed effects linear models, assuming a spherical-plus-spikes structure for the covariance matrix of each random effect. We characterize the behavior of outlier sample…

Statistics Theory · Mathematics 2018-06-26 Zhou Fan , Iain M. Johnstone , Yi Sun

This paper investigates a statistical procedure for testing the equality of two independent estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Statistics Theory · Mathematics 2020-03-09 Rémy Mariétan , Stephan Morgenthaler

In this note, we establish an asymptotic expansion for the centering parameter appearing in the central limit theorems for linear spectral statistic of large-dimensional sample covariance matrices when the population has a spiked covariance…

Probability · Mathematics 2013-07-08 Qinwen Wang , Jack W. Silverstein , Jianfeng Yao

We develop a pseudo-likelihood theory for rank one matrix estimation problems in the high dimensional limit. We prove a variational principle for the limiting pseudo-maximum likelihood which also characterizes the performance of the…

Statistics Theory · Mathematics 2025-11-10 Curtis Grant , Aukosh Jagannath , Justin Ko

We derive the asymptotic distributions of the spiked eigenvalues and eigenvectors under a generalized and unified asymptotic regime, which takes into account the spike magnitude of leading eigenvalues, sample size, and dimensionality. This…

Statistics Theory · Mathematics 2015-09-15 Jianqing Fan , Weichen Wang

In this work, nonparametric log-rank-type statistical tests are introduced in order to verify homogeneity of purely discrete variables subject to arbitrary right-censoring for infinitely many categories. In particular, the Cram\'er-von…

Statistics Theory · Mathematics 2012-01-12 Dorival Leão , Alberto Ohashi

Testing independence among a number of (ultra) high-dimensional random samples is a fundamental and challenging problem. By arranging $n$ identically distributed $p$-dimensional random vectors into a $p \times n$ data matrix, we investigate…

Statistics Theory · Mathematics 2017-03-28 Xi Chen , Weidong Liu

For a generalization of Johnstone's spiked model, a covariance matrix with eigenvalues all one but $M$ of them, the number of features $N$ comparable to the number of samples $n: N=N(n), M=M(n), \gamma^{-1} \leq \frac{N}{n} \leq \gamma$…

Statistics Theory · Mathematics 2021-12-15 Simona Diaconu

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

In this paper we study random matrix models where the matrices in question contain infinitely many spikes. Recent work has characterized the possible outliers in the spectrum of large deformed unitarily invariant models when the number of…

Probability · Mathematics 2019-04-03 Brady Thompson

Testing for white noise is a classical yet important problem in statistics, especially for diagnostic checks in time series modeling and linear regression. For high-dimensional time series in the sense that the dimension $p$ is large in…

Statistics Theory · Mathematics 2018-11-26 Zeng Li , Clifford Lam , Jianfeng Yao , Qiwei Yao

Given a large, high-dimensional sample from a spiked population, the top sample covariance eigenvalue is known to exhibit a phase transition. We show that the largest eigenvalues have asymptotic distributions near the phase transition in…

Probability · Mathematics 2013-07-24 Alex Bloemendal , Bálint Virág

Estimating the number of spikes in a spiked model is an important problem in many areas such as signal processing. Most of the classical approaches assume a large sample size $n$ whereas the dimension $p$ of the observations is kept small.…

Statistics Theory · Mathematics 2014-06-04 Damien Passemier , Jian-Feng Yao

In this paper, we study the eigenvalues and eigenvectors of the spiked invariant multiplicative models when the randomness is from Haar matrices. We establish the limits of the outlier eigenvalues $\widehat{\lambda}_i$ and the generalized…

Probability · Mathematics 2023-02-28 Xiucai Ding , Hong Chang Ji

In this paper we consider the uniformity testing problem for high-dimensional discrete distributions (multinomials) under sparse alternatives. More precisely, we derive sharp detection thresholds for testing, based on $n$ samples, whether a…

Statistics Theory · Mathematics 2022-02-17 Bhaswar B. Bhattacharya , Rajarshi Mukherjee

We study the statistical decision process of detecting the low-rank signal from various signal-plus-noise type data matrices, known as the spiked random matrix models. We first show that the principal component analysis can be improved by…

Statistics Theory · Mathematics 2023-01-18 Ji Hyung Jung , Hye Won Chung , Ji Oon Lee

This paper is to study a signal-plus-noise model in high dimensional settings when the dimension and the sample size are comparable. Specifically, we assume that the noise has a general covariance matrix that allows for heteroskedasticity,…

Statistics Theory · Mathematics 2025-05-13 Xiaoyu Liu , Yiming Liu , Guangming Pan , Lingyue Zhang , Zhixiang Zhang

We study the asymptotic distributions of the spiked eigenvalues and the largest nonspiked eigenvalue of the sample covariance matrix under a general covariance matrix model with divergent spiked eigenvalues, while the other eigenvalues are…

Statistics Theory · Mathematics 2017-11-07 Tony Cai , Xiao Han , Guangming Pan