English

Spectrally Robust Covariance Shrinkage for Hotelling's $T^2$ in High Dimensions

Statistics Theory 2025-06-13 v3 Probability Methodology Statistics Theory

Abstract

We investigate covariance shrinkage for Hotelling's T2T^2 in the regime where the data dimension pp and the sample size nn grow in a fixed ratio -- without assuming that the population covariance matrix is spiked or well-conditioned. When p/nϕ(0,1)p/n\to\phi \in (0,1), we propose a practical finite-sample shrinker that, for any maximum-entropy signal prior and any fixed significance level, (a) asymptotically maximizes power under Gaussian data, and (b) asymptotically saturates the Hanson--Wright lower bound on power in the more general sub-Gaussian case. Our approach is to formulate and solve a variational problem characterizing the optimal limiting shrinker, and to show that our finite-sample method consistently approximates this limit by extending recent local random matrix laws. Empirical studies on simulated and real-world data, including the Crawdad UMich/RSS data set, demonstrate up to a 50%50\% gain in power over leading linear and nonlinear competitors at a significance level of 10410^{-4}.

Keywords

Cite

@article{arxiv.2502.02006,
  title  = {Spectrally Robust Covariance Shrinkage for Hotelling's $T^2$ in High Dimensions},
  author = {Benjamin D. Robinson and Van Latimer},
  journal= {arXiv preprint arXiv:2502.02006},
  year   = {2025}
}

Comments

43 pages, 6 figures