English

Consistent model selection in the spiked Wigner model via AIC-type criteria

Statistics Theory 2025-02-10 v2 Information Theory math.IT Methodology Machine Learning Statistics Theory

Abstract

Consider the spiked Wigner model X=i=1kλiuiui+σG, X = \sum_{i = 1}^k \lambda_i u_i u_i^\top + \sigma G, where GG is an N×NN \times N GOE random matrix, and the eigenvalues λi\lambda_i are all spiked, i.e. above the Baik-Ben Arous-P\'ech\'e (BBP) threshold σ\sigma. We consider AIC-type model selection criteria of the form 2(maximised log-likelihood)+γ(number of parameters) -2 \, (\text{maximised log-likelihood}) + \gamma \, (\text{number of parameters}) for estimating the number kk of spikes. For γ>2\gamma > 2, the above criterion is strongly consistent provided λk>λγ\lambda_k > \lambda_{\gamma}, where λγ\lambda_{\gamma} is a threshold strictly above the BBP threshold, whereas for γ<2\gamma < 2, it almost surely overestimates kk. Although AIC (which corresponds to γ=2\gamma = 2) is not strongly consistent, we show that taking γ=2+δN\gamma = 2 + \delta_N, where δN0\delta_N \to 0 and δNN2/3\delta_N \gg N^{-2/3}, results in a weakly consistent estimator of kk. We further show that a soft minimiser of AIC, where one chooses the least complex model whose AIC score is close to the minimum AIC score, is strongly consistent. Based on a spiked (generalised) Wigner representation, we also develop similar model selection criteria for consistently estimating the number of communities in a balanced stochastic block model under some sparsity restrictions.

Keywords

Cite

@article{arxiv.2307.12982,
  title  = {Consistent model selection in the spiked Wigner model via AIC-type criteria},
  author = {Soumendu Sundar Mukherjee},
  journal= {arXiv preprint arXiv:2307.12982},
  year   = {2025}
}

Comments

25 pages, 2 figures, 5 tables

R2 v1 2026-06-28T11:38:54.906Z