Stochastic block models with many communities and the Kesten--Stigum bound
Abstract
We study the inference of communities in stochastic block models with a growing number of communities. For block models with vertices and a fixed number of communities , it was predicted in Decelle et al. (2011) that there are computationally efficient algorithms for recovering the communities above the Kesten--Stigum (KS) bound and that efficient recovery is impossible below the KS bound. This conjecture has since stimulated a lot of interest, with the achievability side proven in a line of research that culminated in the work of Abbe and Sandon (2018). Conversely, recent work by Sohn and Wein (2025) provides evidence for the hardness part using the low-degree paradigm. In this paper we investigate community recovery in the regime as where no such predictions exist. We show that efficient inference of communities remains possible above the KS bound. Furthermore, we show that recovery of block models is low-degree hard below the KS bound when the number of communities satisfies . Perhaps surprisingly, we find that when , there is an efficient algorithm based on non-backtracking walks for recovery even below the KS bound. We identify a new threshold and ask if it is the threshold for efficient recovery in this regime. Finally, we show that detection is easy and identify (up to a constant) the information-theoretic threshold for community recovery as the number of communities diverges. Our low-degree hardness results also naturally have consequences for graphon estimation, improving results of Luo and Gao (2024).
Keywords
Cite
@article{arxiv.2503.03047,
title = {Stochastic block models with many communities and the Kesten--Stigum bound},
author = {Byron Chin and Elchanan Mossel and Youngtak Sohn and Alexander S. Wein},
journal= {arXiv preprint arXiv:2503.03047},
year = {2025}
}
Comments
46 pages, 1 figure, added discussion and minor corrections, extended abstract in COLT 2025