English

Stochastic block models with many communities and the Kesten--Stigum bound

Probability 2025-06-12 v2 Social and Information Networks Statistics Theory Statistics Theory

Abstract

We study the inference of communities in stochastic block models with a growing number of communities. For block models with nn vertices and a fixed number of communities qq, it was predicted in Decelle et al. (2011) that there are computationally efficient algorithms for recovering the communities above the Kesten--Stigum (KS) bound and that efficient recovery is impossible below the KS bound. This conjecture has since stimulated a lot of interest, with the achievability side proven in a line of research that culminated in the work of Abbe and Sandon (2018). Conversely, recent work by Sohn and Wein (2025) provides evidence for the hardness part using the low-degree paradigm. In this paper we investigate community recovery in the regime q=qnq=q_n \to \infty as nn\to\infty where no such predictions exist. We show that efficient inference of communities remains possible above the KS bound. Furthermore, we show that recovery of block models is low-degree hard below the KS bound when the number of communities satisfies qnq\ll \sqrt{n}. Perhaps surprisingly, we find that when qnq \gg \sqrt{n}, there is an efficient algorithm based on non-backtracking walks for recovery even below the KS bound. We identify a new threshold and ask if it is the threshold for efficient recovery in this regime. Finally, we show that detection is easy and identify (up to a constant) the information-theoretic threshold for community recovery as the number of communities qq diverges. Our low-degree hardness results also naturally have consequences for graphon estimation, improving results of Luo and Gao (2024).

Keywords

Cite

@article{arxiv.2503.03047,
  title  = {Stochastic block models with many communities and the Kesten--Stigum bound},
  author = {Byron Chin and Elchanan Mossel and Youngtak Sohn and Alexander S. Wein},
  journal= {arXiv preprint arXiv:2503.03047},
  year   = {2025}
}

Comments

46 pages, 1 figure, added discussion and minor corrections, extended abstract in COLT 2025