English

Mutual information for the sparse stochastic block model

Probability 2023-08-30 v3 Disordered Systems and Neural Networks

Abstract

We consider the problem of recovering the community structure in the stochastic block model with two communities. We aim to describe the mutual information between the observed network and the actual community structure in the sparse regime, where the total number of nodes diverges while the average degree of a given node remains bounded. Our main contributions are a conjecture for the limit of this quantity, which we express in terms of a Hamilton-Jacobi equation posed over a space of probability measures, and a proof that this conjectured limit provides a lower bound for the asymptotic mutual information. The well-posedness of the Hamilton-Jacobi equation is obtained in our companion paper. In the case when links across communities are more likely than links within communities, the asymptotic mutual information is known to be given by a variational formula. We also show that our conjectured limit coincides with this formula in this case.

Keywords

Cite

@article{arxiv.2209.04513,
  title  = {Mutual information for the sparse stochastic block model},
  author = {Tomas Dominguez and Jean-Christophe Mourrat},
  journal= {arXiv preprint arXiv:2209.04513},
  year   = {2023}
}

Comments

Added in-depth discussion on related work and alternative conjectures

R2 v1 2026-06-28T01:02:30.726Z