English

Spectral clustering in the Gaussian mixture block model

Machine Learning 2024-04-12 v3 Data Structures and Algorithms Social and Information Networks Probability Statistics Theory Statistics Theory

Abstract

Gaussian mixture block models are distributions over graphs that strive to model modern networks: to generate a graph from such a model, we associate each vertex ii with a latent feature vector uiRdu_i \in \mathbb{R}^d sampled from a mixture of Gaussians, and we add edge (i,j)(i,j) if and only if the feature vectors are sufficiently similar, in that ui,ujτ\langle u_i,u_j \rangle \ge \tau for a pre-specified threshold τ\tau. The different components of the Gaussian mixture represent the fact that there may be different types of nodes with different distributions over features -- for example, in a social network each component represents the different attributes of a distinct community. Natural algorithmic tasks associated with these networks are embedding (recovering the latent feature vectors) and clustering (grouping nodes by their mixture component). In this paper we initiate the study of clustering and embedding graphs sampled from high-dimensional Gaussian mixture block models, where the dimension of the latent feature vectors dd\to \infty as the size of the network nn \to \infty. This high-dimensional setting is most appropriate in the context of modern networks, in which we think of the latent feature space as being high-dimensional. We analyze the performance of canonical spectral clustering and embedding algorithms for such graphs in the case of 2-component spherical Gaussian mixtures, and begin to sketch out the information-computation landscape for clustering and embedding in these models.

Keywords

Cite

@article{arxiv.2305.00979,
  title  = {Spectral clustering in the Gaussian mixture block model},
  author = {Shuangping Li and Tselil Schramm},
  journal= {arXiv preprint arXiv:2305.00979},
  year   = {2024}
}

Comments

50 pages

R2 v1 2026-06-28T10:22:43.193Z