English

Statistical inference of a ranked community in a directed graph

Statistics Theory 2024-12-02 v1 Computational Complexity Data Structures and Algorithms Combinatorics Probability Statistics Theory

Abstract

We study the problem of detecting or recovering a planted ranked subgraph from a directed graph, an analog for directed graphs of the well-studied planted dense subgraph model. We suppose that, among a set of nn items, there is a subset SS of kk items having a latent ranking in the form of a permutation π\pi of SS, and that we observe a fraction pp of pairwise orderings between elements of {1,,n}\{1, \dots, n\} which agree with π\pi with probability 12+q\frac{1}{2} + q between elements of SS and otherwise are uniformly random. Unlike in the planted dense subgraph and planted clique problems where the community SS is distinguished by its unusual density of edges, here the community is only distinguished by the unusual consistency of its pairwise orderings. We establish computational and statistical thresholds for both detecting and recovering such a ranked community. In the log-density setting where kk, pp, and qq all scale as powers of nn, we establish the exact thresholds in the associated exponents at which detection and recovery become statistically and computationally feasible. These regimes include a rich variety of behaviors, exhibiting both statistical-computational and detection-recovery gaps. We also give finer-grained results for two extreme cases: (1) p=1p = 1, k=nk = n, and qq small, where a full tournament is observed that is weakly correlated with a global ranking, and (2) p=1p = 1, q=12q = \frac{1}{2}, and kk small, where a small "ordered clique" (totally ordered directed subgraph) is planted in a random tournament.

Keywords

Cite

@article{arxiv.2411.19885,
  title  = {Statistical inference of a ranked community in a directed graph},
  author = {Dmitriy Kunisky and Daniel A. Spielman and Alexander S. Wein and Xifan Yu},
  journal= {arXiv preprint arXiv:2411.19885},
  year   = {2024}
}

Comments

79 pages, 1 figure. This paper subsumes most of the results of the earlier arXiv:2407.16597 by a subset of the authors