English

Achieving the Bayes Error Rate in Synchronization and Block Models by SDP, Robustly

Statistics Theory 2019-04-23 v1 Information Theory Machine Learning math.IT Optimization and Control Machine Learning Statistics Theory

Abstract

We study the statistical performance of semidefinite programming (SDP) relaxations for clustering under random graph models. Under the Z2\mathbb{Z}_{2} Synchronization model, Censored Block Model and Stochastic Block Model, we show that SDP achieves an error rate of the form exp[(1o(1))nˉI]. \exp\Big[-\big(1-o(1)\big)\bar{n} I^* \Big]. Here nˉ\bar{n} is an appropriate multiple of the number of nodes and II^* is an information-theoretic measure of the signal-to-noise ratio. We provide matching lower bounds on the Bayes error for each model and therefore demonstrate that the SDP approach is Bayes optimal. As a corollary, our results imply that SDP achieves the optimal exact recovery threshold under each model. Furthermore, we show that SDP is robust: the above bound remains valid under semirandom versions of the models in which the observed graph is modified by a monotone adversary. Our proof is based on a novel primal-dual analysis of SDP under a unified framework for all three models, and the analysis shows that SDP tightly approximates a joint majority voting procedure.

Keywords

Cite

@article{arxiv.1904.09635,
  title  = {Achieving the Bayes Error Rate in Synchronization and Block Models by SDP, Robustly},
  author = {Yingjie Fei and Yudong Chen},
  journal= {arXiv preprint arXiv:1904.09635},
  year   = {2019}
}

Comments

Partial preliminary results to appear in the Conference on Learning Theory (COLT) 2019

R2 v1 2026-06-23T08:45:46.451Z