English

Universality in polytope phase transitions and message passing algorithms

Probability 2015-03-18 v2 Information Theory math.IT

Abstract

We consider a class of nonlinear mappings FA,N\mathsf{F}_{A,N} in RN\mathbb{R}^N indexed by symmetric random matrices ARN×NA\in\mathbb{R}^{N\times N} with independent entries. Within spin glass theory, special cases of these mappings correspond to iterating the TAP equations and were studied by Bolthausen [Comm. Math. Phys. 325 (2014) 333-366]. Within information theory, they are known as "approximate message passing" algorithms. We study the high-dimensional (large NN) behavior of the iterates of F\mathsf{F} for polynomial functions F\mathsf{F}, and prove that it is universal; that is, it depends only on the first two moments of the entries of AA, under a sub-Gaussian tail condition. As an application, we prove the universality of a certain phase transition arising in polytope geometry and compressed sensing. This solves, for a broad class of random projections, a conjecture by David Donoho and Jared Tanner.

Keywords

Cite

@article{arxiv.1207.7321,
  title  = {Universality in polytope phase transitions and message passing algorithms},
  author = {Mohsen Bayati and Marc Lelarge and Andrea Montanari},
  journal= {arXiv preprint arXiv:1207.7321},
  year   = {2015}
}

Comments

Published in at http://dx.doi.org/10.1214/14-AAP1010 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

R2 v1 2026-06-21T21:44:13.148Z