English

Approximate message passing from random initialization with applications to $\mathbb{Z}_{2}$ synchronization

Statistics Theory 2023-02-08 v1 Information Theory Signal Processing math.IT Machine Learning Statistics Theory

Abstract

This paper is concerned with the problem of reconstructing an unknown rank-one matrix with prior structural information from noisy observations. While computing the Bayes-optimal estimator seems intractable in general due to its nonconvex nature, Approximate Message Passing (AMP) emerges as an efficient first-order method to approximate the Bayes-optimal estimator. However, the theoretical underpinnings of AMP remain largely unavailable when it starts from random initialization, a scheme of critical practical utility. Focusing on a prototypical model called Z2\mathbb{Z}_{2} synchronization, we characterize the finite-sample dynamics of AMP from random initialization, uncovering its rapid global convergence. Our theory provides the first non-asymptotic characterization of AMP in this model without requiring either an informative initialization (e.g., spectral initialization) or sample splitting.

Keywords

Cite

@article{arxiv.2302.03682,
  title  = {Approximate message passing from random initialization with applications to $\mathbb{Z}_{2}$ synchronization},
  author = {Gen Li and Wei Fan and Yuting Wei},
  journal= {arXiv preprint arXiv:2302.03682},
  year   = {2023}
}
R2 v1 2026-06-28T08:34:29.796Z