English

Estimation in the spiked Wigner model: A short proof of the replica formula

Information Theory 2018-09-25 v2 math.IT Probability Statistics Theory Statistics Theory

Abstract

We consider the problem of estimating a rank-one perturbation of a Wigner matrix in a setting of low signal-to-noise ratio. This serves as a simple model for principal component analysis in high dimensions. The mutual information per variable between the spike and the observed matrix, or equivalently, the normalized Kullback-Leibler divergence between the planted and null models are known to converge to the so-called {\em replica-symmetric} formula, the properties of which determine the fundamental limits of estimation in this model. We provide in this note a short and transparent proof of this formula, based on simple executions of Gaussian interpolations and standard concentration-of-measure arguments. The \emph{Franz-Parisi potential}, that is, the free entropy at a fixed overlap, plays an important role in our proof. Furthermore, our proof can be generalized straightforwardly to spiked tensor models of even order.

Keywords

Cite

@article{arxiv.1801.01593,
  title  = {Estimation in the spiked Wigner model: A short proof of the replica formula},
  author = {Ahmed El Alaoui and Florent Krzakala},
  journal= {arXiv preprint arXiv:1801.01593},
  year   = {2018}
}

Comments

11 pages. Appears in proc. of the IEEE International Symposium on Information Theory (ISIT) 2018