English

Information-theoretic limits of a multiview low-rank symmetric spiked matrix model

Information Theory 2020-05-19 v1 Disordered Systems and Neural Networks Machine Learning math.IT

Abstract

We consider a generalization of an important class of high-dimensional inference problems, namely spiked symmetric matrix models, often used as probabilistic models for principal component analysis. Such paradigmatic models have recently attracted a lot of attention from a number of communities due to their phenomenological richness with statistical-to-computational gaps, while remaining tractable. We rigorously establish the information-theoretic limits through the proof of single-letter formulas for the mutual information and minimum mean-square error. On a technical side we improve the recently introduced adaptive interpolation method, so that it can be used to study low-rank models (i.e., estimation problems of "tall matrices") in full generality, an important step towards the rigorous analysis of more complicated inference and learning models.

Keywords

Cite

@article{arxiv.2005.08017,
  title  = {Information-theoretic limits of a multiview low-rank symmetric spiked matrix model},
  author = {Jean Barbier and Galen Reeves},
  journal= {arXiv preprint arXiv:2005.08017},
  year   = {2020}
}

Comments

Presented at the 2020 International Symposium on Information Theory (ISIT)