English

On the Universality of Noiseless Linear Estimation with Respect to the Measurement Matrix

Machine Learning 2020-01-22 v1 Information Theory Machine Learning Signal Processing math.IT Statistics Theory Statistics Theory

Abstract

In a noiseless linear estimation problem, one aims to reconstruct a vector x* from the knowledge of its linear projections y=Phi x*. There have been many theoretical works concentrating on the case where the matrix Phi is a random i.i.d. one, but a number of heuristic evidence suggests that many of these results are universal and extend well beyond this restricted case. Here we revisit this problematic through the prism of development of message passing methods, and consider not only the universality of the l1 transition, as previously addressed, but also the one of the optimal Bayesian reconstruction. We observed that the universality extends to the Bayes-optimal minimum mean-squared (MMSE) error, and to a range of structured matrices.

Keywords

Cite

@article{arxiv.1906.04735,
  title  = {On the Universality of Noiseless Linear Estimation with Respect to the Measurement Matrix},
  author = {Alia Abbara and Antoine Baker and Florent Krzakala and Lenka Zdeborová},
  journal= {arXiv preprint arXiv:1906.04735},
  year   = {2020}
}

Comments

13 pages, 4 figures