English

Matrix denoising: Bayes-optimal estimators via low-degree polynomials

Disordered Systems and Neural Networks 2024-10-25 v2 Statistical Mechanics Information Theory math.IT Probability Statistics Theory Statistics Theory

Abstract

We consider the additive version of the matrix denoising problem, where a random symmetric matrix SS of size nn has to be inferred from the observation of Y=S+ZY=S+Z, with ZZ an independent random matrix modeling a noise. For prior distributions of SS and ZZ that are invariant under conjugation by orthogonal matrices we determine, using results from first and second order free probability theory, the Bayes-optimal (in terms of the mean square error) polynomial estimators of degree at most DD, asymptotically in nn, and show that as DD increases they converge towards the estimator introduced by Bun, Allez, Bouchaud and Potters in [IEEE Transactions on Information Theory 62, 7475 (2016)]. We conjecture that this optimality holds beyond strictly orthogonally invariant priors, and provide partial evidences of this universality phenomenon when SS is an arbitrary Wishart matrix and ZZ is drawn from the Gaussian Orthogonal Ensemble, a case motivated by the related extensive rank matrix factorization problem.

Keywords

Cite

@article{arxiv.2402.16719,
  title  = {Matrix denoising: Bayes-optimal estimators via low-degree polynomials},
  author = {Guilhem Semerjian},
  journal= {arXiv preprint arXiv:2402.16719},
  year   = {2024}
}

Comments

44 pages, v2 : updated references, minor clarifications

R2 v1 2026-06-28T15:00:33.494Z