Matrix denoising: Bayes-optimal estimators via low-degree polynomials
Abstract
We consider the additive version of the matrix denoising problem, where a random symmetric matrix of size has to be inferred from the observation of , with an independent random matrix modeling a noise. For prior distributions of and that are invariant under conjugation by orthogonal matrices we determine, using results from first and second order free probability theory, the Bayes-optimal (in terms of the mean square error) polynomial estimators of degree at most , asymptotically in , and show that as increases they converge towards the estimator introduced by Bun, Allez, Bouchaud and Potters in [IEEE Transactions on Information Theory 62, 7475 (2016)]. We conjecture that this optimality holds beyond strictly orthogonally invariant priors, and provide partial evidences of this universality phenomenon when is an arbitrary Wishart matrix and is drawn from the Gaussian Orthogonal Ensemble, a case motivated by the related extensive rank matrix factorization problem.
Cite
@article{arxiv.2402.16719,
title = {Matrix denoising: Bayes-optimal estimators via low-degree polynomials},
author = {Guilhem Semerjian},
journal= {arXiv preprint arXiv:2402.16719},
year = {2024}
}
Comments
44 pages, v2 : updated references, minor clarifications