English

Gradient flow on extensive-rank positive semi-definite matrix denoising

Machine Learning 2023-03-17 v1 Machine Learning

Abstract

In this work, we present a new approach to analyze the gradient flow for a positive semi-definite matrix denoising problem in an extensive-rank and high-dimensional regime. We use recent linear pencil techniques of random matrix theory to derive fixed point equations which track the complete time evolution of the matrix-mean-square-error of the problem. The predictions of the resulting fixed point equations are validated by numerical experiments. In this short note we briefly illustrate a few predictions of our formalism by way of examples, and in particular we uncover continuous phase transitions in the extensive-rank and high-dimensional regime, which connect to the classical phase transitions of the low-rank problem in the appropriate limit. The formalism has much wider applicability than shown in this communication.

Keywords

Cite

@article{arxiv.2303.09474,
  title  = {Gradient flow on extensive-rank positive semi-definite matrix denoising},
  author = {Antoine Bodin and Nicolas Macris},
  journal= {arXiv preprint arXiv:2303.09474},
  year   = {2023}
}
R2 v1 2026-06-28T09:20:25.727Z