English

Fitting an ellipsoid to a quadratic number of random points

Probability 2024-10-03 v2 Data Structures and Algorithms Machine Learning Statistics Theory Machine Learning Statistics Theory

Abstract

We consider the problem (P)(\mathrm{P}) of fitting nn standard Gaussian random vectors in Rd\mathbb{R}^d to the boundary of a centered ellipsoid, as n,dn, d \to \infty. This problem is conjectured to have a sharp feasibility transition: for any ε>0\varepsilon > 0, if n(1ε)d2/4n \leq (1 - \varepsilon) d^2 / 4 then (P)(\mathrm{P}) has a solution with high probability, while (P)(\mathrm{P}) has no solutions with high probability if n(1+ε)d2/4n \geq (1 + \varepsilon) d^2 /4. So far, only a trivial bound nd2/2n \geq d^2 / 2 is known on the negative side, while the best results on the positive side assume nd2/polylog(d)n \leq d^2 / \mathrm{polylog}(d). In this work, we improve over previous approaches using a key result of Bartl & Mendelson (2022) on the concentration of Gram matrices of random vectors under mild assumptions on their tail behavior. This allows us to give a simple proof that (P)(\mathrm{P}) is feasible with high probability when nd2/Cn \leq d^2 / C, for a (possibly large) constant C>0C > 0.

Keywords

Cite

@article{arxiv.2307.01181,
  title  = {Fitting an ellipsoid to a quadratic number of random points},
  author = {Afonso S. Bandeira and Antoine Maillard and Shahar Mendelson and Elliot Paquette},
  journal= {arXiv preprint arXiv:2307.01181},
  year   = {2024}
}

Comments

17 pages; Update (v2) to match the published version