English

Low-Rank Univariate Sum of Squares Has No Spurious Local Minima

Optimization and Control 2023-10-03 v2 Numerical Analysis Algebraic Geometry Numerical Analysis

Abstract

We study the problem of decomposing a polynomial pp into a sum of rr squares by minimizing a quadratically penalized objective fp(u)=i=1rui2p2f_p(\mathbf{u}) = \left\lVert \sum_{i=1}^r u_i^2 - p\right\lVert^2. This objective is nonconvex and is equivalent to the rank-rr Burer-Monteiro factorization of a semidefinite program (SDP) encoding the sum of squares decomposition. We show that for all univariate polynomials pp, if r2r \ge 2 then fp(u)f_p(\mathbf{u}) has no spurious second-order critical points, showing that all local optima are also global optima. This is in contrast to previous work showing that for general SDPs, in addition to genericity conditions, rr has to be roughly the square root of the number of constraints (the degree of pp) for there to be no spurious second-order critical points. Our proof uses tools from computational algebraic geometry and can be interpreted as constructing a certificate using the first- and second-order necessary conditions. We also show that by choosing a norm based on sampling equally-spaced points on the circle, the gradient fp\nabla f_p can be computed in nearly linear time using fast Fourier transforms. Experimentally we demonstrate that this method has very fast convergence using first-order optimization algorithms such as L-BFGS, with near-linear scaling to million-degree polynomials.

Keywords

Cite

@article{arxiv.2205.11466,
  title  = {Low-Rank Univariate Sum of Squares Has No Spurious Local Minima},
  author = {Benoît Legat and Chenyang Yuan and Pablo A. Parrilo},
  journal= {arXiv preprint arXiv:2205.11466},
  year   = {2023}
}

Comments

18 pages, to appear in SIAM Journal on Optimization