English

Complexity of quadratic penalty methods with adaptive accuracy under a PL condition for the constraints

Optimization and Control 2026-01-06 v1

Abstract

We study the quadratic penalty method (QPM) for smooth nonconvex optimization problems with equality constraints. Assuming the constraint violation satisfies the PL condition near the feasible set, we derive sharper worst-case complexity bounds for obtaining approximate first-order KKT points. When the objective and constraints are twice continuously differentiable, we show that QPM equipped with a suitable first-order inner solver requires at most O(ε01ε12)O(\varepsilon_{0}^{-1}\varepsilon_{1}^{-2}) first-order oracle calls to find an (ε0,ε1)(\varepsilon_{0},\varepsilon_{1})-approximate KKT point -- that is, a point that is ε0\varepsilon_{0}-approximately feasible and ε1\varepsilon_{1}-approximately stationary. Furthermore, when the objective and constraints are three times continuously differentiable, we show that QPM with a suitable second-order inner solver requires at most O(ε01/2ε13/2)O\left(\varepsilon_{0}^{-1/2}\varepsilon_{1}^{-3/2}\right) second-order oracle calls to find an (ε0,ε1)(\varepsilon_{0},\varepsilon_{1})-approximate KKT point. We also introduce an adaptive, feasibility-aware stopping criterion for the subproblems, which relaxes the stationarity tolerance when far from feasibility. This rule preserves all theoretical guarantees while substantially reducing computational effort in practice.

Keywords

Cite

@article{arxiv.2601.02134,
  title  = {Complexity of quadratic penalty methods with adaptive accuracy under a PL condition for the constraints},
  author = {Florentin Goyens and Geovani N. Grapiglia},
  journal= {arXiv preprint arXiv:2601.02134},
  year   = {2026}
}