English

Nonmonotone subgradient methods based on a local descent lemma

Optimization and Control 2026-04-22 v2 Machine Learning

Abstract

In this paper we present a nonmonotone line search subgradient algorithm tailored to upper-C2\mathcal{C}^2 functions. This is a family of nonsmooth and nonconvex functions that satisfies a nonsmooth and local version of the descent lemma, making them suitable for line searches. We prove subsequential convergence of the proposed algorithm to a stationary point of the optimization problem. Our approach allows us to cover the setting of various subgradient algorithms, including Newton and quasi-Newton methods. In addition, we propose a specification of the general scheme, named Self-adaptive Nonmonotone Subgradient Method (SNSM), which automatically updates the parameters of the line search. Particular attention is paid to the minimum sum-of-squares clustering problem, for which we provide a concrete implementation of SNSM. We conclude with some numerical experiments where we exhibit the advantages of SNSM in comparison with some known algorithms.

Keywords

Cite

@article{arxiv.2510.19341,
  title  = {Nonmonotone subgradient methods based on a local descent lemma},
  author = {Francisco J. Aragón-Artacho and Rubén Campoy and Pedro Pérez-Aros and David Torregrosa-Belén},
  journal= {arXiv preprint arXiv:2510.19341},
  year   = {2026}
}
R2 v1 2026-07-01T06:59:15.910Z