English

A Generic Branch-and-Bound Algorithm for $\ell_0$-Penalized Problems with Supplementary Material

Optimization and Control 2025-06-05 v1 Machine Learning Machine Learning

Abstract

We present a generic Branch-and-Bound procedure designed to solve L0-penalized optimization problems. Existing approaches primarily focus on quadratic losses and construct relaxations using "Big-M" constraints and/or L2-norm penalties. In contrast, our method accommodates a broader class of loss functions and allows greater flexibility in relaxation design through a general penalty term, encompassing existing techniques as special cases. We establish theoretical results ensuring that all key quantities required for the Branch-and-Bound implementation admit closed-form expressions under the general blanket assumptions considered in our work. Leveraging this framework, we introduce El0ps, an open-source Python solver with a plug-and-play workflow that enables user-defined losses and penalties in L0-penalized problems. Through extensive numerical experiments, we demonstrate that El0ps achieves state-of-the-art performance on classical instances and extends computational feasibility to previously intractable ones.

Keywords

Cite

@article{arxiv.2506.03974,
  title  = {A Generic Branch-and-Bound Algorithm for $\ell_0$-Penalized Problems with Supplementary Material},
  author = {Clément Elvira and Théo Guyard and Cédric Herzet},
  journal= {arXiv preprint arXiv:2506.03974},
  year   = {2025}
}
R2 v1 2026-07-01T02:59:04.491Z