English
Related papers

Related papers: Safe Peeling for L0-Regularized Least-Squares with…

200 papers

Quasi branch and bound is a recently introduced generalization of branch and bound, where lower bounds are replaced by a relaxed notion of quasi-lower bounds, required to be lower bounds only for sub-cubes containing a minimizer. This paper…

Optimization and Control · Mathematics 2020-05-29 Nadav Dym

We consider algorithmic problems motivated by modular robotic reconfiguration in the sliding square model, in which we are given $n$ square-shaped modules in a (labeled or unlabeled) start configuration and need to find a schedule of…

Computational Geometry · Computer Science 2025-10-09 Hugo A. Akitaya , Sándor P. Fekete , Peter Kramer , Saba Molaei , Christian Rieck , Frederick Stock , Tobias Wallner

In this paper, we propose a procedure to accelerate the resolution of the well-known "Elastic-Net" problem. Our procedure is based on the (partial) identification of the solution support and the reformulation of the original problem into a…

Optimization and Control · Mathematics 2022-02-04 Théo Guyard , Cédric Herzet , Clément Elvira

In many applications, we need algorithms which can align partially overlapping point sets and are invariant to the corresponding transformations. In this work, a method possessing such properties is realized by minimizing the objective of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Wei Lian , Wangmeng Zuo

We investigate the problem of certifying optimality for sparse generalized linear models (GLMs), where sparsity is enforced through a cardinality constraint. While Branch-and-Bound (BnB) frameworks can certify optimality using perspective…

Optimization and Control · Mathematics 2026-03-03 Jiachang Liu , Andrea Lodi , Soroosh Shafiee

Inspired by recent work on safe feature elimination for $1$-norm regularized least-squares, we develop strategies to eliminate features from convex optimization problems with non-negativity constraints. Our strategy is safe in the sense…

Optimization and Control · Mathematics 2024-07-08 James Folberth , Stephen Becker

Iteratively reweighted least square (IRLS) is a popular approach to solve sparsity-enforcing regression problems in machine learning. State of the art approaches are more efficient but typically rely on specific coordinate pruning schemes.…

Machine Learning · Statistics 2022-10-03 Clarice Poon , Gabriel Peyré

This paper presents a methodology for solving a geometrically robust least squares problem, which arises in various applications where the model is subject to geometric constraints. The problem is formulated as a minimax optimization…

Optimization and Control · Mathematics 2025-11-06 Jeremy Coulson , Alberto Padoan , Cyrus Mostajeran

This paper investigates the problem of certifying optimality for sparse generalized linear models (GLMs), where sparsity is enforced through an $\ell_0$ cardinality constraint. While branch-and-bound (BnB) frameworks can certify optimality…

Machine Learning · Computer Science 2025-06-12 Jiachang Liu , Soroosh Shafiee , Andrea Lodi

In this paper we propose a variant of the linear least squares model allowing practitioners to partition the input features into groups of variables that they require to contribute similarly to the final result. The output allows…

Machine Learning · Computer Science 2024-07-17 Roberto Esposito , Mattia Cerrato , Marco Locatelli

Logic-Based Benders Decomposition (LBBD) and its Branch-and-Cut variant, namely Branch-and-Check, enjoy an extensive applicability on a broad variety of problems, including scheduling. Although LBBD offers problem-specific cuts to impose…

Optimization and Control · Mathematics 2025-04-02 Ioannis Avgerinos , Ioannis Mourtos , Stavros Vatikiotis , Georgios Zois

The $L_0$-regularized least squares problem (a.k.a. best subsets) is central to sparse statistical learning and has attracted significant attention across the wider statistics, machine learning, and optimization communities. Recent work has…

Computation · Statistics 2020-01-28 Hussein Hazimeh , Rahul Mazumder

This paper addresses the problem of safe optimization under a single smooth constraint, a scenario that arises in diverse real-world applications such as robotics and autonomous navigation. The objective of safe optimization is to solve a…

Optimization and Control · Mathematics 2025-05-15 Ilnura Usmanova , Kfir Yehuda Levy

Tight and efficient neural network bounding is crucial to the scaling of neural network verification systems. Many efficient bounding algorithms have been presented recently, but they are often too loose to verify more challenging…

Machine Learning · Computer Science 2024-02-27 Alessandro De Palma , Harkirat Singh Behl , Rudy Bunel , Philip H. S. Torr , M. Pawan Kumar

This paper presents and evaluates two pruning techniques to reinforce the efficiency of constraint optimization solvers based on multi-valued decision-diagrams (MDD). It adopts the branch-and-bound framework proposed by Bergman et al. in…

Artificial Intelligence · Computer Science 2021-04-27 Xavier Gillard , Vianney Coppé , Pierre Schaus , André Augusto Cire

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

In this paper, we consider the multiple probabilistic covering location problem (MPCLP), which attempts to open a fixed number of facilities to maximize the total covered customer demand under a joint probabilistic coverage setting. We…

Optimization and Control · Mathematics 2025-11-24 Yan-Ru Wang , Wei-Kun Chen , Ivana Ljubić

Regularization using the L0 pseudo-norm is a common approach to promote sparsity, with widespread applications in machine learning and signal processing. However, solving such problems is known to be NP-hard. Recently, the L0 Bregman…

Optimization and Control · Mathematics 2025-03-20 Mhamed Essafri , Luca Calatroni , Emmanuel Soubies

Strong Branching (SB) is a cornerstone of all modern branching rules used in the Branch-and-Bound (BnB) algorithm, which is at the center of Mixed-Integer Programming solvers. In its full form, SB evaluates all variables to branch on and…

Optimization and Control · Mathematics 2024-04-08 Gioni Mexi , Somayeh Shamsi , Mathieu Besançon , Pierre Le Bodic

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks