English
Related papers

Related papers: Safe Peeling for L0-Regularized Least-Squares with…

200 papers

We present a novel screening methodology to safely discard irrelevant nodes within a generic branch-and-bound (BnB) algorithm solving the l0-penalized least-squares problem. Our contribution is a set of two simple tests to detect sets of…

Signal Processing · Electrical Eng. & Systems 2022-02-04 Théo Guyard , Cédric Herzet , Clément Elvira

We consider the resolution of learning problems involving $\ell_0$-regularization via Branch-and-Bound (BnB) algorithms. These methods explore regions of the feasible space of the problem and check whether they do not contain solutions…

Optimization and Control · Mathematics 2024-06-07 Theo Guyard , Cédric Herzet , Clément Elvira , Ayşe-Nur Arslan

We present the Branch-and-Bound Performance Estimation Programming (BnB-PEP), a unified methodology for constructing optimal first-order methods for convex and nonconvex optimization. BnB-PEP poses the problem of finding the optimal…

Optimization and Control · Mathematics 2023-06-09 Shuvomoy Das Gupta , Bart P. G. Van Parys , Ernest K. Ryu

This paper deals with the problem of finding the globally optimal subset of h elements from a larger set of n elements in d space dimensions so as to minimize a quadratic criterion, with an special emphasis on applications to computing the…

Optimization and Control · Mathematics 2015-06-01 Salvador Flores

Decision trees are one of the most useful and popular methods in the machine learning toolbox. In this paper, we consider the problem of learning optimal decision trees, a combinatorial optimization problem that is challenging to solve at…

Machine Learning · Computer Science 2022-07-01 Rahul Mazumder , Xiang Meng , Haoyue Wang

Decision diagrams are an increasingly important tool in cutting-edge solvers for discrete optimization. However, the field of decision diagrams is relatively new, and is still incorporating the library of techniques that conventional…

Optimization and Control · Mathematics 2023-08-17 Isaac Rudich , Quentin Cappart , Louis-Martin Rousseau

In recent years, several branch-and-bound (BnB) algorithms have been proposed to globally optimize rigid registration problems. In this paper, we suggest a general framework to improve upon the BnB approach, which we name Quasi BnB. Quasi…

Computational Geometry · Computer Science 2019-04-16 Nadav Dym , Shahar Ziv Kovalsky

The sparse portfolio selection problem is one of the most famous and frequently-studied problems in the optimization and financial economics literatures. In a universe of risky assets, the goal is to construct a portfolio with maximal…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright

The NP-hard scheduling problem P||C_max encompasses a set of tasks with known execution time which must be mapped to a set of identical machines such that the overall completion time is minimized. In this work, we improve existing…

Data Structures and Algorithms · Computer Science 2024-10-22 Matthew Akram , Nikolai Maas , Peter Sanders , Dominik Schreiber

In this paper we propose a methodology to accelerate the resolution of the so-called "Sorted L-One Penalized Estimation" (SLOPE) problem. Our method leverages the concept of "safe screening", well-studied in the literature for…

Machine Learning · Computer Science 2022-10-05 Clément Elvira , Cédric Herzet

This article presents a new method for computing guaranteed convex and concave relaxations of nonlinear stochastic optimal control problems with final-time expected-value cost functions. This method is motivated by similar methods for…

Optimization and Control · Mathematics 2017-11-27 Yuanxun Shao , Dillard Robertson , Joseph Kirk Scott

Decision diagrams are an increasingly important tool in cutting-edge solvers for discrete optimization. However, the field of decision diagrams is relatively new, and is still incorporating the library of techniques that conventional…

Optimization and Control · Mathematics 2023-08-21 Isaac Rudich , Quentin Cappart , Louis-Martin Rousseau

We consider the least squares regression problem, penalized with a combination of the $\ell_{0}$ and squared $\ell_{2}$ penalty functions (a.k.a. $\ell_0 \ell_2$ regularization). Recent work shows that the resulting estimators are of key…

Computation · Statistics 2021-04-16 Hussein Hazimeh , Rahul Mazumder , Ali Saab

This article considers nonconvex global optimization problems subject to uncertainties described by continuous random variables. Such problems arise in chemical process design, renewable energy systems, stochastic model predictive control,…

Optimization and Control · Mathematics 2017-09-27 Yuanxun Shao , Joseph Kirk Scott

Sparsifying neural networks often suffers from seemingly inevitable performance degradation, and it remains challenging to restore the original performance despite much recent progress. Motivated by recent studies in robust optimization, we…

Machine Learning · Computer Science 2025-06-17 Dongyeop Lee , Kwanhee Lee , Jinseok Chung , Namhoon Lee

Bayesian $l_0$-regularized least squares is a variable selection technique for high dimensional predictors. The challenge is optimizing a non-convex objective function via search over model space consisting of all possible predictor…

Machine Learning · Statistics 2018-12-19 Nicholas G. Polson , Lei Sun

The Maximum s-Bundle Problem (MBP) addresses the task of identifying a maximum s-bundle in a given graph. A graph G=(V, E) is called an s-bundle if its vertex connectivity is at least |V|-s, where the vertex connectivity equals the minimum…

Data Structures and Algorithms · Computer Science 2024-02-07 Jinghui Xue , Jiongzhi Zheng , Mingming Jin , Kun He

Computing the exact optimal experimental design has been a longstanding challenge in various scientific fields. This problem, when formulated using a specific information function, becomes a mixed-integer nonlinear programming (MINLP)…

Methodology · Statistics 2024-09-30 Ling Liang , Haizhao Yang

The problem of planar registration consists in finding the transformation that better aligns two point sets. In our setting, the search domain is the set of planar rigid transformations and the objective function is the sum of the distances…

Robotics · Computer Science 2020-05-22 Luca Consolini , Mattia Laurini , Marco Locatelli , Dario Lodi Rizzini

A recently introduced technique for a sparse optimization problem called "safe screening" allows us to identify irrelevant variables in the early stage of optimization. In this paper, we first propose a flexible framework for safe screening…

Machine Learning · Statistics 2022-04-29 Hiroaki Yamada , Makoto Yamada
‹ Prev 1 2 3 10 Next ›