English
Related papers

Related papers: A New Branch-and-Bound Pruning Framework for $\ell…

200 papers

We present a novel screening methodology to safely discard irrelevant nodes within a generic branch-and-bound (BnB) algorithm solving the l0-penalized least-squares problem. Our contribution is a set of two simple tests to detect sets of…

Signal Processing · Electrical Eng. & Systems 2022-02-04 Théo Guyard , Cédric Herzet , Clément Elvira

We introduce a new methodology dubbed ``safe peeling'' to accelerate the resolution of L0-regularized least-squares problems via a Branch-and-Bound (BnB) algorithm. Our procedure enables to tighten the convex relaxation considered at each…

Machine Learning · Computer Science 2023-06-07 Théo Guyard , Gilles Monnoyer , Clément Elvira , Cédric Herzet

In this paper, we surveyed the existing literature studying different approaches and algorithms for the four critical components in the general branch and bound (B&B) algorithm, namely, branching variable selection, node selection, node…

Machine Learning · Computer Science 2021-11-12 Lingying Huang , Xiaomeng Chen , Wei Huo , Jiazheng Wang , Fan Zhang , Bo Bai , Ling Shi

We present the Branch-and-Bound Performance Estimation Programming (BnB-PEP), a unified methodology for constructing optimal first-order methods for convex and nonconvex optimization. BnB-PEP poses the problem of finding the optimal…

Optimization and Control · Mathematics 2023-06-09 Shuvomoy Das Gupta , Bart P. G. Van Parys , Ernest K. Ryu

We improve the scalability of Branch and Bound (BaB) algorithms for formally proving input-output properties of neural networks. First, we propose novel bounding algorithms based on Lagrangian Decomposition. Previous works have used…

The use of machine learning techniques to improve the performance of branch-and-bound optimization algorithms is a very active area in the context of mixed integer linear problems, but little has been done for non-linear optimization. To…

We present a generic Branch-and-Bound procedure designed to solve L0-penalized optimization problems. Existing approaches primarily focus on quadratic losses and construct relaxations using "Big-M" constraints and/or L2-norm penalties. In…

Optimization and Control · Mathematics 2025-06-05 Clément Elvira , Théo Guyard , Cédric Herzet

Branch and Bound (B&B) is the exact tree search method typically used to solve Mixed-Integer Linear Programming problems (MILPs). Learning branching policies for MILP has become an active research area, with most works proposing to imitate…

Machine Learning · Computer Science 2021-06-04 Giulia Zarpellon , Jason Jo , Andrea Lodi , Yoshua Bengio

Decision trees are one of the most useful and popular methods in the machine learning toolbox. In this paper, we consider the problem of learning optimal decision trees, a combinatorial optimization problem that is challenging to solve at…

Machine Learning · Computer Science 2022-07-01 Rahul Mazumder , Xiang Meng , Haoyue Wang

Many available formal verification methods have been shown to be instances of a unified Branch-and-Bound (BaB) formulation. We propose a novel machine learning framework that can be used for designing an effective branching strategy as well…

Machine Learning · Computer Science 2021-07-28 Florian Jaeckle , Jingyue Lu , M. Pawan Kumar

Logic-Based Benders Decomposition (LBBD) and its Branch-and-Cut variant, namely Branch-and-Check, enjoy an extensive applicability on a broad variety of problems, including scheduling. Although LBBD offers problem-specific cuts to impose…

Optimization and Control · Mathematics 2025-04-02 Ioannis Avgerinos , Ioannis Mourtos , Stavros Vatikiotis , Georgios Zois

Probabilistic verification problems of neural networks are concerned with formally analysing the output distribution of a neural network under a probability distribution of the inputs. Examples of probabilistic verification problems include…

Machine Learning · Computer Science 2025-07-11 David Boetius , Stefan Leue , Tobias Sutter

With the rise of smartphones and the internet-of-things, data is increasingly getting generated at the edge on local, personal devices. For privacy, latency and energy saving reasons, this shift is causing machine learning algorithms to…

Machine Learning · Computer Science 2021-04-29 Jiaqi Li , Ross Drummond , Stephen R. Duncan

When solving numerical constraints such as nonlinear equations and inequalities, solvers often exploit pruning techniques, which remove redundant value combinations from the domains of variables, at pruning steps. To find the complete…

Artificial Intelligence · Computer Science 2007-05-23 Xuan-Ha Vu , Marius-Calin Silaghi , Djamila Sam-Haroud , Boi Faltings

This paper presents and evaluates two pruning techniques to reinforce the efficiency of constraint optimization solvers based on multi-valued decision-diagrams (MDD). It adopts the branch-and-bound framework proposed by Bergman et al. in…

Artificial Intelligence · Computer Science 2021-04-27 Xavier Gillard , Vianney Coppé , Pierre Schaus , André Augusto Cire

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. In this context, verification involves proving or disproving that an NN…

Machine Learning · Computer Science 2025-08-27 Rudy Bunel , Jingyue Lu , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

This paper proposes Branch & Learn, a framework for Predict+Optimize to tackle optimization problems containing parameters that are unknown at the time of solving. Given an optimization problem solvable by a recursive algorithm satisfying…

Machine Learning · Computer Science 2022-05-05 Xinyi Hu , Jasper C. H. Lee , Jimmy H. M. Lee , Allen Z. Zhong

Tree search algorithms, such as branch-and-bound, are the most widely used tools for solving combinatorial and nonconvex problems. For example, they are the foremost method for solving (mixed) integer programs and constraint satisfaction…

Artificial Intelligence · Computer Science 2018-05-18 Maria-Florina Balcan , Travis Dick , Tuomas Sandholm , Ellen Vitercik

Accelerating DNN execution on various resource-limited computing platforms has been a long-standing problem. Prior works utilize l1-based group lasso or dynamic regularization such as ADMM to perform structured pruning on DNN models to…

Machine Learning · Computer Science 2020-02-25 Xiaolong Ma , Zhengang Li , Yifan Gong , Tianyun Zhang , Wei Niu , Zheng Zhan , Pu Zhao , Jian Tang , Xue Lin , Bin Ren , Yanzhi Wang

Network adaptation is essential for the efficient operation of Cloud-RANs. Unfortunately, it leads to highly intractable mixed-integer nonlinear programming problems. Existing solutions typically rely on convex relaxation, which yield…

Signal Processing · Electrical Eng. & Systems 2018-09-18 Yifei Shen , Yuanming Shi , Jun Zhang , Khaled B. Letaief
‹ Prev 1 2 3 10 Next ›