English
Related papers

Related papers: Shaping and Trimming Branch-and-bound Trees

200 papers

We introduce a method for creating a special type of tree, called a tree position, from a weighted graph. Leaves of the tree correspond to vertices of the original graph, and the tree edges contain information which can be used to partition…

Combinatorics · Mathematics 2014-08-19 R. Sean Bowman , Douglas R. Heisterkamp , Jesse Johnson

We propose a tree-based algorithm for classification and regression problems in the context of functional data analysis, which allows to leverage representation learning and multiple splitting rules at the node level, reducing…

Machine Learning · Statistics 2020-11-03 Edoardo Belli , Simone Vantini

This paper presents and evaluates two pruning techniques to reinforce the efficiency of constraint optimization solvers based on multi-valued decision-diagrams (MDD). It adopts the branch-and-bound framework proposed by Bergman et al. in…

Artificial Intelligence · Computer Science 2021-04-27 Xavier Gillard , Vianney Coppé , Pierre Schaus , André Augusto Cire

The goal of this tutorial is to introduce key models, algorithms, and open questions related to the use of optimization methods for solving problems arising in machine learning. It is written with an INFORMS audience in mind, specifically…

Machine Learning · Statistics 2017-07-03 Frank E. Curtis , Katya Scheinberg

Given a graph, the sparsest cut problem asks for a subset of vertices whose edge expansion (the normalized cut given by the subset) is minimized. In this paper, we study a generalization of this problem seeking for $ k $ disjoint subsets of…

Data Structures and Algorithms · Computer Science 2017-02-21 Ramin Javadi , Saleh Ashkboos

There is a growing cross-disciplinary effort in the broad domain of optimization and learning with streams of data, applied to settings where traditional batch optimization techniques cannot produce solutions at time scales that match the…

Optimization and Control · Mathematics 2021-11-29 Emiliano Dall'Anese , Andrea Simonetto , Stephen Becker , Liam Madden

We present a new mixed integer formulation for the discrete informative path planning problem in random fields. The objective is to compute a budget constrained path while collecting measurements whose linear estimate results in minimum…

Systems and Control · Electrical Eng. & Systems 2022-04-21 Shamak Dutta , Nils Wilde , Stephen L. Smith

Mixed-integer programming (MIP) has emerged as a powerful framework for learning optimal decision trees. Yet, existing MIP approaches for regression tasks are either limited to purely binary features or become computationally intractable…

Machine Learning · Computer Science 2025-10-29 Cristobal Heredia , Pedro Chumpitaz-Flores , Kaixun Hua

Standard approaches for global optimization of non-convex functions, such as branch-and-bound, maintain partition trees to systematically prune the domain. The tree size grows exponentially in the number of dimensions. We propose new…

Artificial Intelligence · Computer Science 2024-02-21 Yaoguang Zhai , Zhizhen Qin , Sicun Gao

Solution techniques for Constraint Satisfaction and Optimisation Problems often make use of backtrack search methods, exploiting variable and value ordering heuristics. In this paper, we propose and analyse a very simple method to apply in…

Artificial Intelligence · Computer Science 2007-05-23 Willem Jan van Hoeve , Michela Milano

Tree-structured LSTM is promising way to consider long-distance interaction over hierarchies. However, there have been few research efforts on the hyperparameter tuning of the construction and traversal of tree-structured LSTM. To name a…

Machine Learning · Computer Science 2020-08-24 Ruo Ando , Yoshiyasu Takefuji

We survey recent work on machine learning (ML) techniques for selecting cutting planes (or cuts) in mixed-integer linear programming (MILP). Despite the availability of various classes of cuts, the task of choosing a set of cuts to add to…

Optimization and Control · Mathematics 2023-11-01 Arnaud Deza , Elias B. Khalil

Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumption: The order in which a plan is constructed is the same in…

This paper proposes a new mixed-integer programming (MIP) formulation to optimize split rule selection in the decision tree induction process, and develops an efficient search algorithm that is able to solve practical instances of the MIP…

Machine Learning · Computer Science 2022-05-31 Yanchao Liu

We present a first exact study on higher-dimensional packing problems with order constraints. Problems of this type occur naturally in applications such as logistics or computer architecture and can be interpreted as higher-dimensional…

Data Structures and Algorithms · Computer Science 2007-05-23 Sandor P. Fekete , Ekkehard Koehler , Juergen Teich

Robust optimization is one of the fundamental approaches to deal with uncertainty in combinatorial optimization. This paper considers the robust spanning tree problem with interval data, which arises in a variety of telecommunication…

Artificial Intelligence · Computer Science 2013-01-07 Ionut Aron , Pascal Van Hentenryck

As the development of distributed systems progresses, more and more challenges arise and the need for developing optimized systems and for optimizing existing systems from multiple perspectives becomes more stringent. In this paper I…

Data Structures and Algorithms · Computer Science 2009-03-21 Mugurel Ionut Andreica

In this paper we consider large-scale smooth optimization problems with multiple linear coupled constraints. Due to the non-separability of the constraints, arbitrary random sketching would not be guaranteed to work. Thus, we first…

Optimization and Control · Mathematics 2018-08-09 Ion Necoara , Martin Takac

We introduce the dual-path fixing strategy to exploit dual algorithms for solving relaxations of mixed-integer nonlinear-optimization problems. Such dual algorithms are naturally applied in the context of branch-and-bound, and eventual…

Optimization and Control · Mathematics 2026-02-03 Paulo Michel F. Yamagishi , Marcia Fampa , Jon Lee

In this work, we address unconstrained finite-sum optimization problems, with particular focus on instances originating in large scale deep learning scenarios. Our main interest lies in the exploration of the relationship between recent…

Optimization and Control · Mathematics 2026-03-13 Matteo Lapucci , Davide Pucci