English
Related papers

Related papers: Optimal Decision Trees for the Algorithm Selection…

200 papers

Decision trees are renowned for their ability to achieve high predictive performance while remaining interpretable, especially on tabular data. Traditionally, they are constructed through recursive algorithms, where they partition the data…

Machine Learning · Computer Science 2024-08-27 Yufan Zhuang , Liyuan Liu , Chandan Singh , Jingbo Shang , Jianfeng Gao

Dealing with multi-objective problems by using generation methods has some interesting advantages since it provides the decision-maker with the complete information about the set of non-dominated points (Pareto front) and a clear overview…

Optimization and Control · Mathematics 2022-09-09 Mariana Mesquita-Cunha , José Rui Figueira , Ana Paula Barbosa-Póvoa

Complete tree search is a highly effective method for tackling MIP problems, and over the years, a plethora of branching heuristics have been introduced to further refine the technique for varying problems. Recently, portfolio algorithms…

Artificial Intelligence · Computer Science 2013-07-19 Giovanni Di Liberto , Serdar Kadioglu , Kevin Leo , Yuri Malitsky

We analyze a tree search problem with an underlying Markov decision process, in which the goal is to identify the best action at the root that achieves the highest cumulative reward. We present a new tree policy that optimally allocates a…

Systems and Control · Electrical Eng. & Systems 2020-09-29 Yunchuan Li , Michael C. Fu , Jie Xu

Designing a search heuristic for constraint programming that is reliable across problem domains has been an important research topic in recent years. This paper concentrates on one family of candidates: counting-based search. Such…

Artificial Intelligence · Computer Science 2014-01-21 Gilles Pesant , Claude-Guy Quimper , Alessandro Zanarini

Mixed Integer Programming (MIP) solvers rely on an array of sophisticated heuristics developed with decades of research to solve large-scale MIP instances encountered in practice. Machine learning offers to automatically construct better…

The orienteering problem is a route optimization problem which consists in finding a simple cycle that maximizes the total collected profit subject to a maximum distance limitation. In the last few decades, the occurrence of this problem in…

Optimization and Control · Mathematics 2021-01-14 Gorka Kobeaga , María Merino , Jose A. Lozano

We consider the minimum spanning tree problem with predictions, using the weight-arrival model, i.e., the graph is given, together with predictions for the weights of all edges. Then the actual weights arrive one at a time and an…

Data Structures and Algorithms · Computer Science 2023-02-24 Magnus Berg , Joan Boyar , Lene M. Favrholdt , Kim S. Larsen

The current cut selection algorithm used in mixed-integer programming solvers has remained largely unchanged since its creation. In this paper, we propose a set of new cut scoring measures, cut filtering techniques, and stopping criteria,…

Optimization and Control · Mathematics 2023-07-18 Mark Turner , Timo Berthold , Mathieu Besançon

This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To…

Probabilistic inference is fundamentally hard, yet many tasks require optimization on top of inference, which is even harder. We present a new optimization-via-compilation strategy to scalably solve a certain class of such problems. In…

Programming Languages · Computer Science 2025-04-11 Minsung Cho , John Gouwar , Steven Holtzen

This work presents a hybrid approach to solve the maximum stable set problem, using constraint and semidefinite programming. The approach consists of two steps: subproblem generation and subproblem solution. First we rank the variable…

Combinatorics · Mathematics 2007-05-23 W. J. van Hoeve

Decision trees, without appropriate constraints, can easily become overly complex and prone to overfit, capturing noise rather than generalizable patterns. To resolve this problem,pruning operation is a crucial part in optimizing decision…

Machine Learning · Computer Science 2025-08-11 Hasibul Karim Shanto , Umme Ayman Koana , Shadikur Rahman

Optimization modeling is one of the most crucial but technical parts of operations research (OR). To automate the modeling process, existing works have leveraged large language models (LLMs), prompting them to break down tasks into steps…

Artificial Intelligence · Computer Science 2025-10-28 Haoyang Liu , Jie Wang , Yuyang Cai , Xiongwei Han , Yufei Kuang , Jianye Hao

In multiobjective optimization, most branch and bound algorithms provide the decision maker with the whole Pareto front, and then decision maker could select a single solution finally. However, if the number of objectives is large, the…

Optimization and Control · Mathematics 2024-02-29 Weitian Wu , Xinmin Yang

Recommendation algorithms perform differently if the users, recommendation contexts, applications, and user interfaces vary even slightly. It is similarly observed in other fields, such as combinatorial problem solving, that algorithms…

Information Retrieval · Computer Science 2021-01-01 Andrew Collins , Laura Tierney , Joeran Beel

In this paper, we present Batch Informed Trees (BIT*), a planning algorithm based on unifying graph- and sampling-based planning techniques. By recognizing that a set of samples describes an implicit random geometric graph (RGG), we are…

Robotics · Computer Science 2015-08-14 Jonathan D. Gammell , Siddhartha S. Srinivasa , Timothy D. Barfoot

Integrating large language models (LLMs) into closed-loop robotic task planning has become increasingly popular within embodied artificial intelligence. Previous efforts mainly focused on leveraging the strong reasoning abilities of LLMs to…

Robotics · Computer Science 2025-02-17 Chaoyuan Zhang , Zhaowei Li , Wentao Yuan

Decision Trees are prominent prediction models for interpretable Machine Learning. They have been thoroughly researched, mostly in the batch setting with a fixed labelled dataset, leading to popular algorithms such as C4.5, ID3 and CART.…

Machine Learning · Computer Science 2024-06-24 Ayman Chaouki , Jesse Read , Albert Bifet

Output thresholding is the technique to search for the best threshold to be used during inference for any classifiers that can produce probability estimates on train and testing datasets. It is particularly useful in high imbalance…

Machine Learning · Computer Science 2024-05-21 Baran Koseoglu , Luca Traverso , Mohammed Topiwalla , Egor Kraev , Zoltan Szopory