English
Related papers

Related papers: Optimal Decision Trees for the Algorithm Selection…

200 papers

We formulate selecting the best optimizing system (SBOS) problems and provide solutions for those problems. In an SBOS problem, a finite number of systems are contenders. Inside each system, a continuous decision variable affects the…

Methodology · Statistics 2025-11-04 Nian Si , Yifu Tang , Zeyu Zheng

We propose an approach for learning optimal tree-based prescription policies directly from data, combining methods for counterfactual estimation from the causal inference literature with recent advances in training globally-optimal decision…

Machine Learning · Computer Science 2020-12-07 Maxime Amram , Jack Dunn , Ying Daisy Zhuo

In this paper we develop optimal algorithms in the binary-forking model for a variety of fundamental problems, including sorting, semisorting, list ranking, tree contraction, range minima, and ordered set union, intersection and difference.…

Data Structures and Algorithms · Computer Science 2020-06-26 Guy E. Blelloch , Jeremy T. Fineman , Yan Gu , Yihan Sun

Dual-tree algorithms are a widely used class of branch-and-bound algorithms. Unfortunately, developing dual-tree algorithms for use with different trees and problems is often complex and burdensome. We introduce a four-part logical split:…

Data Structures and Algorithms · Computer Science 2013-04-17 Ryan R. Curtin , William B. March , Parikshit Ram , David V. Anderson , Alexander G. Gray , Charles L. Isbell

Error-Correcting Output Codes (ECOCs) offer a principled approach for combining simple binary classifiers into multiclass classifiers. In this paper, we investigate the problem of designing optimal ECOCs to achieve both nominal and…

Machine Learning · Computer Science 2020-11-03 Samarth Gupta , Saurabh Amin

Purpose: This paper presents an algorithm that can elicitate (infer) all or any combination of ELECTRE Tri-B parameters. For example, a decision-maker can maintain the values for indifference, preference, and veto thresholds, and our…

Machine Learning · Computer Science 2021-04-12 Gabriela Montenegro de Barros , Valdecy Pereira

We propose a supervised learning framework for computing solutions of multi-parametric Mixed Integer Linear Programs (MILPs) that arise in Model Predictive Control. Our approach also quantifies sub-optimality for the computed solutions.…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Luigi Russo , Siddharth H. Nair , Luigi Glielmo , Francesco Borrelli

We consider integer and linear programming problems for which the linear constraints exhibit a (recursive) block-structure: The problem decomposes into independent and efficiently solvable sub-problems if a small number of constraints is…

Computational Complexity · Computer Science 2020-08-04 Jana Cslovjecsek , Friedrich Eisenbrand , Christoph Hunkenschröder , Lars Rohwedder , Robert Weismantel

This PhD thesis summarizes research works on the design of exact algorithms that provide a worst-case (time or space) guarantee for NP-hard scheduling problems. Both theoretical and practical aspects are considered with three main results…

Computational Complexity · Computer Science 2017-12-07 Lei Shang

Boosted decision trees enjoy popularity in a variety of applications; however, for large-scale datasets, the cost of training a decision tree in each round can be prohibitively expensive. Inspired by ideas from the multi-arm bandit…

Machine Learning · Computer Science 2018-05-22 Maryam Aziz , Jesse Anderton , Javed Aslam

In this paper, based on results of exact learning and test theory, we study arbitrary infinite binary information systems each of which consists of an infinite set of elements and an infinite set of two-valued functions (attributes) defined…

Computational Complexity · Computer Science 2022-01-13 Mikhail Moshkov

Experts advising decision-makers are likely to display expertise which varies as a function of the problem instance. In practice, this may lead to sub-optimal or discriminatory decisions against minority cases. In this work we model such…

Artificial Intelligence · Computer Science 2023-10-27 Axel Abels , Tom Lenaerts , Vito Trianni , Ann Nowé

A key ingredient in branch and bound (B&B) solvers for mixed-integer programming (MIP) is the selection of branching variables since poor or arbitrary selection can affect the size of the resulting search trees by orders of magnitude. A…

Optimization and Control · Mathematics 2020-08-31 Daniel Anderson , Pierre Le Bodic , Kerri Morgan

Monte Carlo Tree Search is a popular method for solving decision making problems. Faster implementations allow for more simulations within the same wall clock time, directly improving search performance. To this end, we present an…

Artificial Intelligence · Computer Science 2025-08-29 James Ragan , Fred Y. Hadaegh , Soon-Jo Chung

Subset selection for multiple linear regression aims to construct a regression model that minimizes errors by selecting a small number of explanatory variables. Once a model is built, various statistical tests and diagnostics are conducted…

Machine Learning · Statistics 2020-09-04 Seokhyun Chung , Young Woong Park , Taesu Cheong

One of the key problems in tensor network based quantum circuit simulation is the construction of a contraction tree which minimizes the cost of the simulation, where the cost can be expressed in the number of operations as a proxy for the…

Quantum Physics · Physics 2022-09-08 Cameron Ibrahim , Danylo Lykov , Zichang He , Yuri Alexeev , Ilya Safro

Many real-world problems can be efficiently modeled as Mixed Integer Linear Programs (MILPs) and solved with the Branch-and-Bound method. Prior work has shown the existence of MILP backdoors, small sets of variables such that prioritizing…

Artificial Intelligence · Computer Science 2024-08-02 Junyang Cai , Taoan Huang , Bistra Dilkina

We consider the problem of constructing optimal decision trees: given a collection of tests which can disambiguate between a set of $m$ possible diseases, each test having a cost, and the a-priori likelihood of the patient having any…

Data Structures and Algorithms · Computer Science 2017-04-24 Anupam Gupta , Viswanath Nagarajan , R. Ravi

In \cite{siebert2019linear} the authors present a set of integer programs (IPs) for the Steiner tree problem, which can be used for both, the directed and the undirected setting of the problem. Each IP finds an optimal Steiner tree with a…

Combinatorics · Mathematics 2020-02-11 Matias Siebert , Shabbir Ahmed , George Nemhauser

We propose a randomized method for solving linear programs with a large number of columns but a relatively small number of constraints. Since enumerating all the columns is usually unrealistic, such linear programs are commonly solved by…

Optimization and Control · Mathematics 2023-11-29 Yi-Chun Akchen , Velibor V. Mišić