English
Related papers

Related papers: A Study of Learning Search Approximation in Mixed …

200 papers

This paper proposes a new mixed-integer programming (MIP) formulation to optimize split rule selection in the decision tree induction process, and develops an efficient search algorithm that is able to solve practical instances of the MIP…

Machine Learning · Computer Science 2022-05-31 Yanchao Liu

Cutting planes are essential for solving mixed-integer linear problems (MILPs), because they facilitate bound improvements on the optimal solution value. For selecting cuts, modern solvers rely on manually designed heuristics that are tuned…

Machine Learning · Computer Science 2022-06-28 Max B. Paulus , Giulia Zarpellon , Andreas Krause , Laurent Charlin , Chris J. Maddison

Branch-and-Bound (B\&B) is an exact method in integer programming that recursively divides the search space into a tree. During the resolution process, determining the next subproblem to explore within the tree-known as the search…

Machine Learning · Computer Science 2024-12-18 Gwen Maudet , Grégoire Danoy

We study the problem of learning a good search policy for combinatorial search spaces. We propose retrospective imitation learning, which, after initial training by an expert, improves itself by learning from \textit{retrospective…

Machine Learning · Computer Science 2019-06-25 Jialin Song , Ravi Lanka , Albert Zhao , Aadyot Bhatnagar , Yisong Yue , Masahiro Ono

Branch and Bound (B&B) is the exact tree search method typically used to solve Mixed-Integer Linear Programming problems (MILPs). Learning branching policies for MILP has become an active research area, with most works proposing to imitate…

Machine Learning · Computer Science 2021-06-04 Giulia Zarpellon , Jason Jo , Andrea Lodi , Yoshua Bengio

This paper surveys the trend of leveraging machine learning to solve mixed integer programming (MIP) problems. Theoretically, MIP is an NP-hard problem, and most of the combinatorial optimization (CO) problems can be formulated as the MIP.…

Artificial Intelligence · Computer Science 2022-03-08 Jiayi Zhang , Chang Liu , Junchi Yan , Xijun Li , Hui-Ling Zhen , Mingxuan Yuan

Interpretable reinforcement learning policies are essential for high-stakes decision-making, yet optimizing decision tree policies in Markov Decision Processes (MDPs) remains challenging. We propose SPOT, a novel method for computing…

Machine Learning · Computer Science 2025-10-23 Xuyuan Xiong , Pedro Chumpitaz-Flores , Kaixun Hua , Cheng Hua

Finding a high-quality feasible solution to a combinatorial optimization (CO) problem in a limited time is challenging due to its discrete nature. Recently, there has been an increasing number of machine learning (ML) methods for addressing…

Optimization and Control · Mathematics 2023-08-02 Taehyun Yoon , Jinwon Choi , Hyokun Yun , Sungbin Lim

Heuristic search is often used for motion planning and pathfinding problems, for finding the shortest path in a graph while also promising completeness and optimal efficiency. The drawback is it's space complexity, specifically storing all…

Artificial Intelligence · Computer Science 2024-06-10 Davor Bokan , Zlatan Ajanovic , Bakir Lacevic

Global optimization of decision trees is a long-standing challenge in combinatorial optimization, yet such models play an important role in interpretable machine learning. Although the problem has been investigated for several decades, only…

Machine Learning · Computer Science 2026-02-03 Jiancheng Tu , Wenqi Fan , Zhibin Wu

Mixed Integer Programming (MIP) is one of the most widely used modeling techniques for combinatorial optimization problems. In many applications, a similar MIP model is solved on a regular basis, maintaining remarkable similarities in model…

Artificial Intelligence · Computer Science 2019-09-10 Jian-Ya Ding , Chao Zhang , Lei Shen , Shengyin Li , Bing Wang , Yinghui Xu , Le Song

This paper proposes a novel primal heuristic for Mixed Integer Programs, by employing machine learning techniques. Mixed Integer Programming is a general technique for formulating combinatorial optimization problems. Inside a solver, primal…

Artificial Intelligence · Computer Science 2021-07-05 Yunzhuang Shen , Yuan Sun , Andrew Eberhard , Xiaodong Li

The problem of learning the structure of Bayesian networks from complete discrete data with a limit on parent set size is considered. Learning is cast explicitly as an optimisation problem where the goal is to find a BN structure which…

Artificial Intelligence · Computer Science 2012-02-20 James Cussens

In this paper, we propose a Bi-layer Predictionbased Reduction Branch (BP-RB) framework to speed up the process of finding a high-quality feasible solution for Mixed Integer Programming (MIP) problems. A graph convolutional network (GCN) is…

Optimization and Control · Mathematics 2022-09-28 Lingying Huang , Xiaomeng Chen , Wei Huo , Jiazheng Wang , Fan Zhang , Bo Bai , Ling Shi

Decision trees are a popular machine learning model which are traditionally trained by heuristic methods. Massive improvements in computing power and optimisation techniques has led to renewed interest in learning globally optimal decision…

Optimization and Control · Mathematics 2025-11-25 Mitchell Keegan , Michael Forbes , Paul Corry , Mahdi Abolghasemi

Recent machine-learning approaches to deterministic search and domain-independent planning employ policy learning to speed up search. Unfortunately, when attempting to solve a search problem by successively applying a policy, no guarantees…

Artificial Intelligence · Computer Science 2021-08-05 Pablo Araneda , Matias Greco , Jorge A. Baier

This paper proposes a Heaviside composite optimization approach and presents a progressive (mixed) integer programming (PIP) method for solving multi-class classification and multi-action treatment problems with constraints. A Heaviside…

Optimization and Control · Mathematics 2024-01-08 Yue Fang , Junyi Liu , Jong-Shi Pang

Most state-of-the-art branch-and-bound solvers for mixed-integer linear programming rely on limited-precision floating-point arithmetic and use numerical tolerances when reasoning about feasibility and optimality during their search. While…

Optimization and Control · Mathematics 2025-04-04 Alexander Hoen , Ambros Gleixner

We consider the problem of learning optimal binary classification trees. Literature on the topic has burgeoned in recent years, motivated both by the empirical suboptimality of heuristic approaches and the tremendous improvements in…

Machine Learning · Statistics 2020-05-14 Sina Aghaei , Andres Gomez , Phebe Vayanos

Over the last few years, there has been a surge in the use of learning techniques to improve the performance of optimization algorithms. In particular, the learning of branching rules in mixed integer linear programming has received a lot…