English
Related papers

Related papers: Acceleration Techniques for Learning Optimal Class…

200 papers

It is well-known that by adding integrality constraints to the semidefinite programming (SDP) relaxation of the max-cut problem, the resulting integer semidefinite program is an exact formulation of the problem. In this paper we show…

Optimization and Control · Mathematics 2023-11-09 Frank de Meijer , Renata Sotirov

Ensembles of classification and regression trees remain popular machine learning methods because they define flexible non-parametric models that predict well and are computationally efficient both during training and testing. During…

Machine Learning · Computer Science 2012-06-22 Sebastian Nowozin

Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to…

Optimization and Control · Mathematics 2026-04-21 Shivi Dixit , Rishabh Gupta , Qi Zhang

Interpretation of Deep Neural Networks (DNNs) training as an optimal control problem with nonlinear dynamical systems has received considerable attention recently, yet the algorithmic development remains relatively limited. In this work, we…

Machine Learning · Computer Science 2021-06-14 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

In hybrid Model Predictive Control (MPC), a Mixed-Integer Quadratic Program (MIQP) is solved at each sampling time to compute the optimal control action. Although these optimizations are generally very demanding, in MPC we expect…

Systems and Control · Electrical Eng. & Systems 2020-04-01 Tobia Marcucci , Russ Tedrake

Designing faster algorithms for solving Mixed-Integer Linear Programming (MILP) problems is highly desired across numerous practical domains, as a vast array of complex real-world challenges can be effectively modeled as MILP formulations.…

Artificial Intelligence · Computer Science 2026-01-23 Ruizhi Liu , Liming Xu , Xulin Huang , Jingyan Sui , Shizhe Ding , Boyang Xia , Chungong Yu , Dongbo Bu

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

We propose new methods for Support Vector Machines (SVMs) using tree architecture for multi-class classi- fication. In each node of the tree, we select an appropriate binary classifier using entropy and generalization error estimation, then…

Machine Learning · Computer Science 2017-08-29 Pittipol Kantavat , Boonserm Kijsirikul , Patoomsiri Songsiri , Ken-ichi Fukui , Masayuki Numao

Production systems use heuristics because they are faster or scale better than their optimal counterparts. Yet, practitioners are often unaware of the performance gap between a heuristic and the optimum or between two heuristics in…

Networking and Internet Architecture · Computer Science 2023-11-22 Pooria Namyar , Behnaz Arzani , Ryan Beckett , Santiago Segarra , Himanshu Raj , Umesh Krishnaswamy , Ramesh Govindan , Srikanth Kandula

This paper addresses the challenge of dynamic multi-objective optimization problems (DMOPs) by introducing novel approaches for accelerating prediction strategies within the evolutionary algorithm framework. Since the objectives of DMOPs…

Neural and Evolutionary Computing · Computer Science 2024-11-14 Ru Lei , Lin Li , Rustam Stolkin , Bin Feng

Modern compilers optimize programs through a sequence of modular passes over intermediate representations (IR). While this pass-by-pass paradigm offers engineering benefits, it suffers from a pass coordination problem: locally beneficial…

Programming Languages · Computer Science 2026-02-24 Lei Qiu , Zi Yang , Fang Lyu , Ming Zhong , Huimin Cui , Xiaobing Feng

There is an increasing need for algorithms that can accurately detect changepoints in long time-series, or equivalent, data. Many common approaches to detecting changepoints, for example based on penalised likelihood or minimum description…

Methodology · Statistics 2014-09-08 Robert Maidstone , Toby Hocking , Guillem Rigaill , Paul Fearnhead

Planning collision-free motions for robots with many degrees of freedom is challenging in environments with complex obstacle geometries. Recent work introduced the idea of speeding up the planning by encoding prior experience of successful…

Robotics · Computer Science 2024-05-28 Johannes Tenhumberg , Darius Burschka , Berthold Bäuml

This article introduces a numerical algorithm that serves as a preliminary step toward solving continuous-time model predictive control (MPC) problems directly without explicit time-discretization. The chief ingredients of the underlying…

Optimization and Control · Mathematics 2024-01-24 Souvik Das , Siddhartha Ganguly , Muthyala Anjali , Debasish Chatterjee

A key ingredient in branch and bound (B&B) solvers for mixed-integer programming (MIP) is the selection of branching variables since poor or arbitrary selection can affect the size of the resulting search trees by orders of magnitude. A…

Optimization and Control · Mathematics 2020-08-31 Daniel Anderson , Pierre Le Bodic , Kerri Morgan

We present a new algorithm, Fractional Decomposition Tree (FDT) for finding a feasible solution for an integer program (IP) where all variables are binary. FDT runs in polynomial time and is guaranteed to find a feasible integer solution…

Discrete Mathematics · Computer Science 2020-08-12 Robert D. Carr , Arash Haddadan , Cynthia A. Phillips

Decision trees are a widely used method for classification, both by themselves and as the building blocks of multiple different ensemble learning methods. The Max-Cut decision tree involves novel modifications to a standard, baseline model…

Machine Learning · Computer Science 2020-06-26 Jonathan Bodine , Dorit S. Hochbaum

Optimizing Large Language Model (LLM) performance requires well-crafted prompts, but manual prompt engineering is labor-intensive and often ineffective. Automated prompt optimization techniques address this challenge but the majority of…

Computation and Language · Computer Science 2025-08-20 Ximing Dong , Shaowei Wang , Dayi Lin , Ahmed E. Hassan

This paper introduces Bidirectional Tight Informed Trees (BTIT*), an asymptotically optimal kinodynamic sampling-based motion planning algorithm that integrates an anytime bidirectional heuristic search (Bi-HS) and ensures the…

Robotics · Computer Science 2026-04-14 Yi Wang , Bingxian Mu , Shahab Shokouhi , May-Win Thein

We propose a machine learning approach for quickly solving Mixed Integer Programs (MIP) by learning to prioritize a set of decision variables, which we call pseudo-backdoors, for branching that results in faster solution times.…

Machine Learning · Computer Science 2021-06-10 Aaron Ferber , Jialin Song , Bistra Dilkina , Yisong Yue