English
Related papers

Related papers: Differentiation of Blackbox Combinatorial Solvers

200 papers

The application of machine learning (ML) models to the analysis of optimization algorithms requires the representation of optimization problems using numerical features. These features can be used as input for ML models that are trained to…

Machine Learning · Computer Science 2023-06-12 Gjorgjina Cenikj , Gašper Petelin , Carola Doerr , Peter Korošec , Tome Eftimov

The integration of constrained optimization models as components in deep networks has led to promising advances on many specialized learning tasks. A central challenge in this setting is backpropagation through the solution of an…

Machine Learning · Computer Science 2024-01-01 James Kotary , Jacob Christopher , My H Dinh , Ferdinando Fioretto

Discrete black-box optimization problems are challenging for model-based optimization (MBO) algorithms, such as Bayesian optimization, due to the size of the search space and the need to satisfy combinatorial constraints. In particular,…

Optimization and Control · Mathematics 2022-06-15 Theodore Papalexopoulos , Christian Tjandraatmadja , Ross Anderson , Juan Pablo Vielma , David Belanger

Bayesian optimization is a popular method for solving the problem of global optimization of an expensive-to-evaluate black-box function. It relies on a probabilistic surrogate model of the objective function, upon which an acquisition…

Machine Learning · Statistics 2022-06-22 Jungtaek Kim , Seungjin Choi , Minsu Cho

Despite their proficiency in various language tasks, Large Language Models (LLMs) struggle with combinatorial problems like Satisfiability, Traveling Salesman Problem, or even basic arithmetic. We address this gap through a novel trial &…

Machine Learning · Computer Science 2026-01-19 Panagiotis Giannoulis , Yorgos Pantis , Christos Tzamos

Combinatorial optimization serves as an essential part in many modern industrial applications. A great number of the problems are offline setting due to safety and/or cost issues. While simulation-based approaches appear difficult to…

Machine Learning · Computer Science 2020-07-21 Wenpeng Wei , Toshiko Aizono

We consider the problem of black-box function optimization over the boolean hypercube. Despite the vast literature on black-box function optimization over continuous domains, not much attention has been paid to learning models for…

Machine learning algorithms for generating molecular structures offer a promising new approach to drug discovery. We cast molecular optimization as a translation problem, where the goal is to map an input compound to a target compound with…

Machine Learning · Computer Science 2019-12-24 Farhan Damani , Vishnu Sresht , Stephen Ra

In this paper, we build upon previous work on designing informative and efficient Exploratory Landscape Analysis features for characterizing problems' landscapes and show their effectiveness in automatically constructing algorithm selection…

Machine Learning · Statistics 2018-11-30 Pascal Kerschke , Heike Trautmann

Many industrial applications require finding solutions to challenging combinatorial problems. Efficient elimination of symmetric solution candidates is one of the key enablers for high-performance solving. However, existing model-based…

Artificial Intelligence · Computer Science 2022-05-17 Alice Tarzariol , Martin Gebser , Mark Law , Konstantin Schekotihin

With the rise of e-commerce and increasing customer requirements, logistics service providers face a new complexity in their daily planning, mainly due to efficiently handling same day deliveries. Existing multi-stage stochastic…

Optimization and Control · Mathematics 2023-04-04 Léo Baty , Kai Jungel , Patrick S. Klein , Axel Parmentier , Maximilian Schiffer

Bridging logical and algorithmic reasoning with modern machine learning techniques is a fundamental challenge with potentially transformative impact. On the algorithmic side, many NP-hard problems can be expressed as integer programs, in…

Machine Learning · Computer Science 2024-12-16 Anselm Paulus , Michal Rolínek , Vít Musil , Brandon Amos , Georg Martius

Finding diverse solutions in combinatorial problems recently has received considerable attention (Baste et al. 2020; Fomin et al. 2020; Hanaka et al. 2021). In this paper we study the following type of problems: given an integer $k$, the…

Data Structures and Algorithms · Computer Science 2021-12-16 Tesshu Hanaka , Yasuaki Kobayashi , Kazuhiro Kurita , See Woo Lee , Yota Otachi

Black-box optimization minimizes an objective function without derivatives or explicit forms. Such an optimization method with continuous variables has been successful in the fields of machine learning and material science. For discrete…

We propose a novel exact algorithm for the transportation problem, one of the paradigmatic network optimization problems. The algorithm, denoted Iterated Inside Out, requires in input a basic feasible solution and is composed by two main…

Optimization and Control · Mathematics 2023-03-30 Roberto Bargetto , Federico Della Croce , Rosario Scatamacchia

Black-box optimization (BBO) involves functions that are unknown, inexact and/or expensive-to-evaluate. Existing BBO algorithms face several challenges, including high computational cost from extensive evaluations, difficulty in handling…

Optimization and Control · Mathematics 2025-09-26 Zixuan Zhang , Xiaowei Song , Jiaming Li , Yujiao Zeng , Yaling Nie , Min Zhu , Dongyun Lu , Yibo Zhang , Xin Xiao , Jie Li

This paper presents a novel learning-based trajectory planning framework for quadrotors that combines model-based optimization techniques with deep learning. Specifically, we formulate the trajectory optimization problem as a quadratic…

Robotics · Computer Science 2023-12-05 Yuwei Wu , Xiatao Sun , Igor Spasojevic , Vijay Kumar

We consider robust combinatorial optimization problems where the decision maker can react to a scenario by choosing from a finite set of $k$ solutions. This approach is appropriate for decision problems under uncertainty where the…

Optimization and Control · Mathematics 2019-03-28 André Chassein , Marc Goerigk , Jannis Kurtz , Michael Poss

Solving combinatorial optimization (CO) on graphs is among the fundamental tasks for upper-stream applications in data mining, machine learning and operations research. Despite the inherent NP-hard challenge for CO, heuristics,…

Optimization and Control · Mathematics 2022-06-07 Han Lu , Zenan Li , Runzhong Wang , Qibing Ren , Junchi Yan , Xiaokang Yang

Black-box optimization (BBO) addresses problems where objectives are accessible only through costly queries without gradients or explicit structure. Classical derivative-free methods -- line search, direct search, and model-based solvers…

Machine Learning · Computer Science 2025-10-01 Morteza Kimiaei , Vyacheslav Kungurtsev