English
Related papers

Related papers: On Solving Boolean Multilevel Optimization Problem…

200 papers

We consider a bilevel continuous knapsack problem where the leader controls the capacity of the knapsack and the follower chooses an optimal packing according to his own profits, which may differ from those of the leader. To this bilevel…

Data Structures and Algorithms · Computer Science 2022-07-19 Christoph Buchheim , Dorothee Henke

Dependency solving is a hard (NP-complete) problem in all non-trivial component models due to either mutually incompatible versions of the same packages or explicitly declared package conflicts. As such, software upgrade planning needs to…

Software Engineering · Computer Science 2020-11-17 Pietro Abate , Roberto Di Cosmo , Georgios Gousios , Stefano Zacchiroli

Probabilistic programming systems enable users to encode model structure and naturally reason about uncertainties, which can be leveraged towards improved Bayesian optimization (BO) methods. Here we present a probabilistic program embedding…

Artificial Intelligence · Computer Science 2019-02-06 Alexander Lavin

Learning to Optimize (L2O) is a subfield of machine learning (ML) in which ML models are trained to solve parametric optimization problems. The general goal is to learn a fast approximator of solutions to constrained optimization problems,…

Optimization and Control · Mathematics 2025-12-04 James Kotary , Himanshu Sharma , Ethan King , Draguna Vrabie , Ferdinando Fioretto , Jan Drgona

Bilevel optimization is an important formulation for many machine learning problems. Current bilevel optimization algorithms assume that the gradient of the upper-level function is Lipschitz. However, recent studies reveal that certain…

Machine Learning · Computer Science 2024-01-19 Jie Hao , Xiaochuan Gong , Mingrui Liu

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

Bayesian Optimization (BO) is a well-established method for addressing black-box optimization problems. In many real-world scenarios, optimization often involves multiple functions, emphasizing the importance of leveraging data and learned…

Machine Learning · Computer Science 2025-03-11 Khoa Nguyen , Viet Huynh , Binh Tran , Tri Pham , Tin Huynh , Thin Nguyen

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

Machine Learning · Computer Science 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

The optimization of high-dimensional black-box functions is a challenging problem. When a low-dimensional linear embedding structure can be assumed, existing Bayesian optimization (BO) methods often transform the original problem into…

Machine Learning · Statistics 2022-11-03 Shuhei A. Horiguchi , Tomoharu Iwata , Taku Tsuzuki , Yosuke Ozawa

In a multiobjective optimization problem a solution is called Pareto-optimal if no criterion can be improved without deteriorating at least one of the other criteria. Computing the set of all Pareto-optimal solutions is a common task in…

Data Structures and Algorithms · Computer Science 2020-10-22 Heiko Röglin

Combinatorial optimization (CO) problems, central to decision-making scenarios like logistics and manufacturing, are traditionally solved using problem-specific algorithms requiring significant domain expertise. While large language models…

Artificial Intelligence · Computer Science 2025-09-24 Xia Jiang , Yaoxin Wu , Minshuo Li , Zhiguang Cao , Yingqian Zhang

Multi-objective optimization aims to solve problems with competing objectives. Evaluating such problems is often slow or expensive, limiting the budget of evaluations. In many applications, historical data from related optimization tasks is…

Machine Learning · Computer Science 2026-05-12 Leonard Papenmeier , Petru Tighineanu

This work uniquely combines an affine linear decision rule known from adjustable robustness with min-max-regret robustness. By doing so, the advantages of both concepts can be obtained with an adjustable solution that is not…

Optimization and Control · Mathematics 2024-12-02 Kerstin Schneider , Helene Krieg , Dimitri Nowak , Karl-Heinz Küfer

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, multitask Bayesian…

Machine Learning · Statistics 2019-06-24 Yao Zhang , James Jordon , Ahmed M. Alaa , Mihaela van der Schaar

In this paper, we study the Multi-Objective Bi-Level Optimization (MOBLO) problem, where the upper-level subproblem is a multi-objective optimization problem and the lower-level subproblem is for scalar optimization. Existing gradient-based…

Machine Learning · Computer Science 2024-07-11 Feiyang Ye , Baijiong Lin , Xiaofeng Cao , Yu Zhang , Ivor Tsang

Macro placement is the problem of placing memory blocks on a chip canvas. It can be formulated as a combinatorial optimization problem over sequence pairs, a representation which describes the relative positions of macros. Solving this…

In this paper, the problem of load uncertainty in compliance problems is addressed where the uncertainty is described in the form of a set of finitely many loading scenarios. Computationally more efficient methods are proposed to exactly…

Computational Engineering, Finance, and Science · Computer Science 2021-09-29 Mohamed Tarek , Tapabrata Ray

Bilevel optimization has found successful applications in various machine learning problems, including hyper-parameter optimization, data cleaning, and meta-learning. However, its huge computational cost presents a significant challenge for…

Machine Learning · Computer Science 2024-11-05 Xiaoyu Wang , Rui Pan , Renjie Pi , Jipeng Zhang

Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, engineering, physics, and experimental design. However, it remains a challenge for users to apply BBO methods to their problems at hand…

Machine Learning · Computer Science 2021-11-05 Yang Li , Yu Shen , Wentao Zhang , Yuanwei Chen , Huaijun Jiang , Mingchao Liu , Jiawei Jiang , Jinyang Gao , Wentao Wu , Zhi Yang , Ce Zhang , Bin Cui

Real-world optimization problems often do not just involve multiple objectives but also uncertain parameters. In this case, the goal is to find Pareto-optimal solutions that are robust, i.e., reasonably good under all possible realizations…

Optimization and Control · Mathematics 2023-11-06 Fabian Chlumsky-Harttmann , Marie Schmidt , Anita Schöbel