English
Related papers

Related papers: Pareto Set Prediction Assisted Bilevel Multi-objec…

200 papers

We consider the problem of multi-objective (MO) blackbox optimization using expensive function evaluations, where the goal is to approximate the true Pareto set of solutions while minimizing the number of function evaluations. For example,…

Machine Learning · Computer Science 2022-04-13 Syrine Belakaria , Aryan Deshwal , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

Multi-objective optimization problems (MOPs) require the simultaneous optimization of conflicting objectives. Real-world MOPs often exhibit complex characteristics, including high-dimensional decision spaces, many objectives, or…

Neural and Evolutionary Computing · Computer Science 2025-10-20 Haokai Hong , Liang Feng , Min Jiang , Kay Chen Tan

Meta learning with multiple objectives can be formulated as a Multi-Objective Bi-Level optimization Problem (MOBLP) where the upper-level subproblem is to solve several possible conflicting targets for the meta learner. However, existing…

Machine Learning · Computer Science 2021-02-16 Feiyang Ye , Baijiong Lin , Zhixiong Yue , Pengxin Guo , Qiao Xiao , Yu Zhang

In this paper we begin by discussing the simple bilevel programming problem (SBP) and its extension the simple mathematical programming problem under equilibrium constraints (SMPEC). Here we first define both these problems and study their…

Optimization and Control · Mathematics 2019-12-16 Stephan Dempe , Nguyen Dinh , Joydeep Dutta , Tanushree Pandit

The optimal assignment of Large Language Models (LLMs) to specialized roles in multi-agent systems is a significant challenge, defined by a vast combinatorial search space, expensive black-box evaluations, and an inherent trade-off between…

Multiagent Systems · Computer Science 2025-11-18 Antonio Sabbatella

Bilevel optimization recently has attracted increased interest in machine learning due to its many applications such as hyper-parameter optimization and meta learning. Although many bilevel methods recently have been proposed, these methods…

Optimization and Control · Mathematics 2023-02-21 Feihu Huang , Junyi Li , Shangqian Gao

Many modern machine learning applications, such as multi-task learning, require finding optimal model parameters to trade-off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on…

Optimization and Control · Mathematics 2022-09-05 Mao Ye , Qiang Liu

We consider the standard optimistic bilevel optimization problem, in particular upper- and lower-level constraints can be coupled. By means of the lower-level value function, the problem is transformed into a single-level optimization…

Optimization and Control · Mathematics 2019-12-17 Andreas Fischer , Alain B. Zemkoho , Shenglong Zhou

Multi-modal multi-objective optimization aims to find all Pareto optimal solutions including overlapping solutions in the objective space. Multi-modal multi-objective optimization has been investigated in the evolutionary computation…

Neural and Evolutionary Computing · Computer Science 2020-09-29 Ryoji Tanabe , Hisao Ishibuchi

The open-pit mine scheduling problem (OPMSP) is a complex, computationally expensive process in long-term mine planning, constrained by operational and geological dependencies. Traditional deterministic approaches often ignore geological…

Neural and Evolutionary Computing · Computer Science 2025-11-12 Ishara Hewa Pathiranage , Aneta Neumann

We study the novel problem of blackbox optimization of multiple objectives via multi-fidelity function evaluations that vary in the amount of resources consumed and their accuracy. The overall goal is to approximate the true Pareto set of…

Artificial Intelligence · Computer Science 2020-11-04 Syrine Belakaria , Aryan Deshwal , Janardhan Rao Doppa

In this work, we introduce new direct search schemes for the solution of bilevel optimization (BO) problems. Our methods rely on a fixed accuracy black box oracle for the lower-level problem, and deal both with smooth and potentially…

Optimization and Control · Mathematics 2023-09-14 Youssef Diouane , Vyacheslav Kungurtsev , Francesco Rinaldi , Damiano Zeffiro

A wide range of applications arising in machine learning and signal processing can be cast as convex optimization problems. These problems are often ill-posed, i.e., the optimal solution lacks a desired property such as uniqueness or…

Optimization and Control · Mathematics 2019-07-18 Mostafa Amini , Farzad Yousefian

Multi-objective optimization has burgeoned as a potent methodology for informed decision-making in enhanced geothermal systems, aiming to concurrently maximize economic yield, ensure enduring geothermal energy provision, and curtail carbon…

Neural and Evolutionary Computing · Computer Science 2024-11-04 Guodong Chen , Jiu Jimmy Jiao , Qiqi Liu , Zhongzheng Wang , Yaochu Jin

Although traditional optimization methods focus on finding a single optimal solution, most objective functions in modern machine learning problems, especially those in deep learning, often have multiple or infinite numbers of optima.…

Machine Learning · Computer Science 2022-02-18 Chengyue Gong , Lemeng Wu , Qiang Liu

Multi-objective optimization problems are ubiquitous in real-world science, engineering and design optimization problems. It is not uncommon that the objective functions are as a black box, the evaluation of which usually involve…

Neural and Evolutionary Computing · Computer Science 2021-09-14 Ke Li , Renzhi Chen

Bilevel linear programming (LP) is one of the simplest classes of bilevel optimization problems, yet it is known to be NP-hard in general. Specifically, determining whether the optimal objective value of a bilevel LP is at least as good as…

Optimization and Control · Mathematics 2026-03-23 Nagisa Sugishita , Margarida Carvalho

Cross-Project Defect Prediction (CPDP), which borrows data from similar projects by combining a transfer learner with a classifier, have emerged as a promising way to predict software defects when the available data about the target project…

Software Engineering · Computer Science 2020-09-01 Ke Li , Zilin Xiang , Tao Chen , Kay Chen Tan

Inverse problems occur in a variety of parameter identification tasks in engineering. Such problems are challenging in practice, as they require repeated evaluation of computationally expensive forward models. We introduce a unifying…

Optimization and Control · Mathematics 2022-05-02 Simon Weissmann , Ashia Wilson , Jakob Zech

This work addresses the uniform parallel machine scheduling problem within an optimistic bilevel optimization framework. The leader seeks to minimize the weighted number of tardy jobs, while the follower aims to minimize the total…

Optimization and Control · Mathematics 2026-05-20 Quentin Schau , Federico Della Croce , Olivier Ploton , Vincent t'Kindt