English
Related papers

Related papers: Multi-objective Optimization by Learning Space Par…

200 papers

Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous…

Machine Learning · Computer Science 2024-07-31 Weiyu Chen , James T. Kwok

Several planners have been proposed to compute robot paths that reach desired goal regions while avoiding obstacles. However, these methods fail when all pathways to the goal are blocked. In such cases, the robot must reason about how to…

Robotics · Computer Science 2025-10-17 Yuqing Zhang , Yiannis Kantaros

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperparameter evaluations cost approximately the same. In…

Machine Learning · Computer Science 2020-11-25 Gauthier Guinet , Valerio Perrone , Cédric Archambeau

Fast gradient-based optimization algorithms have become increasingly essential for the computationally efficient training of machine learning models. One technique is to multiply the gradient by a preconditioner matrix to produce a step,…

Machine Learning · Computer Science 2023-09-12 Isaac Liao , Rumen R. Dangovski , Jakob N. Foerster , Marin Soljačić

In this work, we consider multiobjective optimization problems with both bound constraints on the variables and general nonlinear constraints, where objective and constraint function values can only be obtained by querying a black box.…

Optimization and Control · Mathematics 2022-04-15 Giampaolo Liuzzi , Stefano Lucidi

This study considers multi-objective Bayesian optimization (MOBO) through the information gain of the Pareto-frontier. To calculate the information gain, a predictive distribution conditioned on the Pareto-frontier plays a key role, which…

Machine Learning · Computer Science 2025-09-04 Masanori Ishikura , Masayuki Karasuyama

Problems defined on binary decision spaces have been intensively studied in the theory of multi-objective evolutionary algorithms (MOEAs). In contrast, no mathematical runtime analyses exist so far for MOEAs dealing with decision variables…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Mingfeng Li , Zheng Cheng , Weijie Zheng , Benjamin Doerr

Recently, there has been a growing surge of interest in enabling machine learning systems to generalize well to Out-of-Distribution (OOD) data. Most efforts are devoted to advancing optimization objectives that regularize models to capture…

Machine Learning · Computer Science 2023-03-03 Yongqiang Chen , Kaiwen Zhou , Yatao Bian , Binghui Xie , Bingzhe Wu , Yonggang Zhang , Kaili Ma , Han Yang , Peilin Zhao , Bo Han , James Cheng

In multi-objective optimization, a single decision vector must balance the trade-offs between many objectives. Solutions achieving an optimal trade-off are said to be Pareto optimal: these are decision vectors for which improving any one…

Optimization and Control · Mathematics 2023-08-07 Abhishek Roy , Geelon So , Yi-An Ma

Large-scale multiobjective optimization problems (LSMOPs) refer to optimization problems with multiple conflicting optimization objectives and hundreds or even thousands of decision variables. A key point in solving LSMOPs is how to balance…

Neural and Evolutionary Computing · Computer Science 2023-04-17 Haokai Hong , Min Jiang , Liang Feng , Qiuzhen Lin , Kay Chen Tan

A multi-condition multi-objective optimization method that can find Pareto front over a defined condition space is developed for the first time using deep reinforcement learning. Unlike the conventional methods which perform optimization at…

Machine Learning · Computer Science 2022-05-25 Sejin Kim , Innyoung Kim , Donghyun You

The facility location problems (FLPs) are a typical class of NP-hard combinatorial optimization problems, which are widely seen in the supply chain and logistics. Many mathematical and heuristic algorithms have been developed for optimizing…

Machine Learning · Computer Science 2022-10-28 Shiqing Liu , Xueming Yan , Yaochu Jin

Given a finite set $N$ of feasible points of a multi-objective optimization (MOO) problem, the search region corresponds to the part of the objective space containing all the points that are not dominated by any point of $N$, i.e. the part…

Discrete Mathematics · Computer Science 2015-04-14 Kathrin Klamroth , Renaud Lacour , Daniel Vanderpooten

Software configuration tuning is essential for optimizing a given performance objective (e.g., minimizing latency). Yet, due to the software's intrinsically complex configuration landscape and expensive measurement, there has been a rather…

Software Engineering · Computer Science 2024-03-18 Pengzhou Chen , Tao Chen , Miqing Li

One of the most common approaches for multiobjective optimization is to generate a solution set that well approximates the whole Pareto-optimal frontier to facilitate the later decision-making process. However, how to evaluate and compare…

Neural and Evolutionary Computing · Computer Science 2017-02-03 Miqing Li , Xin Yao

Optimisation problems often have multiple conflicting objectives that can be computationally and/or financially expensive. Mono-surrogate Bayesian optimisation (BO) is a popular model-based approach for optimising such black-box functions.…

Machine Learning · Computer Science 2022-08-11 George De Ath , Tinkle Chugh , Alma A. M. Rahat

The discovery of therapeutic molecules is fundamentally a multi-objective optimization problem. One formulation of the problem is to identify molecules that simultaneously exhibit strong binding affinity for a target protein, minimal…

Quantitative Methods · Quantitative Biology 2023-10-17 Jenna C. Fromer , David E. Graff , Connor W. Coley

Most of existing neural methods for multi-objective combinatorial optimization (MOCO) problems solely rely on decomposition, which often leads to repetitive solutions for the respective subproblems, thus a limited Pareto set. Beyond…

Machine Learning · Computer Science 2023-10-25 Jinbiao Chen , Zizhen Zhang , Zhiguang Cao , Yaoxin Wu , Yining Ma , Te Ye , Jiahai Wang

The construction of machine learning models involves many bi-level multi-objective optimization problems (BL-MOPs), where upper level (UL) candidate solutions must be evaluated via training weights of a model in the lower level (LL). Due to…

Neural and Evolutionary Computing · Computer Science 2023-02-07 Chao Wang , Licheng Jiao , Jiaxuan Zhao , Lingling Li , Xu Liu , Fang Liu , Shuyuan Yang

We present PESMO, a Bayesian method for identifying the Pareto set of multi-objective optimization problems, when the functions are expensive to evaluate. The central idea of PESMO is to choose evaluation points so as to maximally reduce…

Machine Learning · Statistics 2016-02-23 Daniel Hernández-Lobato , José Miguel Hernández-Lobato , Amar Shah , Ryan P. Adams