English
Related papers

Related papers: Pareto Set Learning for Expensive Multi-Objective …

200 papers

Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the…

Machine Learning · Computer Science 2019-06-24 Biswajit Paria , Kirthevasan Kandasamy , Barnabás Póczos

We consider the problem of multi-objective optimization (MOO) of expensive black-box functions with the goal of discovering high-quality and diverse Pareto fronts where we are allowed to evaluate a batch of inputs. This problem arises in…

Machine Learning · Computer Science 2024-06-14 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

Tasks in multi-task learning often correlate, conflict, or even compete with each other. As a result, a single solution that is optimal for all tasks rarely exists. Recent papers introduced the concept of Pareto optimality to this field and…

Machine Learning · Computer Science 2020-08-28 Pingchuan Ma , Tao Du , Wojciech Matusik

Incorporating user preferences into multi-objective Bayesian optimization (MOBO) allows for personalization of the optimization procedure. Preferences are often abstracted in the form of an unknown utility function, estimated through…

Machine Learning · Computer Science 2025-03-19 Joshua Hang Sai Ip , Ankush Chakrabarty , Ali Mesbah , Diego Romeres

We present a review that unifies decision-support methods for exploring the solutions produced by multi-objective optimization (MOO) algorithms. As MOO is applied to solve diverse problems, approaches for analyzing the trade-offs offered by…

Artificial Intelligence · Computer Science 2023-11-21 Zuzanna Osika , Jazmin Zatarain Salazar , Diederik M. Roijers , Frans A. Oliehoek , Pradeep K. Murukannaiah

Classical evolutionary approaches for multiobjective optimization are quite accurate but incur a lot of queries to the objectives; this can be prohibitive when objectives are expensive oracles. A sample-efficient approach to solving…

Optimization and Control · Mathematics 2025-02-18 Ashwin Renganathan , Kade E. Carlson

Multi-objective optimization aims at finding trade-off solutions to conflicting objectives. These constitute the Pareto optimal set. In the context of expensive-to-evaluate functions, it is impossible and often non-informative to look for…

Machine Learning · Statistics 2020-02-20 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

Multi-Objective Optimization (MOO) is an important problem in real-world applications. However, for a non-trivial problem, no single solution exists that can optimize all the objectives simultaneously. In a typical MOO problem, the goal is…

Machine Learning · Computer Science 2024-09-17 Zhang Haishan , Diptesh Das , Koji Tsuda

For a control problem with multiple conflicting objectives, there exists a set of Pareto-optimal policies called the Pareto set instead of a single optimal policy. When a multi-objective control problem is continuous and complex,…

Artificial Intelligence · Computer Science 2024-06-28 Tianye Shu , Ke Shang , Cheng Gong , Yang Nan , Hisao Ishibuchi

The design of machine learning systems often requires trading off different objectives, for example, prediction error and energy consumption for deep neural networks (DNNs). Typically, no single design performs well in all objectives;…

Machine Learning · Computer Science 2022-08-23 Md Shahriar Iqbal , Jianhai Su , Lars Kotthoff , Pooyan Jamshidi

Multi-Objective Optimization (MOO) techniques have become increasingly popular in recent years due to their potential for solving real-world problems in various fields, such as logistics, finance, environmental management, and engineering.…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Noor A. Rashed , Yossra H. Ali , Tarik A. Rashid , A. Salih

Many modern machine learning applications, such as multi-task learning, require finding optimal model parameters to trade-off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on…

Optimization and Control · Mathematics 2022-09-05 Mao Ye , Qiang Liu

Expensive multi-objective optimization is a prevalent and crucial concern in many real-world scenarios, where sample-efficiency is vital due to the limited evaluations to recover the true Pareto front for decision making. Existing works…

Machine Learning · Computer Science 2026-02-03 Yiming Yao , Fei Liu , Liang Zhao , Xi Lin , Yilu Liu , Qingfu Zhang

Optimizing nonlinear systems involving expensive computer experiments with regard to conflicting objectives is a common challenge. When the number of experiments is severely restricted and/or when the number of objectives increases,…

Machine Learning · Statistics 2019-07-16 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

Many real-world applications require solving families of expensive multi-objective optimization problems~(EMOPs) under varying operational conditions. This can be formulated as parametric expensive multi-objective optimization problems…

Machine Learning · Computer Science 2026-05-11 Tingyang Wei , Jiao Liu , Abhishek Gupta , Chin Chun Ooi , Puay Siew Tan , Yew-Soon Ong

Decomposition has become an increasingly popular technique for evolutionary multi-objective optimization (EMO). A decomposition-based EMO algorithm is usually designed to approximate a whole Pareto-optimal front (PF). However, in practice,…

Neural and Evolutionary Computing · Computer Science 2018-10-02 Ke Li , Renzhi Chen , Dragan Savic , Xin Yao

Pareto front profiling in multi-objective optimization (MOO), i.e., finding a diverse set of Pareto optimal solutions, is challenging, especially with expensive objectives that require training a neural network. Typically, in MOO for neural…

Machine Learning · Computer Science 2025-02-06 Rhea Sanjay Sukthanker , Arber Zela , Benedikt Staffler , Samuel Dooley , Josif Grabocka , Frank Hutter

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperparameter evaluations cost approximately the same. In…

Machine Learning · Computer Science 2020-11-25 Gauthier Guinet , Valerio Perrone , Cédric Archambeau

Decomposition has been the mainstream approach in classic mathematical programming for multi-objective optimization and multi-criterion decision-making. However, it was not properly studied in the context of evolutionary multi-objective…

Neural and Evolutionary Computing · Computer Science 2024-10-23 Ke Li

Optimization of materials performance for specific applications often requires balancing multiple aspects of materials functionality. Even for the cases where generative physical model of material behavior is known and reliable, this often…

Materials Science · Physics 2021-12-15 Arpan Biswas , Anna N. Morozovska , Maxim Ziatdinov , Eugene A. Eliseev , Sergei V. Kalinin