English
Related papers

Related papers: One Step Preference Elicitation in Multi-Objective…

200 papers

Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the…

Machine Learning · Computer Science 2019-06-24 Biswajit Paria , Kirthevasan Kandasamy , Barnabás Póczos

Preferential Bayesian optimization allows optimization of objectives that are either expensive or difficult to measure directly, by relying on a minimal number of comparative evaluations done by a human expert. Generating candidate…

Multiobjective optimization plays an increasingly important role in modern applications, where several criteria are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to…

Hyperparameter optimization (HPO) is important to leverage the full potential of machine learning (ML). In practice, users are often interested in multi-objective (MO) problems, i.e., optimizing potentially conflicting objectives, like…

Machine Learning · Computer Science 2024-01-12 Joseph Giovanelli , Alexander Tornede , Tanja Tornede , Marius Lindauer

Decomposition has become an increasingly popular technique for evolutionary multi-objective optimization (EMO). A decomposition-based EMO algorithm is usually designed to approximate a whole Pareto-optimal front (PF). However, in practice,…

Neural and Evolutionary Computing · Computer Science 2018-10-02 Ke Li , Renzhi Chen , Dragan Savic , Xin Yao

3D Mixed Reality interfaces have nearly unlimited space for layout placement, making automatic UI adaptation crucial for enhancing the user experience. Such adaptation is often formulated as a multi-objective optimization (MOO) problem,…

Human-Computer Interaction · Computer Science 2025-09-24 Yao Song , Christoph Gebhardt , Yi-Chi Liao , Christian Holz

Many modern machine learning applications, such as multi-task learning, require finding optimal model parameters to trade-off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on…

Optimization and Control · Mathematics 2022-09-05 Mao Ye , Qiang Liu

Multiple-objective optimization (MOO) aims to simultaneously optimize multiple conflicting objectives and has found important applications in machine learning, such as minimizing classification loss and discrepancy in treating different…

Machine Learning · Computer Science 2022-09-16 Eric Enouen , Katja Mathesius , Sean Wang , Arielle Carr , Sihong Xie

Multi-objective learning under user-specified preference is common in real-world problems such as multi-lingual speech recognition under fairness. In this work, we frame such a problem as a semivectorial bilevel optimization problem, whose…

Optimization and Control · Mathematics 2025-04-07 Lisha Chen , Quan Xiao , Ellen Hidemi Fukuda , Xinyi Chen , Kun Yuan , Tianyi Chen

Post-training of LLMs with RLHF, and subsequently preference optimization algorithms such as DPO, IPO, etc., made a big difference in improving human alignment. However, all such techniques can only work with a single (human) objective. In…

Machine Learning · Computer Science 2025-05-19 Akhil Agnihotri , Rahul Jain , Deepak Ramachandran , Zheng Wen

Many machine learning tasks aim to find models that work well not for a single, but for a group of criteria, often opposing ones. One such example is imbalanced data classification, where, on the one hand, we want to achieve the best…

Machine Learning · Computer Science 2025-11-18 Szymon Wojciechowski , Michał Woźniak

Bayesian optimization is a popular tool for data-efficient optimization of expensive objective functions. In real-life applications like engineering design, the designer often wants to take multiple objectives as well as input uncertainty…

Artificial Intelligence · Computer Science 2022-02-28 J. Qing , I. Couckuyt , T. Dhaene

We present a review that unifies decision-support methods for exploring the solutions produced by multi-objective optimization (MOO) algorithms. As MOO is applied to solve diverse problems, approaches for analyzing the trade-offs offered by…

Artificial Intelligence · Computer Science 2023-11-21 Zuzanna Osika , Jazmin Zatarain Salazar , Diederik M. Roijers , Frans A. Oliehoek , Pradeep K. Murukannaiah

Offline multi-objective optimization aims to identify Pareto-optimal solutions given a dataset of designs and their objective values. In this work, we propose a preference-guided diffusion model that generates Pareto-optimal designs by…

Machine Learning · Computer Science 2025-12-19 Yashas Annadani , Syrine Belakaria , Stefano Ermon , Stefan Bauer , Barbara E Engelhardt

Bayesian optimization (BO) has emerged during the last few years as an effective approach to optimizing black-box functions where direct queries of the objective are expensive. In this paper we consider the case where direct access to the…

Machine Learning · Statistics 2017-04-13 Javier Gonzalez , Zhenwen Dai , Andreas Damianou , Neil D. Lawrence

Autonomous robots are increasingly utilized in realistic scenarios with multiple complex tasks. In these scenarios, there may be a preferred way of completing all of the given tasks, but it is often in conflict with optimal execution.…

Robotics · Computer Science 2023-06-26 Peter Amorese , Morteza Lahijanian

In multi-objective optimization, a single decision vector must balance the trade-offs between many objectives. Solutions achieving an optimal trade-off are said to be Pareto optimal: these are decision vectors for which improving any one…

Optimization and Control · Mathematics 2023-08-07 Abhishek Roy , Geelon So , Yi-An Ma

Preferential Bayesian optimization (PBO) is a framework for optimizing a decision-maker's latent preferences over available design choices. While preferences often involve multiple conflicting objectives, existing work in PBO assumes that…

Machine Learning · Computer Science 2024-06-24 Raul Astudillo , Kejun Li , Maegan Tucker , Chu Xin Cheng , Aaron D. Ames , Yisong Yue

Most existing studies on evolutionary multi-objective optimization focus on approximating the whole Pareto-optimal front. Nevertheless, rather than the whole front, which demands for too many points (especially in a high-dimensional space),…

Neural and Evolutionary Computing · Computer Science 2017-01-24 Ke Li , Kalyanmoy Deb , Xin Yao

Multi-objective multi-armed bandit (MO-MAB) problems traditionally aim to achieve Pareto optimality. However, real-world scenarios often involve users with varying preferences across objectives, resulting in a Pareto-optimal arm that may…

Machine Learning · Computer Science 2025-11-18 Linfeng Cao , Ming Shi , Ness B. Shroff