English
Related papers

Related papers: User Preference Meets Pareto-Optimality in Multi-O…

200 papers

A single language model, even when aligned with labelers through reinforcement learning from human feedback (RLHF), may not suit all human preferences. Recent approaches therefore prefer customization, gathering multi-dimensional feedback,…

Machine Learning · Computer Science 2024-08-20 Zhanhui Zhou , Jie Liu , Jing Shao , Xiangyu Yue , Chao Yang , Wanli Ouyang , Yu Qiao

In the field of large language models (LLMs), aligning models with the diverse preferences of users is a critical challenge. Direct Preference Optimization (DPO) has played a key role in this area. It works by using pairs of preferences…

Computation and Language · Computer Science 2024-05-29 Yueqin Yin , Zhendong Wang , Yi Gu , Hai Huang , Weizhu Chen , Mingyuan Zhou

Many real-world multi-objective optimisation problems rely on computationally expensive function evaluations. Multi-objective Bayesian optimisation (BO) can be used to alleviate the computation time to find an approximated set of Pareto…

Machine Learning · Statistics 2022-04-29 Tinkle Chugh

Many crucial scientific problems involve designing novel molecules with desired properties, which can be formulated as a black-box optimization problem over the discrete chemical space. In practice, multiple conflicting objectives and…

Machine Learning · Computer Science 2023-11-03 Yiheng Zhu , Jialu Wu , Chaowen Hu , Jiahuan Yan , Chang-Yu Hsieh , Tingjun Hou , Jian Wu

This paper studies an entropy-based multi-objective Bayesian optimization (MBO). The entropy search is successful approach to Bayesian optimization. However, for MBO, existing entropy-based methods ignore trade-off among objectives or…

Machine Learning · Computer Science 2020-02-12 Shinya Suzuki , Shion Takeno , Tomoyuki Tamura , Kazuki Shitara , Masayuki Karasuyama

Adjustable hyperparameters of machine learning models typically impact various key trade-offs such as accuracy, fairness, robustness, or inference cost. Our goal in this paper is to find a configuration that adheres to user-specified limits…

Machine Learning · Computer Science 2023-12-05 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

In this article, we present a framework for taking into account user preferences in multi-objective Bayesian optimization in the case where the objectives are expensive-to-evaluate black-box functions. A novel expected improvement criterion…

Optimization and Control · Mathematics 2018-09-17 Paul Feliot , Julien Bect , Emmanuel Vazquez

Trajectory planning for automated vehicles commonly employs optimization over a moving horizon - Model Predictive Control - where the cost function critically influences the resulting driving style. However, finding a suitable cost function…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Lukas Theiner , Sebastian Hirt , Alexander Steinke , Rolf Findeisen

Mutual adaptation can significantly enhance overall task performance in human-robot co-transportation by integrating both the robot's and human's understanding of the environment. While human modeling helps capture humans' subjective…

Robotics · Computer Science 2025-03-13 Al Jaber Mahmud , Weizi Li , Xuan Wang

Utility preference robust optimization (PRO) has recently been proposed to deal with optimal decision making problems where the decision maker's (DM) preference over gains and losses is ambiguous. In this paper, we take a step further to…

Optimization and Control · Mathematics 2024-03-11 Jian Hu , Dali Zhang , Huifu Xu , Sainan Zhang

Multiobjective optimization plays an increasingly important role in modern applications, where several criteria are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to…

While Bayesian Optimization (BO) is a very popular method for optimizing expensive black-box functions, it fails to leverage the experience of domain experts. This causes BO to waste function evaluations on bad design choices (e.g., machine…

Machine Learning · Computer Science 2021-04-20 Artur Souza , Luigi Nardi , Leonardo B. Oliveira , Kunle Olukotun , Marius Lindauer , Frank Hutter

Multi-Objective Optimization (MOO) techniques have become increasingly popular in recent years due to their potential for solving real-world problems in various fields, such as logistics, finance, environmental management, and engineering.…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Noor A. Rashed , Yossra H. Ali , Tarik A. Rashid , A. Salih

Direct Preference Optimization (DPO) is a simple and efficient framework that has attracted substantial attention. However, it often struggles to meet its primary objectives -- increasing the generation probability of chosen responses while…

Artificial Intelligence · Computer Science 2025-06-17 Jay Hyeon Cho , JunHyeok Oh , Myunsoo Kim , Byung-Jun Lee

It is desirable in many multi-objective machine learning applications, such as multi-task learning with conflicting objectives and multi-objective reinforcement learning, to find a Pareto solution that can match a given preference of a…

Machine Learning · Computer Science 2024-02-19 Xiaoyuan Zhang , Xi Lin , Qingfu Zhang

A preference based multi-objective evolutionary algorithm is proposed for generating solutions in an automatically detected knee point region. It is named Automatic Preference based DI-MOEA (AP-DI-MOEA) where DI-MOEA stands for…

Neural and Evolutionary Computing · Computer Science 2021-01-26 Yali Wang , Steffen Limmer , Markus Olhofer , Michael Emmerich , Thomas Baeck

Optimization has found numerous applications in engineering, particularly since 1960s. Many optimization applications in engineering have more than one objective (or performance criterion). Such applications require multi-objective (or…

Chemical Physics · Physics 2024-07-16 Zhiyuan Wang , Seyed Reza Nabavi , Gade Pandu Rangaiah

The ultimate goal of multi-objective optimisation is to help a decision maker (DM) identify solution(s) of interest (SOI) achieving satisfactory trade-offs among multiple conflicting criteria. This can be realised by leveraging DM's…

Neural and Evolutionary Computing · Computer Science 2019-10-01 Ke Li , Minhui Liao , Kalyanmoy Deb , Geyong Min , Xin Yao

Realizing high-throughput aberration-corrected Scanning Transmission Electron Microscopy (STEM) exploration of atomic structures requires rapid tuning of multipole probe correctors while compensating for the inevitable drift of the optical…

Machine Learning · Computer Science 2026-01-28 Utkarsh Pratiush , Austin Houston , Richard Liu , Gerd Duscher , Sergei Kalinin

Real-world problems often involve the optimization of several objectives under multiple constraints. An example is the hyper-parameter tuning problem of machine learning algorithms. In particular, the minimization of the estimation of the…

Machine Learning · Statistics 2021-07-02 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato
‹ Prev 1 4 5 6 7 8 10 Next ›