English
Related papers

Related papers: Bayesian Preference Elicitation: Human-In-The-Loop…

200 papers

Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well-performing machine learning models, tuning BO's own…

Machine Learning · Computer Science 2019-08-20 Marius Lindauer , Matthias Feurer , Katharina Eggensperger , André Biedenkapp , Frank Hutter

Recent advancements in human video generation and animation tasks, driven by diffusion models, have achieved significant progress. However, expressive and realistic human animation remains challenging due to the trade-off between motion…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Chao Liang , Jianwen Jiang , Wang Liao , Jiaqi Yang , Zerong zheng , Weihong Zeng , Han Liang

Despite the growing interest in designing truly interactive hyperparameter optimization (HPO) methods, to date, only a few allow to include human feedback. Existing interactive Bayesian optimization (BO) methods incorporate human beliefs by…

Machine Learning · Computer Science 2025-05-26 Jonas Seng , Fabrizio Ventola , Zhongjie Yu , Kristian Kersting

In this paper, we introduce HALO, a novel Offline Reward Learning algorithm that quantifies human intuition in navigation into a vision-based reward function for robot navigation. HALO learns a reward model from offline data, leveraging…

At the forefront of state-of-the-art human alignment methods are preference optimization methods (*PO). Prior research has often concentrated on identifying the best-performing method, typically involving a grid search over hyperparameters,…

Computation and Language · Computer Science 2025-04-30 Kian Ahrabian , Xihui Lin , Barun Patra , Vishrav Chaudhary , Alon Benhaim , Jay Pujara , Xia Song

We consider black-box global optimization of time-consuming-to-evaluate functions on behalf of a decision-maker (DM) whose preferences must be learned. Each feasible design is associated with a time-consuming-to-evaluate vector of…

Machine Learning · Statistics 2020-03-05 Raul Astudillo , Peter I. Frazier

In this paper, we address the problem of \emph{cost-sensitive} hyperparameter optimization (HPO) built upon freeze-thaw Bayesian optimization (BO). Specifically, we assume a scenario where users want to early-stop the HPO process when the…

Machine Learning · Computer Science 2025-10-27 Dong Bok Lee , Aoxuan Silvia Zhang , Byungjoo Kim , Junhyeon Park , Steven Adriaensen , Juho Lee , Sung Ju Hwang , Hae Beom Lee

Optimizing an expensive-to-query function is a common task in science and engineering, where it is beneficial to keep the number of queries to a minimum. A popular strategy is Bayesian optimization (BO), which leverages probabilistic models…

Machine Learning · Computer Science 2019-07-05 Willie Neiswanger , Kirthevasan Kandasamy , Barnabas Poczos , Jeff Schneider , Eric Xing

Trajectory planning for automated vehicles commonly employs optimization over a moving horizon - Model Predictive Control - where the cost function critically influences the resulting driving style. However, finding a suitable cost function…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Lukas Theiner , Sebastian Hirt , Alexander Steinke , Rolf Findeisen

Personalization of the amplification function of hearing aids has been shown to be of benefit to hearing aid users in previous studies. Several machine learning-based personalization approaches have been introduced in the literature. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-17 Aoxin Ni , Edward Lobarinas , Nasser Kehtarnavaz

Preferential Bayesian Optimization (PBO) is a sample-efficient method to learn latent user utilities from preferential feedback over a pair of designs. It relies on a statistical surrogate model for the latent function, usually a Gaussian…

Machine Learning · Statistics 2025-03-04 Xinyu Zhang , Daolang Huang , Samuel Kaski , Julien Martinelli

Controllers in robotics often consist of expert-designed heuristics, which can be hard to tune in higher dimensions. It is typical to use simulation to learn these parameters, but controllers learned in simulation often don't transfer to…

Bayesian optimization (BO) with Gaussian processes (GP) has become an indispensable algorithm for black box optimization problems. Not without a dash of irony, BO is often considered a black box itself, lacking ways to provide reasons as to…

While Bayesian Optimization (BO) is a very popular method for optimizing expensive black-box functions, it fails to leverage the experience of domain experts. This causes BO to waste function evaluations on bad design choices (e.g., machine…

Machine Learning · Computer Science 2021-04-20 Artur Souza , Luigi Nardi , Leonardo B. Oliveira , Kunle Olukotun , Marius Lindauer , Frank Hutter

Multi-objective optimization (MOO) has been widely studied in literature because of its versatility in human-centered decision making in real-life applications. Recently, demand for dynamic MOO is fast-emerging due to tough market dynamics…

Artificial Intelligence · Computer Science 2026-04-14 Jiahuan Jin , Wenhao Zhao , Rong Qu , Jianfeng Ren , Xinan Chen , Qingfu Zhang , Ruibin Bai

Optimization problems find widespread use in both single-objective and multi-objective scenarios. In practical applications, users aspire for solutions that converge to the region of interest (ROI) along the Pareto front (PF). While the…

Artificial Intelligence · Computer Science 2025-03-10 Tian Huang , Shengbo Wang , Ke Li

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

Machine Learning · Computer Science 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

Personalizing medical devices such as lower limb wearable robots is challenging. While the initial feasibility of automating the process of knee prosthesis control parameter tuning has been demonstrated in a principled way, the next…

Systems and Control · Electrical Eng. & Systems 2021-06-08 Minhan Li , Yue Wen , Xiang Gao , Jennie Si , He Helen Huang

Human-in-the-loop reinforcement learning allows the training of agents through various interfaces, even for non-expert humans. Recently, preference-based methods (PbRL), where the human has to give his preference over two trajectories,…

Artificial Intelligence · Computer Science 2024-08-06 Jakob Karalus

Locomotion planning for legged systems requires reasoning about suitable contact schedules. The contact sequence and timings constitute a hybrid dynamical system and prescribe a subset of achievable motions. State-of-the-art approaches cast…

Robotics · Computer Science 2019-03-12 Tim Seyde , Jan Carius , Ruben Grandia , Farbod Farshidian , Marco Hutter