English
Related papers

Related papers: Enhanced Bayesian Optimization via Preferential Mo…

200 papers

Selecting the optimal combination of a machine learning (ML) algorithm and its hyper-parameters is crucial for the development of high-performance ML systems. However, since the combination of ML algorithms and hyper-parameters is enormous,…

Machine Learning · Computer Science 2025-02-14 Kazuki Ishikawa , Ryota Ozaki , Yohei Kanzaki , Ichiro Takeuchi , Masayuki Karasuyama

Preferential Bayesian optimization (PBO) is a variant of Bayesian optimization that observes relative preferences (e.g., pairwise comparisons) instead of direct objective values, making it especially suitable for human-in-the-loop…

Machine Learning · Computer Science 2025-05-19 Koki Iwai , Yusuke Kumagae , Yuki Koyama , Masahiro Hamasaki , Masataka Goto

Despite the growing interest in designing truly interactive hyperparameter optimization (HPO) methods, to date, only a few allow to include human feedback. Existing interactive Bayesian optimization (BO) methods incorporate human beliefs by…

Machine Learning · Computer Science 2025-05-26 Jonas Seng , Fabrizio Ventola , Zhongjie Yu , Kristian Kersting

Bayesian optimization (BO) with preference-based feedback has recently garnered significant attention due to its emerging applications. We refer to this problem as Bayesian Optimization from Human Feedback (BOHF), which differs from…

Machine Learning · Computer Science 2025-05-30 Aya Kayal , Sattar Vakili , Laura Toni , Da-shan Shiu , Alberto Bernacchia

Bayesian optimization (BO) is a widely-used method for optimizing expensive (to evaluate) problems. At the core of most BO methods is the modeling of the objective function using a Gaussian Process (GP) whose covariance is selected from a…

Bayesian Optimization (BO) methods are useful for optimizing functions that are expen- sive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

Machine Learning · Statistics 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Bayesian optimal experimental design (BOED) is a principled framework for making efficient use of limited experimental resources. Unfortunately, its applicability is hampered by the difficulty of obtaining accurate estimates of the expected…

Machine Learning · Statistics 2020-01-15 Adam Foster , Martin Jankowiak , Eli Bingham , Paul Horsfall , Yee Whye Teh , Tom Rainforth , Noah Goodman

Bayesian optimization (BO) methods often rely on the assumption that the objective function is well-behaved, but in practice, this is seldom true for real-world objectives even if noise-free observations can be collected. Common approaches,…

Machine Learning · Statistics 2020-09-10 Erik Bodin , Markus Kaiser , Ieva Kazlauskaite , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

Bayesian optimization has been successfully applied to optimize black-box functions where the number of evaluations is severely limited. However, in many real-world applications, it is hard or impossible to know in advance which designs are…

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agents often face…

Machine Learning · Statistics 2025-10-21 Zihan Wang , Yi-Ping Chen , Tuba Dolar , Wei Chen

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimization in these…

Machine Learning · Statistics 2020-06-05 Peter D. Tonner , Daniel V. Samarov , A. Gilad Kusne

Bayesian optimization (BO) is a typical approach to solve expensive optimization problems. In each iteration of BO, a Gaussian process(GP) model is trained using the previously evaluated solutions; then next candidate solutions for…

Neural and Evolutionary Computing · Computer Science 2022-06-23 Jixiang Chen , Fu Luo , Zhenkun Wang

Bayesian optimization (BO) is an efficient method to optimize expensive black-box functions. It has been generalized to scenarios where objective function evaluations return stochastic binary feedback, such as success/failure in a given…

Machine Learning · Statistics 2021-11-08 Tristan Fauvel , Matthew Chalk

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Bayesian optimization (BO) is a popular, sample-efficient technique for expensive, black-box optimization. One such problem arising in manufacturing is that of maximizing the reliability, or equivalently minimizing the probability of a…

Machine Learning · Computer Science 2026-02-03 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Bayesian Optimization (BO) is a surrogate-assisted global optimization technique that has been successfully applied in various fields, e.g., automated machine learning and design optimization. Built upon a so-called infill-criterion and…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Elena Raponi , Hao Wang , Mariusz Bujny , Simonetta Boria , Carola Doerr

We consider the problem of optimizing expensive black-box functions over high-dimensional combinatorial spaces which arises in many science, engineering, and ML applications. We use Bayesian Optimization (BO) and propose a novel surrogate…

Machine Learning · Computer Science 2023-03-06 Aryan Deshwal , Sebastian Ament , Maximilian Balandat , Eytan Bakshy , Janardhan Rao Doppa , David Eriksson

Motivated by the growing need for black-box optimization and data privacy, we introduce a collaborative Bayesian optimization (BO) framework that addresses both of these challenges. In this framework agents work collaboratively to optimize…

Machine Learning · Computer Science 2025-04-16 Donglin Zhan , Haoting Zhang , Rhonda Righter , Zeyu Zheng , James Anderson

Bayesian optimization (BO) is a class of global optimization algorithms, suitable for minimizing an expensive objective function in as few function evaluations as possible. While BO budgets are typically given in iterations, this implicitly…

Machine Learning · Computer Science 2020-03-25 Eric Hans Lee , Valerio Perrone , Cedric Archambeau , Matthias Seeger

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive…

Machine Learning · Computer Science 2023-11-23 Ryota Ozaki , Kazuki Ishikawa , Youhei Kanzaki , Shinya Suzuki , Shion Takeno , Ichiro Takeuchi , Masayuki Karasuyama
‹ Prev 1 4 5 6 7 8 10 Next ›