English
Related papers

Related papers: VBO-MI: A Fully Gradient-Based Bayesian Optimizati…

200 papers

Bayesian optimization (BO) has been widely used to optimize expensive and black-box functions across various domains. However, existing BO methods have not addressed tensor-output functions. To fill this gap, we propose a novel…

Machine Learning · Computer Science 2026-03-03 Jingru Huang , Haijie Xu , Jie Guo , Manrui Jiang , Chen Zhang

While Bayesian Optimization (BO) is a very popular method for optimizing expensive black-box functions, it fails to leverage the experience of domain experts. This causes BO to waste function evaluations on bad design choices (e.g., machine…

Machine Learning · Computer Science 2021-04-20 Artur Souza , Luigi Nardi , Leonardo B. Oliveira , Kunle Olukotun , Marius Lindauer , Frank Hutter

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

Machine Learning · Statistics 2021-10-19 Tristan Fauvel , Matthew Chalk

Many crucial scientific problems involve designing novel molecules with desired properties, which can be formulated as a black-box optimization problem over the discrete chemical space. In practice, multiple conflicting objectives and…

Machine Learning · Computer Science 2023-11-03 Yiheng Zhu , Jialu Wu , Chaowen Hu , Jiahuan Yan , Chang-Yu Hsieh , Tingjun Hou , Jian Wu

Despite the growing interest in designing truly interactive hyperparameter optimization (HPO) methods, to date, only a few allow to include human feedback. Existing interactive Bayesian optimization (BO) methods incorporate human beliefs by…

Machine Learning · Computer Science 2025-05-26 Jonas Seng , Fabrizio Ventola , Zhongjie Yu , Kristian Kersting

Bayesian optimization (BO) with Gaussian processes (GP) as surrogate models is widely used to optimize analytically unknown and expensive-to-evaluate functions. In this paper, we propose Prior-mean-RObust Bayesian Optimization (PROBO) that…

Artificial Intelligence · Computer Science 2021-11-17 Julian Rodemann , Thomas Augustin

Bayesian optimization (BO) based on Gaussian process models is a powerful paradigm to optimize black-box functions that are expensive to evaluate. While several BO algorithms provably converge to the global optimum of the unknown function,…

Machine Learning · Statistics 2019-04-03 Felix Berkenkamp , Angela P. Schoellig , Andreas Krause

We study the problem of performance optimization of closed-loop control systems with unmodeled dynamics. Bayesian optimization (BO) has been demonstrated to be effective for improving closed-loop performance by automatically tuning…

Machine Learning · Computer Science 2023-01-31 Wenjie Xu , Colin N Jones , Bratislav Svetozarevic , Christopher R. Laughman , Ankush Chakrabarty

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperparameter evaluations cost approximately the same. In…

Machine Learning · Computer Science 2020-11-25 Gauthier Guinet , Valerio Perrone , Cédric Archambeau

This paper presents an information-theoretic framework for unifying active learning problems: level set estimation (LSE), Bayesian optimization (BO), and their generalized variant. We first introduce a novel active learning criterion that…

Machine Learning · Computer Science 2020-12-22 Quoc Phong Nguyen , Bryan Kian Hsiang Low , Patrick Jaillet

Multi-Source Bayesian Optimization (MSBO) serves as a variant of the traditional Bayesian Optimization (BO) framework applicable to situations involving optimization of an objective black-box function over multiple information sources such…

Machine Learning · Computer Science 2026-02-17 Luuk Jacobs , Mohammad Ali Javidian

Bilevel optimization (BO) is useful for solving a variety of important machine learning problems including but not limited to hyperparameter optimization, meta-learning, continual learning, and reinforcement learning. Conventional BO…

Machine Learning · Computer Science 2022-09-20 Mao Ye , Bo Liu , Stephen Wright , Peter Stone , Qiang Liu

Bayesian optimization (BO) is a global optimization strategy designed to find the minimum of an expensive black-box function, typically defined on a compact subset of $\mathcal{R}^d$, by using a Gaussian process (GP) as a surrogate model…

Machine Learning · Statistics 2018-09-24 Eero Siivola , Aki Vehtari , Jarno Vanhatalo , Javier González , Michael Riis Andersen

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive…

Machine Learning · Computer Science 2023-11-23 Ryota Ozaki , Kazuki Ishikawa , Youhei Kanzaki , Shinya Suzuki , Shion Takeno , Ichiro Takeuchi , Masayuki Karasuyama

Optimization for different tasks like material characterization, synthesis, and functional properties for desired applications over multi-dimensional control parameters need a rapid strategic search through active learning such as Bayesian…

Machine Learning · Computer Science 2026-03-16 Arpan Biswas , Hiroshi Funakubo , Yongtao Liu

Despite the recent success of Bayesian optimization (BO) in a variety of applications where sample efficiency is imperative, its performance may be seriously compromised in settings characterized by high-dimensional parameter spaces. A…

Machine Learning · Computer Science 2020-11-26 Noémie Jaquier , Leonel Rozo

Bayesian optimization (BO) recently became popular in robotics to optimize control parameters and parametric policies in direct reinforcement learning due to its data efficiency and gradient-free approach. However, its performance may be…

Robotics · Computer Science 2019-10-14 Noémie Jaquier , Leonel Rozo , Sylvain Calinon , Mathias Bürger

Bayesian Neural Networks (BNNs) are trained to optimize an entire distribution over their weights instead of a single set, having significant advantages in terms of, e.g., interpretability, multi-task learning, and calibration. Because of…

Machine Learning · Computer Science 2022-10-07 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Generative auto-bidding has demonstrated strong performance in online advertising, yet it often suffers from data scarcity in small-scale settings with limited advertiser participation. While cross-task data sharing is a natural remedy to…

Machine Learning · Computer Science 2026-02-10 Yiqin Lv , Zhiyu Mou , Miao Xu , Jinghao Chen , Qi Wang , Yixiu Mao , Yun Qu , Rongquan Bai , Chuan Yu , Jian Xu , Bo Zheng , Xiangyang Ji

Bayesian optimization (BO) is a popular, sample-efficient technique for expensive, black-box optimization. One such problem arising in manufacturing is that of maximizing the reliability, or equivalently minimizing the probability of a…

Machine Learning · Computer Science 2026-02-03 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke
‹ Prev 1 8 9 10 Next ›