中文
相关论文

相关论文: GIBBON: General-purpose Information-Based Bayesian…

200 篇论文

In this paper we propose DKIBO, a Bayesian optimization (BO) algorithm that accommodates domain knowledge to tune exploration in the search space. Bayesian optimization has recently emerged as a sample-efficient optimizer for many…

人工智能 · 计算机科学 2023-11-28 Zikai Xie , Xenophon Evangelopoulos , Joseph Thacker , Andrew Cooper

Bayesian optimization (BO) is a powerful framework for optimizing black-box, expensive-to-evaluate functions. Over the past decade, many algorithms have been proposed to integrate cheaper, lower-fidelity approximations of the objective…

机器学习 · 计算机科学 2023-02-27 Petrus Mikkola , Julien Martinelli , Louis Filstroff , Samuel Kaski

Bayesian optimisation (BO) has been a successful approach to optimise functions which are expensive to evaluate and whose observations are noisy. Classical BO algorithms, however, do not account for errors about the location where…

机器学习 · 计算机科学 2019-02-22 Rafael Oliveira , Lionel Ott , Fabio Ramos

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the…

最优化与控制 · 数学 2026-05-08 Sourav Das , Debjani Chakraborty , Pabitra Mitra

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where…

机器学习 · 计算机科学 2026-02-12 Aashwin Mishra , Matt Seaberg , Ryan Roussel , Daniel Ratner , Apurva Mehta

Bayesian Optimization (BO) methods are useful for optimizing functions that are expen- sive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

机器学习 · 统计学 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

In high-dimensional settings, Bayesian optimization (BO) can be expensive and infeasible. The random embedding Bayesian optimization algorithm is commonly used to address high-dimensional BO challenges. However, this method relies on the…

机器学习 · 计算机科学 2024-08-12 Jiaming Lu , Rong J. B. Zhu

Bilevel optimization is characterized by a two-level optimization structure, where the upper-level problem is constrained by optimal lower-level solutions, and such structures are prevalent in real-world problems. The constraint by optimal…

机器学习 · 计算机科学 2025-05-29 Ruth Wan Theng Chew , Quoc Phong Nguyen , Bryan Kian Hsiang Low

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

机器学习 · 计算机科学 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

Optimizing expensive black-box objectives over mixed search spaces is a common challenge across the natural sciences. Bayesian optimization (BO) offers sample-efficient strategies through probabilistic surrogate models and acquisition…

机器学习 · 计算机科学 2026-04-10 Yuhao Zhang , Ti John , Matthias Stosiek , Patrick Rinke

We present a general strategy for turning generative models into candidate solution samplers for batch Bayesian optimization (BO). The use of generative models for BO enables large batch scaling as generative sampling, optimization of…

机器学习 · 统计学 2026-05-15 Rafael Oliveira , Daniel M. Steinberg , Edwin V. Bonilla

Bayesian optimization (BO) is increasingly employed in critical applications to find the optimal design with minimal cost. While BO is known for its sample efficiency, relying solely on costly high-fidelity data can still result in high…

人工智能 · 计算机科学 2025-03-25 Zahra Zanjani Foumani , Ramin Bostanabad

A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result to improve a wide…

机器学习 · 计算机科学 2021-09-02 Nadhir Hassen , Irina Rish

Bayesian Optimization (BO) is a widely used approach for blackbox optimization that leverages a Gaussian process (GP) model and an acquisition function to guide future sampling. While effective in low-dimensional settings, BO faces…

机器学习 · 计算机科学 2025-11-26 Pavankumar Koratikere , Leifur Leifsson

Bayesian optimization (BO) is a sequential approach for optimizing black-box objective functions using zeroth-order noisy observations. In BO, Gaussian processes (GPs) are employed as probabilistic surrogate models to estimate the objective…

机器学习 · 计算机科学 2025-04-02 Dongwon Kim , Matteo Zecchin , Sangwoo Park , Joonhyuk Kang , Osvaldo Simeone

We present K-Means Batch Bayesian Optimization (KMBBO), a novel batch sampling algorithm for Bayesian Optimization (BO). KMBBO uses unsupervised learning to efficiently estimate peaks of the model acquisition function. We show in empirical…

机器学习 · 统计学 2018-09-20 Matthew Groves , Edward O. Pyzer-Knapp

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

最优化与控制 · 数学 2021-10-01 Rodolphe Le Riche , Victor Picheny

Bayesian optimization (BO) is increasingly employed in critical applications such as materials design and drug discovery. An increasingly popular strategy in BO is to forgo the sole reliance on high-fidelity data and instead use an ensemble…

机器学习 · 统计学 2023-03-22 Zahra Zanjani Foumani , Mehdi Shishehbor , Amin Yousefpour , Ramin Bostanabad

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

机器学习 · 计算机科学 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

机器学习 · 计算机科学 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau