English
Related papers

Related papers: Sparse Bayesian Optimization

200 papers

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

Machine Learning · Computer Science 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

Bayesian Optimization (BO) is used to find the global optima of black box functions. In this work, we propose a practical BO method of function compositions where the form of the composition is known but the constituent functions are…

Machine Learning · Computer Science 2023-05-02 Kunal Jain , Prabuchandran K. J. , Tejas Bodas

Bayesian optimization (BO) is a popular framework to optimize black-box functions. In many applications, the objective function can be evaluated at multiple fidelities to enable a trade-off between the cost and accuracy. To reduce the…

Machine Learning · Computer Science 2020-12-11 Shibo Li , Wei Xing , Mike Kirby , Shandian Zhe

Bayesian optimization (BO) is a typical approach to solve expensive optimization problems. In each iteration of BO, a Gaussian process(GP) model is trained using the previously evaluated solutions; then next candidate solutions for…

Neural and Evolutionary Computing · Computer Science 2022-06-23 Jixiang Chen , Fu Luo , Zhenkun Wang

Bayesian optimization (BO) is a powerful black-box optimization framework that looks to efficiently learn the global optimum of an unknown system by systematically trading-off between exploration and exploitation. However, the use of BO as…

Optimization and Control · Mathematics 2023-03-28 Dinesh Krishnamoorthy , Joel A. Paulson

Bayesian Optimization (BO) is widely used for optimizing expensive black-box functions, particularly in hyperparameter tuning. However, standard BO assumes access to precise objective values, which may be unavailable, noisy, or unreliable…

Machine Learning · Statistics 2025-10-07 Tunde Fahd Egunjobi

Bayesian optimization (BO) is an effective technique for black-box optimization. However, its applicability is typically limited to moderate-budget problems due to the cubic complexity of fitting the Gaussian process (GP) surrogate model.…

Machine Learning · Statistics 2025-10-13 Qiyu Wei , Haowei Wang , Zirui Cao , Songhao Wang , Richard Allmendinger , Mauricio A Álvarez

Bayesian optimisation (BO) is a powerful framework for global optimisation of costly functions, using predictions from Gaussian process models (GPs). In this work, we apply BO to functions that exhibit invariance to a known group of…

Machine Learning · Computer Science 2024-10-23 Theodore Brown , Alexandru Cioba , Ilija Bogunovic

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

Machine Learning · Computer Science 2021-09-02 Eero Siivola , Akash Kumar Dhaka , Michael Riis Andersen , Javier Gonzalez , Pablo Garcia Moreno , Aki Vehtari

Bayesian optimization (BO) is widely used to optimize expensive-to-evaluate black-box functions.BO first builds a surrogate model to represent the objective function and assesses its uncertainty. It then decides where to sample by…

Machine Learning · Computer Science 2024-01-25 Jiayu Zhao , Renyu Yang , Shenghao Qiu , Zheng Wang

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

Artificial Intelligence · Computer Science 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

Safe Bayesian optimization (BO) with Gaussian processes is an effective tool for tuning control policies in safety-critical real-world systems, specifically due to its sample efficiency and safety guarantees. However, most safe BO…

Optimization and Control · Mathematics 2025-12-15 Abdullah Tokmak , Thomas B. Schön , Dominik Baumann

Learning robot controllers by minimizing a black-box objective cost using Bayesian optimization (BO) can be time-consuming and challenging. It is very often the case that some roll-outs result in failure behaviors, causing premature…

Machine Learning · Computer Science 2020-11-11 Alonso Marco , Dominik Baumann , Philipp Hennig , Sebastian Trimpe

Meta-Bayesian optimisation (meta-BO) aims to improve the sample efficiency of Bayesian optimisation by leveraging data from related tasks. While previous methods successfully meta-learn either a surrogate model or an acquisition function…

Machine Learning · Computer Science 2023-12-25 Alexandre Maraval , Matthieu Zimmer , Antoine Grosnit , Haitham Bou Ammar

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive…

Machine Learning · Computer Science 2023-11-23 Ryota Ozaki , Kazuki Ishikawa , Youhei Kanzaki , Shinya Suzuki , Shion Takeno , Ichiro Takeuchi , Masayuki Karasuyama

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

Machine Learning · Statistics 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

Computational models in fields such as computational neuroscience are often evaluated via stochastic simulation or numerical approximation. Fitting these models implies a difficult optimization problem over complex, possibly noisy parameter…

Machine Learning · Statistics 2017-11-03 Luigi Acerbi , Wei Ji Ma

This paper considers Bayesian optimization (BO) for problems with known outer problem structure. In contrast to the classic BO setting, where the objective function itself is unknown and needs to be iteratively estimated from noisy…

Optimization and Control · Mathematics 2025-03-19 Katrin Baumgärtner , Moritz Diehl

Bayesian optimization is an effective method for solving expensive black-box optimization problems. Most existing methods use Gaussian processes (GP) as the surrogate model for approximating the black-box objective function, it is…

Machine Learning · Computer Science 2025-12-23 Wei Peng , Jianchen Hu , Kang Liu , Qiaozhu Zhai