English
Related papers

Related papers: High-Dimensional Bayesian Optimization via Additiv…

200 papers

Because of its sample efficiency, Bayesian optimization (BO) has become a popular approach dealing with expensive black-box optimization problems, such as hyperparameter optimization (HPO). Recent empirical experiments showed that the loss…

Machine Learning · Computer Science 2021-11-11 Difan Deng , Marius Lindauer

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

Artificial Intelligence · Computer Science 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

Sample efficiency is one of the key factors when applying policy search to real-world problems. In recent years, Bayesian Optimization (BO) has become prominent in the field of robotics due to its sample efficiency and little prior…

Robotics · Computer Science 2020-11-19 Lukas P. Fröhlich , Melanie N. Zeilinger , Edgar D. Klenske

We present a general strategy for turning generative models into candidate solution samplers for batch Bayesian optimization (BO). The use of generative models for BO enables large batch scaling as generative sampling, optimization of…

Machine Learning · Statistics 2026-05-15 Rafael Oliveira , Daniel M. Steinberg , Edwin V. Bonilla

Bayesian optimisation (BO) is a well-known efficient algorithm for finding the global optimum of expensive, black-box functions. The current practical BO algorithms have regret bounds ranging from $\mathcal{O}(\frac{logN}{\sqrt{N}})$ to…

Machine Learning · Computer Science 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperparameter evaluations cost approximately the same. In…

Machine Learning · Computer Science 2020-11-25 Gauthier Guinet , Valerio Perrone , Cédric Archambeau

Bayesian Optimisation (BO) is a powerful tool for optimising expensive blackbox functions but its effectiveness diminishes in highdimensional spaces due to sparse data and poor surrogate model scalability While Variational Autoencoder (VAE)…

Machine Learning · Computer Science 2025-10-13 Junyu Xuan , Wenlong Chen , Yingzhen Li

Bayesian optimization is known to be difficult to scale to high dimensions, because the acquisition step requires solving a non-convex optimization problem in the same search space. In order to scale the method and keep its benefits, we…

Machine Learning · Computer Science 2019-05-29 Johannes Kirschner , Mojmír Mutný , Nicole Hiller , Rasmus Ischebeck , Andreas Krause

Bayesian optimization (BO) is a prominent approach to optimizing expensive-to-evaluate black-box functions. The massive computational capability of edge devices such as mobile phones, coupled with privacy concerns, has led to a surging…

Machine Learning · Computer Science 2020-10-23 Zhongxiang Dai , Kian Hsiang Low , Patrick Jaillet

Bayesian optimisation (BO) is a standard approach for sample-efficient global optimisation of expensive black-box functions, yet its scalability to high dimensions remains challenging. Here, we investigate nonlinear dimensionality reduction…

Optimization and Control · Mathematics 2025-10-20 Luo Long , Coralia Cartis , Paz Fink Shustin

Bayesian optimization (BO) is a powerful framework to optimize black-box expensive-to-evaluate functions via sequential interactions. In several important problems (e.g. drug discovery, circuit design, neural architecture search, etc.),…

Machine Learning · Computer Science 2025-02-25 Melis Ilayda Bal , Pier Giuseppe Sessa , Mojmir Mutny , Andreas Krause

Bayesian optimization (BO) has contributed greatly to improving model performance by suggesting promising hyperparameter configurations iteratively based on observations from multiple training trials. However, only partial knowledge (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 HyunJae Lee , Heon Song , Hyeonsoo Lee , Gi-hyeon Lee , Suyeong Park , Donggeun Yoo

Learning decompositions of expensive-to-evaluate black-box functions promises to scale Bayesian optimisation (BO) to high-dimensional problems. However, the success of these techniques depends on finding proper decompositions that…

Machine Learning · Computer Science 2023-05-30 Juliusz Ziomek , Haitham Bou-Ammar

Bayesian optimization (BO) is widely used to optimize expensive-to-evaluate black-box functions.BO first builds a surrogate model to represent the objective function and assesses its uncertainty. It then decides where to sample by…

Machine Learning · Computer Science 2024-01-25 Jiayu Zhao , Renyu Yang , Shenghao Qiu , Zheng Wang

Bayesian optimization (BO) is a flexible and powerful framework that is suitable for computationally expensive simulation-based applications and guarantees statistical convergence to the global optimum. While remaining as one of the most…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-16 Anh Tran

This paper presents a novel decentralized high-dimensional Bayesian optimization (DEC-HBO) algorithm that, in contrast to existing HBO algorithms, can exploit the interdependent effects of various input components on the output of the…

Machine Learning · Statistics 2018-01-25 Trong Nghia Hoang , Quang Minh Hoang , Ruofei Ouyang , Kian Hsiang Low

Bayesian optimization (BO) is a powerful paradigm for optimizing expensive black-box functions. Traditional BO methods typically rely on separate hand-crafted acquisition functions and surrogate models for the underlying function, and often…

Machine Learning · Computer Science 2025-07-10 Fengxue Zhang , Yuxin Chen

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

We propose an algorithm for Bayesian functional optimisation - that is, finding the function to optimise a process - guided by experimenter beliefs and intuitions regarding the expected characteristics (length-scale, smoothness, cyclicity…

Machine Learning · Computer Science 2020-09-09 Alistair Shilton , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian optimization has been successfully applied to optimize black-box functions where the number of evaluations is severely limited. However, in many real-world applications, it is hard or impossible to know in advance which designs are…