English
Related papers

Related papers: Batch Bayesian optimisation via density-ratio esti…

200 papers

Bayesian optimization (BO) has become a popular strategy for global optimization of expensive real-world functions. Contrary to a common expectation that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

Machine Learning · Computer Science 2024-08-06 Zi Wang , George E. Dahl , Kevin Swersky , Chansoo Lee , Zachary Nado , Justin Gilmer , Jasper Snoek , Zoubin Ghahramani

Solving optimal design problems through crowdsourcing faces a dilemma: On one hand, human beings have been shown to be more effective than algorithms at searching for good solutions of certain real-world problems with high-dimensional or…

Machine Learning · Computer Science 2017-04-28 Thurston Sexton , Max Yi Ren

Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well-performing machine learning models, tuning BO's own…

Machine Learning · Computer Science 2019-08-20 Marius Lindauer , Matthias Feurer , Katharina Eggensperger , André Biedenkapp , Frank Hutter

Bayesian Optimization aims at optimizing an unknown non-convex/concave function that is costly to evaluate. We are interested in application scenarios where concurrent function evaluations are possible. Under such a setting, BO could choose…

Artificial Intelligence · Computer Science 2012-05-02 Javad Azimi , Ali Jalali , Xiaoli Fern

Approximate Bayesian computation (ABC) is a method for Bayesian inference when the likelihood is unavailable but simulating from the model is possible. However, many ABC algorithms require a large number of simulations, which can be costly.…

Machine Learning · Statistics 2018-10-15 Marko Järvenpää , Michael U. Gutmann , Arijus Pleska , Aki Vehtari , Pekka Marttinen

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely a black-box. The data may have some known structure (e.g. symmetries)…

Machine Learning · Computer Science 2022-12-08 Samuel Kim , Peter Y. Lu , Charlotte Loh , Jamie Smith , Jasper Snoek , Marin Soljačić

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

Machine Learning · Computer Science 2024-07-09 Pallavi Mitra , Felix Biessmann

Bayesian optimization has attracted huge attention from diverse research areas in science and engineering, since it is capable of efficiently finding a global optimum of an expensive-to-evaluate black-box function. In general, a…

Machine Learning · Computer Science 2025-07-29 Jungtaek Kim

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

Machine Learning · Computer Science 2021-09-02 Eero Siivola , Akash Kumar Dhaka , Michael Riis Andersen , Javier Gonzalez , Pablo Garcia Moreno , Aki Vehtari

This paper proposes the incremental Bayesian optimization algorithm (iBOA), which modifies standard BOA by removing the population of solutions and using incremental updates of the Bayesian network. iBOA is shown to be able to learn and…

Neural and Evolutionary Computing · Computer Science 2008-07-30 Martin Pelikan , Kumara Sastry , David E. Goldberg

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

Many black-box optimization tasks arising in high-stakes applications require risk-averse decisions. The standard Bayesian optimization (BO) paradigm, however, optimizes the expected value only. We generalize BO to trade mean and…

Machine Learning · Computer Science 2021-11-10 Anastasiia Makarova , Ilnura Usmanova , Ilija Bogunovic , Andreas Krause

Bayesian optimization (BO) is a model-based approach for gradient-free black-box function optimization. Typically, BO is powered by a Gaussian process (GP), whose algorithmic complexity is cubic in the number of evaluations. Hence, GP-based…

Machine Learning · Statistics 2017-12-11 Valerio Perrone , Rodolphe Jenatton , Matthias Seeger , Cedric Archambeau

Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common framework to tackle…

Machine Learning · Computer Science 2024-12-24 Quoc-Anh Hoang Nguyen , The Hung Tran

We propose a novel Bayesian optimization (BO) procedure aimed at identifying the ``profile optima'' of a deterministic black-box computer simulation that has a single control parameter and multiple nuisance parameters. The profile optima…

Methodology · Statistics 2025-12-30 Courtney Kyger , James Fernandez , John A. Grunenwald , James Braun , Annie Booth

Bayesian Optimization (BO) is a common solution to search optimal hyperparameters based on sample observations of a machine learning model. Existing BO algorithms could converge slowly even collapse when the potential observation noise…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Lei Cui , Yangguang Li , Xin Lu , Dong An , Fenggang Liu

Bayesian Optimization (BO) is a data-efficient method for global black-box optimization of an expensive-to-evaluate fitness function. BO typically assumes that computation cost of BO is cheap, but experiments are time consuming or costly.…

Machine Learning · Statistics 2016-08-18 Doniyor Ulmasov , Caroline Baroukh , Benoit Chachuat , Marc Peter Deisenroth , Ruth Misener

The expected improvement (EI) is one of the most popular acquisition functions for Bayesian optimization (BO) and has demonstrated good empirical performances in many applications for the minimization of simple regret. However, under the…

Machine Learning · Computer Science 2024-10-04 Shouri Hu , Haowei Wang , Zhongxiang Dai , Bryan Kian Hsiang Low , Szu Hui Ng

Bayesian optimization (BO) is a sample-efficient global optimization algorithm for black-box functions which are expensive to evaluate. Existing literature on model based optimization in conditional parameter spaces are usually built on…

Machine Learning · Statistics 2020-10-08 Xingchen Ma , Matthew B. Blaschko

Bayesian optimization is a sample-efficient method for finding a global optimum of an expensive-to-evaluate black-box function. A global solution is found by accumulating a pair of query point and its function value, repeating these two…

Machine Learning · Statistics 2020-06-17 Jungtaek Kim , Seungjin Choi