English
Related papers

Related papers: Multi-Fidelity Cost-Aware Bayesian Optimization

200 papers

Many real-world optimisation problems such as hyperparameter tuning in machine learning or simulation-based optimisation can be formulated as expensive-to-evaluate black-box functions. A popular approach to tackle such problems is Bayesian…

Machine Learning · Computer Science 2021-05-28 Juan Ungredda , Juergen Branke

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

Machine Learning · Statistics 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

A vital stage in the mathematical modelling of real-world systems is to calibrate a model's parameters to observed data. Likelihood-free parameter inference methods, such as Approximate Bayesian Computation, build Monte Carlo samples of the…

Computation · Statistics 2021-12-23 Thomas P Prescott , Ruth E Baker

Solder joint reliability related to failures due to thermomechanical loading is a critically important yet physically complex engineering problem. As a result, simulated behavior is oftentimes computationally expensive. In an increasingly…

Machine Learning · Statistics 2025-07-29 Leo Guo , Adwait Inamdar , Willem D. van Driel , GuoQi Zhang

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

Machine Learning · Computer Science 2021-09-02 Eero Siivola , Akash Kumar Dhaka , Michael Riis Andersen , Javier Gonzalez , Pablo Garcia Moreno , Aki Vehtari

Bayesian Optimization (BO) is an effective method for optimizing expensive-to-evaluate black-box functions with a wide range of applications for example in robotics, system design and parameter optimization. However, scaling BO to problems…

Systems and Control · Electrical Eng. & Systems 2020-01-22 Lukas P. Fröhlich , Edgar D. Klenske , Christian G. Daniel , Melanie N. Zeilinger

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

Machine Learning · Statistics 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Parameter tuning for vehicle controllers remains a costly and time-intensive challenge in automotive development. Traditional approaches rely on extensive real-world testing, making the process inefficient. We propose a multi-fidelity…

Systems and Control · Electrical Eng. & Systems 2025-06-11 Yongpeng Zhao , Maik Pfefferkorn , Maximilian Templer , Rolf Findeisen

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such…

Machine Learning · Computer Science 2023-02-14 Tianyi Bai , Yang Li , Yu Shen , Xinyi Zhang , Wentao Zhang , Bin Cui

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box objective functions. However, the application of BO to areas such as recommendation systems often requires taking the interpretability and…

Machine Learning · Computer Science 2023-03-06 Sulin Liu , Qing Feng , David Eriksson , Benjamin Letham , Eytan Bakshy

Bayesian optimization (BO) methods are useful for optimizing functions that are expensive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

Machine Learning · Statistics 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen

Bayesian Optimisation (BO) refers to a suite of techniques for global optimisation of expensive black box functions, which use introspective Bayesian models of the function to efficiently search for the optimum. While BO has been applied…

Bayesian optimization (BO) is a powerful paradigm for optimizing expensive black-box functions. Traditional BO methods typically rely on separate hand-crafted acquisition functions and surrogate models for the underlying function, and often…

Machine Learning · Computer Science 2025-07-10 Fengxue Zhang , Yuxin Chen

Bayesian optimization (BO) is a model-based approach for gradient-free black-box function optimization. Typically, BO is powered by a Gaussian process (GP), whose algorithmic complexity is cubic in the number of evaluations. Hence, GP-based…

Machine Learning · Statistics 2017-12-11 Valerio Perrone , Rodolphe Jenatton , Matthias Seeger , Cedric Archambeau

Multi-fidelity machine learning methods address the accuracy-efficiency trade-off by integrating scarce, resource-intensive high-fidelity data with abundant but less accurate low-fidelity data. We propose a practical multi-fidelity strategy…

Machine Learning · Computer Science 2025-03-26 Jiaxiang Yi , Ji Cheng , Miguel A. Bessa

In Bayesian optimization (BO) for expensive black-box optimization tasks, acquisition function (AF) guides sequential sampling and plays a pivotal role for efficient convergence to better optima. Prevailing AFs usually rely on artificial…

Machine Learning · Computer Science 2022-10-04 Zijing Liu , Xiyao Qu , Xuejun Liu , Hongqiang Lyu

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

Machine Learning · Statistics 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

Bayesian optimization (BO) is an effective paradigm for the optimization of expensive-to-sample systems. Standard BO learns the performance of a system $f(x)$ by using a Gaussian Process (GP) model; this treats the system as a black-box and…

Machine Learning · Statistics 2025-01-03 Leonardo D. González , Victor M. Zavala
‹ Prev 1 4 5 6 7 8 10 Next ›