English
Related papers

Related papers: MBORE: Multi-objective Bayesian Optimisation by De…

200 papers

Bayesian optimization (BO) is a sample-efficient approach for tuning design parameters to optimize expensive-to-evaluate, black-box performance metrics. In many manufacturing processes, the design parameters are subject to random input…

Machine Learning · Computer Science 2022-06-06 Samuel Daulton , Sait Cakmak , Maximilian Balandat , Michael A. Osborne , Enlu Zhou , Eytan Bakshy

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

Machine Learning · Statistics 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

Machine Learning · Computer Science 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

Bayesian optimization (BO) has been widely used in machine learning and simulation optimization. With the increase in computational resources and storage capacities in these fields, high-dimensional and large-scale problems are becoming…

Machine Learning · Computer Science 2022-06-02 Haowei Wang , Ercong Zhang , Szu Hui Ng , Giulia Pedrielli

Optimizing expensive to evaluate black-box functions over an input space consisting of all permutations of d objects is an important problem with many real-world applications. For example, placement of functional blocks in hardware design…

Machine Learning · Computer Science 2021-12-03 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa , Dae Hyun Kim

In this paper, we deal with batch Bayesian Optimization (Bayes-Opt) problems over a box and we propose a novel bi-objective optimization (BOO) acquisition strategy to sample points where to evaluate the objective function. The BOO problem…

Optimization and Control · Mathematics 2025-05-27 Francesco Carciaghi , Simone Magistri , Pierluigi Mansueto , Fabio Schoen

Resided at the intersection of multi-fidelity optimization (MFO) and Bayesian optimization (BO), MF BO has found a niche in solving expensive engineering design optimization problems, thanks to its advantages in incorporating physical and…

Computational Engineering, Finance, and Science · Computer Science 2026-01-01 Bach Do , Ruda Zhang

Optimizing multiple, non-preferential objectives for mixed-variable, expensive black-box problems is important in many areas of engineering and science. The expensive, noisy, black-box nature of these problems makes them ideal candidates…

Machine Learning · Computer Science 2022-11-15 Haris Moazam Sheikh , Philip S. Marcus

Bayesian optimization (BO) methods often rely on the assumption that the objective function is well-behaved, but in practice, this is seldom true for real-world objectives even if noise-free observations can be collected. Common approaches,…

Machine Learning · Statistics 2020-09-10 Erik Bodin , Markus Kaiser , Ieva Kazlauskaite , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

Bayesian optimization (BO) is well known to be sample-efficient for solving black-box problems. However, the BO algorithms can sometimes get stuck in suboptimal solutions even with plenty of samples. Intrinsically, such suboptimal problem…

Machine Learning · Computer Science 2025-01-24 Zhendong Guo , Yew-Soon Ong , Tiantian He , Haitao Liu

Macro placement is the problem of placing memory blocks on a chip canvas. It can be formulated as a combinatorial optimization problem over sequence pairs, a representation which describes the relative positions of macros. Solving this…

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the…

Optimization and Control · Mathematics 2026-05-08 Sourav Das , Debjani Chakraborty , Pabitra Mitra

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

Machine Learning · Statistics 2018-08-22 Umberto Noè , Dirk Husmeier

BayesianOptimization(BO) is a sample-efficient black-box optimizer, and extensive methods have been proposed to build the absolute function response of the black-box function through a probabilistic surrogate model, including…

Machine Learning · Computer Science 2024-02-07 Xiaoxing Wang , Jiaxing Li , Chao Xue , Wei Liu , Weifeng Liu , Xiaokang Yang , Junchi Yan , Dacheng Tao

Bayesian optimization (BO) is a leading method for optimizing expensive black-box optimization and has been successfully applied across various scenarios. However, BO suffers from the curse of dimensionality, making it challenging to scale…

Machine Learning · Computer Science 2025-04-03 Vu Viet Hoang , Hung The Tran , Sunil Gupta , Vu Nguyen

Bayesian optimization (BO) is a sequential approach for optimizing black-box objective functions using zeroth-order noisy observations. In BO, Gaussian processes (GPs) are employed as probabilistic surrogate models to estimate the objective…

Machine Learning · Computer Science 2025-04-02 Dongwon Kim , Matteo Zecchin , Sangwoo Park , Joonhyuk Kang , Osvaldo Simeone

Bayesian optimization (BO) has emerged as a powerful tool for navigating complex search spaces, showcasing practical applications in the fields of science and engineering.However, since it typically relies on a surrogate model to…

Machine Learning · Computer Science 2024-06-19 Joseph Chakar

Bayesian Optimization (BO) methods are useful for optimizing functions that are expen- sive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

Machine Learning · Statistics 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato