English
Related papers

Related papers: Scalable3-BO: Big Data meets HPC - A scalable asyn…

200 papers

Bayesian optimization (BO ) is an effective method for optimizing expensive-to-evaluate black-box functions. While high-dimensional problems can be particularly challenging, due to the multitude of parameter choices and the potentially high…

Machine Learning · Computer Science 2025-04-09 Erik Hellsten , Carl Hvarfner , Leonard Papenmeier , Luigi Nardi

Given the increasing importance of machine learning (ML) in our lives, several algorithmic fairness techniques have been proposed to mitigate biases in the outcomes of the ML models. However, most of these techniques are specialized to…

Data-efficiency is crucial for autonomous robots to adapt to new tasks and environments. In this work we focus on robotics problems with a budget of only 10-20 trials. This is a very challenging setting even for data-efficient approaches…

Robotics · Computer Science 2019-07-11 Rika Antonova , Akshara Rai , Tianyu Li , Danica Kragic

Bayesian optimization (BO) methods are useful for optimizing functions that are expensive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

Machine Learning · Statistics 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperparameter evaluations cost approximately the same. In…

Machine Learning · Computer Science 2020-11-25 Gauthier Guinet , Valerio Perrone , Cédric Archambeau

Automatic controller tuning is attractive for robotics and mechatronic systems whose dynamics are difficult to model accurately, but direct black-box optimization can be unsafe because each query is executed on the physical plant. Existing…

Robotics · Computer Science 2026-05-15 Hongxuan Wang , Xiaocong Li , Lihao Zheng , Adrish Bhaumik , Prahlad Vadakkepat

Bayesian optimization (BO) has emerged as a powerful tool for navigating complex search spaces, showcasing practical applications in the fields of science and engineering.However, since it typically relies on a surrogate model to…

Machine Learning · Computer Science 2024-06-19 Joseph Chakar

Collaborative Optimization (CO) is a multidisciplinary design optimization (MDO) framework that decomposes large-scale engineering problems into parallel, independently solvable subsystems coordinated by a system-level optimizer. Its…

Optimization and Control · Mathematics 2026-05-08 Mohamed Ali Belhafnaoui , Youssef Diouane

In this paper, we address the problem of cost-sensitive multi-fidelity Bayesian Optimization (BO) for efficient hyperparameter optimization (HPO). Specifically, we assume a scenario where users want to early-stop the BO when the performance…

Machine Learning · Computer Science 2024-05-29 Dong Bok Lee , Aoxuan Silvia Zhang , Byungjoo Kim , Junhyeon Park , Juho Lee , Sung Ju Hwang , Hae Beom Lee

Bayesian optimization (BO) is an approach to globally optimizing black-box objective functions that are expensive to evaluate. BO-powered experimental design has found wide application in materials science, chemistry, experimental physics,…

Machine Learning · Computer Science 2023-10-10 Mimi Zhang , Andrew Parnell , Dermot Brabazon , Alessio Benavoli

Bayesian optimization (BO) is a powerful framework for optimizing expensive black-box objectives, yet extending it to graph-structured domains remains challenging due to the discrete and combinatorial nature of graphs. Existing approaches…

Machine Learning · Computer Science 2025-11-12 Shu Hong , Yongsheng Mei , Mahdi Imani , Tian Lan

Bayesian optimization (BO) is a powerful and data-efficient method for iterative materials discovery and design, particularly valuable when prior knowledge is limited, underlying functional relationships are complex or unknown, and the cost…

In this thesis, I explore the possibilities of conducting Bayesian optimization techniques in high dimensional domains. Although high dimensional domains can be defined to be between hundreds and thousands of dimensions, we will primarily…

Machine Learning · Computer Science 2020-10-09 David Yenicelik

Bayesian optimization (BO) is a widely used approach to hyperparameter optimization (HPO). However, most existing HPO methods only incorporate expert knowledge during initialization, limiting practitioners' ability to influence the…

Machine Learning · Computer Science 2026-02-04 Lukas Fehring , Marcel Wever , Maximilian Spliethöver , Leona Hennig , Henning Wachsmuth , Marius Lindauer

Bayesian Optimization, the application of Bayesian function approximation to finding optima of expensive functions, has exploded in popularity in recent years. In particular, much attention has been paid to improving its efficiency on…

Optimization and Control · Mathematics 2022-05-18 Mickael Binois , Nathan Wycoff

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

Machine Learning · Statistics 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton

Bayesian Optimization (BO) is a powerful tool for black-box optimization, but its application to high-dimensional permutation spaces is severely limited by the challenge of defining scalable representations. The current state-of-the-art BO…

Machine Learning · Computer Science 2025-09-26 Zikai Xie , Linjiang Chen

Bayesian optimization is an effective method for optimizing expensive-to-evaluate black-box functions. High-dimensional problems are particularly challenging as the surrogate model of the objective suffers from the curse of dimensionality,…

Machine Learning · Computer Science 2023-10-06 Erik Orm Hellsten , Carl Hvarfner , Leonard Papenmeier , Luigi Nardi

Many real-world scientific and industrial applications require the optimization of expensive black-box functions. Bayesian Optimization (BO) provides an effective framework for such problems. However, traditional BO methods are prone to get…

Artificial Intelligence · Computer Science 2025-09-29 Zhuo Yang , Daolang Wang , Lingli Ge , Beilun Wang , Tianfan Fu , Yuqiang Li

Bayesian optimization (BO) has become popular for sequential optimization of black-box functions. When BO is used to optimize a target function, we often have access to previous evaluations of potentially related functions. This begs the…

Machine Learning · Computer Science 2022-06-17 Zhongxiang Dai , Yizhou Chen , Haibin Yu , Bryan Kian Hsiang Low , Patrick Jaillet