English
Related papers

Related papers: Cost-Sensitive Multi-Fidelity Bayesian Optimizatio…

200 papers

Bayesian optimization (BO), while proved highly effective for many black-box function optimization tasks, requires practitioners to carefully select priors that well model their functions of interest. Rather than specifying by hand,…

Machine Learning · Computer Science 2023-09-29 Zhou Fan , Xinran Han , Zi Wang

Bandit methods for black-box optimisation, such as Bayesian optimisation, are used in a variety of applications including hyper-parameter tuning and experiment design. Recently, \emph{multi-fidelity} methods have garnered considerable…

Machine Learning · Statistics 2017-03-21 Kirthevasan Kandasamy , Gautam Dasarathy , Jeff Schneider , Barnabas Poczos

Reinforcement Learning's high sensitivity to hyperparameters is a source of instability and inefficiency, creating significant challenges for practitioners. Hyperparameter Optimization (HPO) algorithms have been developed to address this…

Machine Learning · Computer Science 2025-07-18 Waël Doulazmi , Auguste Lehuger , Marin Toromanoff , Valentin Charraut , Thibault Buhet , Fabien Moutarde

Bayesian Optimization (BO) is an effective method for optimizing expensive-to-evaluate black-box functions with a wide range of applications for example in robotics, system design and parameter optimization. However, scaling BO to problems…

Systems and Control · Electrical Eng. & Systems 2020-01-22 Lukas P. Fröhlich , Edgar D. Klenske , Christian G. Daniel , Melanie N. Zeilinger

Transfer learning for Bayesian optimisation has generally assumed a strong similarity between optimisation tasks, with at least a subset having similar optimal inputs. This assumption can reduce computational costs, but it is violated in a…

Machine Learning · Computer Science 2024-04-22 Sigrid Passano Hellan , Christopher G. Lucas , Nigel H. Goddard

Large-scale optimization problems are ubiquitous in the physical sciences; yet, high-fidelity models can often be complex and computationally prohibitive for optimization. A practical alternative is to use a low-fidelity model to facilitate…

Numerical Analysis · Mathematics 2026-04-03 Madhusudan Madhavan , Joseph Hart , Bart van Bloemen Waanders

Bayesian optimization (BO) is widely used to accelerate physics and materials research, where objective function evaluations are computationally or experimentally expensive. While many BO frameworks focus on algorithmic efficiency,…

Computational Physics · Physics 2026-03-03 Yuichi Motoyama , Kazuyoshi Yoshimi , Tatsumi Aoyama , Kei Terayama , Koji Tsuda , Ryo Tamura

Automated machine learning aims to automate the whole process of machine learning, including model configuration. In this paper, we focus on automated hyperparameter optimization (HPO) based on sequential model-based optimization (SMBO).…

Machine Learning · Computer Science 2019-09-11 Ying Wei , Peilin Zhao , Huaxiu Yao , Junzhou Huang

Bayesian optimization (BO) is a popular black-box function optimization method, which makes sequential decisions based on a Bayesian model, typically a Gaussian process (GP), of the function. To ensure the quality of the model, transfer…

Machine Learning · Computer Science 2024-02-15 Zhou Fan , Xinran Han , Zi Wang

Faced with problems of increasing complexity, recent research in Bayesian Optimisation (BO) has focused on adapting deep probabilistic models as flexible alternatives to Gaussian Processes (GPs). In a similar vein, this paper investigates…

Machine Learning · Computer Science 2022-05-31 Alexandre Maraval , Matthieu Zimmer , Antoine Grosnit , Rasul Tutunov , Jun Wang , Haitham Bou Ammar

Tuning parameters in model predictive control (MPC) presents significant challenges, particularly when there is a notable discrepancy between the controller's predictions and the actual behavior of the closed-loop plant. This mismatch may…

Systems and Control · Electrical Eng. & Systems 2024-10-11 Sebastian Hirt , Andreas Höhl , Joachim Schaeffer , Johannes Pohlodek , Richard D. Braatz , Rolf Findeisen

Preferential Bayesian Optimization (PBO) is a sample-efficient method to learn latent user utilities from preferential feedback over a pair of designs. It relies on a statistical surrogate model for the latent function, usually a Gaussian…

Machine Learning · Statistics 2025-03-04 Xinyu Zhang , Daolang Huang , Samuel Kaski , Julien Martinelli

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

Bayesian optimization (BO) is a prominent approach to optimizing expensive-to-evaluate black-box functions. The massive computational capability of edge devices such as mobile phones, coupled with privacy concerns, has led to a surging…

Machine Learning · Computer Science 2020-10-23 Zhongxiang Dai , Kian Hsiang Low , Patrick Jaillet

Reinforcement learning (RL) has achieved promising results on most robotic control tasks. Safety of learning-based controllers is an essential notion of ensuring the effectiveness of the controllers. Current methods adopt whole consistency…

Robotics · Computer Science 2023-07-31 Haotian Xu , Shengjie Wang , Zhaolei Wang , Yunzhe Zhang , Qing Zhuo , Yang Gao , Tao Zhang

This paper considers Bayesian optimization (BO) for problems with known outer problem structure. In contrast to the classic BO setting, where the objective function itself is unknown and needs to be iteratively estimated from noisy…

Optimization and Control · Mathematics 2025-03-19 Katrin Baumgärtner , Moritz Diehl

We propose MUMBO, the first high-performing yet computationally efficient acquisition function for multi-task Bayesian optimization. Here, the challenge is to perform efficient optimization by evaluating low-cost functions somehow related…

Machine Learning · Computer Science 2020-06-23 Henry B. Moss , David S. Leslie , Paul Rayson

Hyperparameter optimization (HPO) is a vital step in improving performance in deep learning (DL). Practitioners are often faced with the trade-off between multiple criteria, such as accuracy and latency. Given the high computational needs…

Machine Learning · Computer Science 2023-06-01 Shuhei Watanabe , Noor Awad , Masaki Onishi , Frank Hutter

Testing controllers in safety-critical systems is vital for ensuring their safety and preventing failures. In this paper, we address the falsification problem within learning-based closed-loop control systems through simulation. This…

Systems and Control · Electrical Eng. & Systems 2024-09-13 Zahra Shahrooei , Mykel J. Kochenderfer , Ali Baheri

Bayesian Optimization (BO) is a surrogate-assisted global optimization technique that has been successfully applied in various fields, e.g., automated machine learning and design optimization. Built upon a so-called infill-criterion and…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Elena Raponi , Hao Wang , Mariusz Bujny , Simonetta Boria , Carola Doerr