English
Related papers

Related papers: Multi-Fidelity Bayesian Optimization with Unreliab…

200 papers

In this study, we propose a novel multi-objective Bayesian optimization (MOBO) method to efficiently identify the Pareto front (PF) defined by risk measures for black-box functions under the presence of input uncertainty (IU). Existing BO…

Machine Learning · Statistics 2023-11-27 Yu Inatsu , Shion Takeno , Hiroyuki Hanada , Kazuki Iwata , Ichiro Takeuchi

Bayesian optimization is a popular black-box optimization method for parameter learning in control and robotics. It typically requires an objective function that reflects the user's optimization goal. However, in practical applications,…

Robotics · Computer Science 2026-04-03 Johanna Menn , David Stenger , Sebastian Trimpe

Bayesian Optimization (BO) is used to find the global optima of black box functions. In this work, we propose a practical BO method of function compositions where the form of the composition is known but the constituent functions are…

Machine Learning · Computer Science 2023-05-02 Kunal Jain , Prabuchandran K. J. , Tejas Bodas

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

Machine Learning · Statistics 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar

First Order Bayesian Optimization (FOBO) is a sample efficient sequential approach to find the global maxima of an expensive-to-evaluate black-box objective function by suitably querying for the function and its gradient evaluations. Such…

Machine Learning · Computer Science 2023-06-21 Utkarsh Prakash , Aryan Chollera , Kushagra Khatwani , Prabuchandran K. J. , Tejas Bodas

A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result to improve a wide…

Machine Learning · Computer Science 2021-09-02 Nadhir Hassen , Irina Rish

Given a Hyperparameter Optimization(HPO) problem, how to design an algorithm to find optimal configurations efficiently? Bayesian Optimization(BO) and the multi-fidelity BO methods employ surrogate models to sample configurations based on…

Machine Learning · Computer Science 2024-02-22 Yang Zhang , Haiyang Wu , Yuekui Yang

Bayesian optimisation (BO) is a powerful framework for global optimisation of costly functions, using predictions from Gaussian process models (GPs). In this work, we apply BO to functions that exhibit invariance to a known group of…

Machine Learning · Computer Science 2024-10-23 Theodore Brown , Alexandru Cioba , Ilija Bogunovic

Bayesian Optimization (BO) is a well-established method for addressing black-box optimization problems. In many real-world scenarios, optimization often involves multiple functions, emphasizing the importance of leveraging data and learned…

Machine Learning · Computer Science 2025-03-11 Khoa Nguyen , Viet Huynh , Binh Tran , Tri Pham , Tin Huynh , Thin Nguyen

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

Machine Learning · Computer Science 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular approach because of…

Machine Learning · Computer Science 2022-06-17 Samuel Daulton , David Eriksson , Maximilian Balandat , Eytan Bakshy

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

Machine Learning · Computer Science 2024-07-09 Pallavi Mitra , Felix Biessmann

Bayesian optimisation (BO) is a surrogate-based optimisation technique that efficiently solves expensive black-box functions with small evaluation budgets. Recent studies consider trust regions to improve the scalability of BO approaches…

Neural and Evolutionary Computing · Computer Science 2025-11-04 Kokila Kasuni Perera , Frank Neumann , Aneta Neumann

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

Optimization and Control · Mathematics 2021-10-01 Rodolphe Le Riche , Victor Picheny

Simulation-based falsification is a practical testing method to increase confidence that the system will meet safety requirements. Because full-fidelity simulations can be computationally demanding, we investigate the use of simulators with…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Zahra Shahrooei , Mykel J. Kochenderfer , Ali Baheri

Optimizing multiple, non-preferential objectives for mixed-variable, expensive black-box problems is important in many areas of engineering and science. The expensive, noisy, black-box nature of these problems makes them ideal candidates…

Machine Learning · Computer Science 2022-11-15 Haris Moazam Sheikh , Philip S. Marcus

Bayesian optimization (BO) is an efficient framework for optimizing expensive black-box functions. However, it is typically formulated as learning an end-to-end mapping from inputs to scalar objectives, thereby discarding the potentially…

Machine Learning · Computer Science 2026-05-12 Wenbin Wang , Colin N. Jones

How can we efficiently gather information to optimize an unknown function, when presented with multiple, mutually dependent information sources with different costs? For example, when optimizing a robotic system, intelligently trading off…

Machine Learning · Computer Science 2018-11-05 Jialin Song , Yuxin Chen , Yisong Yue

The goal of Multi-task Bayesian Optimization (MBO) is to minimize the number of queries required to accurately optimize a target black-box function, given access to offline evaluations of other auxiliary functions. When offline datasets are…

Machine Learning · Computer Science 2022-03-11 Kourosh Hakhamaneshi , Pieter Abbeel , Vladimir Stojanovic , Aditya Grover