English
Related papers

Related papers: Optimal Initialization of Batch Bayesian Optimizat…

200 papers

Bayesian optimization provides an effective method to optimize expensive-to-evaluate black box functions. It has been widely applied to problems in many fields, including notably in computer science, e.g. in machine learning to optimize…

Machine Learning · Computer Science 2025-11-18 Mike Diessner , Joseph O'Connor , Andrew Wynn , Sylvain Laizet , Yu Guan , Kevin Wilson , Richard D. Whalley

While sample efficiency is the main motive for use of Bayesian optimisation when black-box functions are expensive to evaluate, the standard approach based on type II maximum likelihood (ML-II) may fail and result in disappointing…

Machine Learning · Computer Science 2022-08-31 Yuji Saikai

Bayesian optimization (BO) has been widely used to optimize expensive and black-box functions across various domains. However, existing BO methods have not addressed tensor-output functions. To fill this gap, we propose a novel…

Machine Learning · Computer Science 2026-03-03 Jingru Huang , Haijie Xu , Jie Guo , Manrui Jiang , Chen Zhang

Bayesian optimization has become a popular method for high-throughput computing, like the design of computer experiments or hyperparameter tuning of expensive models, where sample efficiency is mandatory. In these applications, distributed…

Machine Learning · Computer Science 2019-07-08 Javier Garcia-Barcos , Ruben Martinez-Cantin

Bayesian Optimization (BO) with Gaussian Processes relies on optimizing an acquisition function to determine sampling. We investigate the advantages and disadvantages of using a deterministic global solver (MAiNGO) compared to conventional…

In a standard setting of Bayesian optimization (BO), the objective function evaluation is assumed to be highly expensive. Multi-fidelity Bayesian optimization (MFBO) accelerates BO by incorporating lower fidelity observations available with…

Bayesian Optimization (BO) is a technique for sample-efficient black-box optimization that employs probabilistic models to identify promising input locations for evaluation. When dealing with composite-structured functions, such as f=g o h,…

Machine Learning · Computer Science 2024-07-11 Natalie Maus , Zhiyuan Jerry Lin , Maximilian Balandat , Eytan Bakshy

We introduce a gradient-based approach for the problem of Bayesian optimal experimental design to learn causal models in a batch setting -- a critical component for causal discovery from finite data where interventions can be costly or…

Machine Learning · Computer Science 2023-06-05 Yashas Annadani , Panagiotis Tigas , Desi R. Ivanova , Andrew Jesson , Yarin Gal , Adam Foster , Stefan Bauer

The design of informatively rich input signals is essential for accurate system identification, yet classical Fisher-information-based methods are inherently local and often inadequate in the presence of significant model uncertainty and…

Statistics Theory · Mathematics 2025-12-15 Piotr Bania , Anna Wójcik

Bayesian optimization (BO) is a popular global optimization scheme for sample-efficient optimization in domains with expensive function evaluations. The existing BO techniques are capable of finding a single global optimum solution.…

Optimization and Control · Mathematics 2023-08-08 Yongsheng Mei , Tian Lan , Mahdi Imani , Suresh Subramaniam

The Bayesian paradigm offers principled tools for sequential decision-making under uncertainty, but its reliance on a probabilistic model for all parameters can hinder the incorporation of complex structural constraints. We introduce a…

Machine Learning · Computer Science 2025-10-09 Kaizheng Wang

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Optimization problems are crucial in artificial intelligence. Optimization algorithms are generally used to adjust the performance of artificial intelligence models to minimize the error of mapping inputs to outputs. Current evaluation…

Artificial Intelligence · Computer Science 2021-11-23 Zhicheng He

The development of novel instrumentation requires an iterative cycle with three stages: design, prototyping, and testing. Recent advancements in simulation and nanofabrication techniques have significantly accelerated the design and…

Instrumentation and Detectors · Physics 2026-01-21 J. Cuevas-Zepeda , C. Chavez , J. Estrada , J. Noonan , B. D. Nord , N. Saffold , M. Sofo-Haro , R. Spinola e Castro , S. Trivedi

This paper introduces a modular framework for Mixed-variable and Combinatorial Bayesian Optimization (MCBO) to address the lack of systematic benchmarking and standardized evaluation in the field. Current MCBO papers often introduce…

Machine Learning · Computer Science 2023-12-12 Kamil Dreczkowski , Antoine Grosnit , Haitham Bou Ammar

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box objective functions. However, the application of BO to areas such as recommendation systems often requires taking the interpretability and…

Machine Learning · Computer Science 2023-03-06 Sulin Liu , Qing Feng , David Eriksson , Benjamin Letham , Eytan Bakshy

Autonomous Experimentation Platforms (AEPs) are advanced manufacturing platforms that, under intelligent control, can sequentially search the material design space (MDS) and identify parameters with the desired properties. At the heart of…

Machine Learning · Computer Science 2023-02-28 Ahmed Shoyeb Raihan , Imtiaz Ahmed

This work introduces an automated testing approach that employs agents controlling game characters to detect potential bugs within a game level. Harnessing the power of Bayesian Optimization (BO) to execute sample-efficient search, the…

Artificial Intelligence · Computer Science 2025-08-19 Carlos Celemin

Recent efforts in smart manufacturing have enhanced aerospace fuselage assembly processes, particularly by innovating shape adjustment techniques to minimize dimensional gaps between assembled sections. Existing approaches have shown…

Machine Learning · Computer Science 2025-12-01 Jiayu Liu , Chong Liu , Trevor Rhone , Yinan Wang

Latent Bayesian optimization (LBO) approaches have successfully adopted Bayesian optimization over a continuous latent space by employing an encoder-decoder architecture to address the challenge of optimization in a high dimensional or…

Machine Learning · Computer Science 2024-11-11 Jaewon Chu , Jinyoung Park , Seunghun Lee , Hyunwoo J. Kim