English
Related papers

Related papers: A survey on high-dimensional Gaussian process mode…

200 papers

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

Bayesian optimization is a popular tool for data-efficient optimization of expensive objective functions. In real-life applications like engineering design, the designer often wants to take multiple objectives as well as input uncertainty…

Artificial Intelligence · Computer Science 2022-02-28 J. Qing , I. Couckuyt , T. Dhaene

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

Bayesian optimisation (BO) is a powerful framework for global optimisation of costly functions, using predictions from Gaussian process models (GPs). In this work, we apply BO to functions that exhibit invariance to a known group of…

Machine Learning · Computer Science 2024-10-23 Theodore Brown , Alexandru Cioba , Ilija Bogunovic

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

The increasing availability of structured but high dimensional data has opened new opportunities for optimization. One emerging and promising avenue is the exploration of unsupervised methods for projecting structured high dimensional data…

Machine Learning · Computer Science 2021-01-07 Eero Siivola , Javier Gonzalez , Andrei Paleyes , Aki Vehtari

Bayesian Optimization is an effective method for searching the global maxima of an objective function especially if the function is unknown. The process comprises of using a surrogate function and choosing an acquisition function followed…

Machine Learning · Computer Science 2021-11-10 Ashish Anil Pawar , Ujwal Warbhe

Bayesian optimization (BO) has gained attention as an efficient algorithm for black-box optimization of expensive-to-evaluate systems, where the BO algorithm iteratively queries the system and suggests new trials based on a probabilistic…

Machine Learning · Computer Science 2026-03-13 Eike Cramer , Luis Kutschat , Oliver Stollenwerk , Joel A. Paulson , Alexander Mitsos

Safe Bayesian optimization (BO) with Gaussian processes is an effective tool for tuning control policies in safety-critical real-world systems, specifically due to its sample efficiency and safety guarantees. However, most safe BO…

Optimization and Control · Mathematics 2025-12-15 Abdullah Tokmak , Thomas B. Schön , Dominik Baumann

Bayesian optimization (BO) is an efficient framework for optimizing expensive black-box functions. However, it is typically formulated as learning an end-to-end mapping from inputs to scalar objectives, thereby discarding the potentially…

Machine Learning · Computer Science 2026-05-12 Wenbin Wang , Colin N. Jones

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

Machine Learning · Statistics 2021-10-19 Tristan Fauvel , Matthew Chalk

Bayesian optimization is a sample-efficient approach to solving global optimization problems. Along with a surrogate model, this approach relies on theoretically motivated value heuristics (acquisition functions) to guide the search…

Machine Learning · Statistics 2017-12-04 James T. Wilson , Riccardo Moriconi , Frank Hutter , Marc Peter Deisenroth

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box functions. However, in settings with very few function evaluations, a successful application of BO may require transferring information from…

Machine Learning · Computer Science 2024-09-10 Aryan Deshwal , Sait Cakmak , Yuhou Xia , David Eriksson

While many advanced statistical methods for the design of experiments exist, it is still typical for physical experiments to be performed adaptively based on human intuition. As a consequence, experimental resources are wasted on…

Methodology · Statistics 2025-03-04 Anton van Beek

The optimization of atomic structures plays a pivotal role in understanding and designing materials with desired properties. However, conventional computational methods often struggle with the formidable task of navigating the vast…

Materials Science · Physics 2024-11-19 Peder Lyngby , Casper Larsen , Karsten Wedel Jacobsen

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

Machine Learning · Statistics 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton

This research delves into optimizing mechanism design, with an emphasis on the energy efficiency and the expansive design possibilities of reciprocating mechanisms. It investigates how to efficiently integrate Computer-Aided Design (CAD)…

Systems and Control · Electrical Eng. & Systems 2024-03-14 Abdelmajid Ben Yahya , Santiago Ramos Garces , Nick Van Oosterwyck , Annie Cuyt , Stijn Derammelaere

Bayesian optimization (BO) is a powerful and data-efficient method for iterative materials discovery and design, particularly valuable when prior knowledge is limited, underlying functional relationships are complex or unknown, and the cost…

Both experimental and computational methods for the exploration of structure, functionality, and properties of materials often necessitate the search across broad parameter spaces to discover optimal experimental conditions and regions of…

Computational Physics · Physics 2021-08-31 Maxim Ziatdinov , Ayana Ghosh , Sergei V. Kalinin

Challenges in multi-fidelity modeling relate to accuracy, uncertainty estimation and high-dimensionality. A novel additive structure is introduced in which the highest fidelity solution is written as a sum of the lowest fidelity solution…

Machine Learning · Computer Science 2021-04-09 Wei W. Xing , Akeel A. Shah , Peng Wang , Shandian Zhe Qian Fu , Robert. M. Kirby