English
Related papers

Related papers: Scalable neural network-based blackbox optimizatio…

200 papers

Bayesian Optimization (BO) is a class of surrogate-based, sample-efficient algorithms for optimizing black-box problems with small evaluation budgets. The BO pipeline itself is highly configurable with many different design choices…

Machine Learning · Computer Science 2023-07-03 Carolin Benjamins , Elena Raponi , Anja Jankovic , Carola Doerr , Marius Lindauer

Many real-world scientific and industrial applications require the optimization of expensive black-box functions. Bayesian Optimization (BO) provides an effective framework for such problems. However, traditional BO methods are prone to get…

Artificial Intelligence · Computer Science 2025-09-29 Zhuo Yang , Daolang Wang , Lingli Ge , Beilun Wang , Tianfan Fu , Yuqiang Li

Many challenges in science and engineering, such as drug discovery and communication network design, involve optimizing complex and expensive black-box functions across vast search spaces. Thus, it is essential to leverage existing data to…

Machine Learning · Computer Science 2024-12-04 Juncheng Dong , Zihao Wu , Hamid Jafarkhani , Ali Pezeshki , Vahid Tarokh

Bayesian optimization (BO) with Gaussian processes (GP) has become an indispensable algorithm for black box optimization problems. Not without a dash of irony, BO is often considered a black box itself, lacking ways to provide reasons as to…

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the…

Optimization and Control · Mathematics 2026-05-08 Sourav Das , Debjani Chakraborty , Pabitra Mitra

In robotics, deep learning (DL) methods are used more and more widely, but their general inability to provide reliable confidence estimates will ultimately lead to fragile and unreliable systems. This impedes the potential deployments of DL…

Robotics · Computer Science 2020-11-02 Matthias Humt , Jongseok Lee , Rudolph Triebel

Bayesian optimisation (BO) is a powerful framework for global optimisation of costly functions, using predictions from Gaussian process models (GPs). In this work, we apply BO to functions that exhibit invariance to a known group of…

Machine Learning · Computer Science 2024-10-23 Theodore Brown , Alexandru Cioba , Ilija Bogunovic

Bayesian Optimization (BO) has been recognized for its effectiveness in optimizing expensive and complex objective functions. Recent advancements in Latent Bayesian Optimization (LBO) have shown promise by integrating generative models such…

Machine Learning · Computer Science 2025-04-22 Seunghun Lee , Jinyoung Park , Jaewon Chu , Minseo Yoon , Hyunwoo J. Kim

Bayesian optimization (BO) has become a popular strategy for global optimization of expensive real-world functions. Contrary to a common expectation that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

Machine Learning · Computer Science 2024-08-06 Zi Wang , George E. Dahl , Kevin Swersky , Chansoo Lee , Zachary Nado , Justin Gilmer , Jasper Snoek , Zoubin Ghahramani

Safe Bayesian optimization (BO) with Gaussian processes is an effective tool for tuning control policies in safety-critical real-world systems, specifically due to its sample efficiency and safety guarantees. However, most safe BO…

Optimization and Control · Mathematics 2025-12-15 Abdullah Tokmak , Thomas B. Schön , Dominik Baumann

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

Optimization and Control · Mathematics 2021-10-01 Rodolphe Le Riche , Victor Picheny

Bayesian optimisation (BO) is a surrogate-based optimisation technique that efficiently solves expensive black-box functions with small evaluation budgets. Recent studies consider trust regions to improve the scalability of BO approaches…

Neural and Evolutionary Computing · Computer Science 2025-11-04 Kokila Kasuni Perera , Frank Neumann , Aneta Neumann

Bayesian optimization (BO) is an attractive machine learning framework for performing sample-efficient global optimization of black-box functions. The optimization process is guided by an acquisition function that selects points to acquire…

Machine Learning · Computer Science 2024-10-14 Felix Teufel , Carsten Stahlhut , Jesper Ferkinghoff-Borg

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, multitask Bayesian…

Machine Learning · Statistics 2019-06-24 Yao Zhang , James Jordon , Ahmed M. Alaa , Mihaela van der Schaar

Molecular property optimization (MPO) problems are inherently challenging since they are formulated over discrete, unstructured spaces and the labeling process involves expensive simulations or experiments, which fundamentally limits the…

Biomolecules · Quantitative Biology 2024-01-04 Farshud Sorourifar , Thomas Banker , Joel A. Paulson

Bayesian Optimization (BO) has shown significant success in tackling expensive low-dimensional black-box optimization problems. Many optimization problems of interest are high-dimensional, and scaling BO to such settings remains an…

Machine Learning · Statistics 2022-06-02 Eric Han , Ishank Arora , Jonathan Scarlett

Bayesian optimization (BO) has traditionally solved black-box problems where function evaluation is expensive and, therefore, observations are few. Recently, however, there has been growing interest in applying BO to problems where function…

Machine Learning · Computer Science 2026-05-06 Mehul Bafna , Siddhant anand Jadhav , David Sweet

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimization in these…

Machine Learning · Statistics 2020-06-05 Peter D. Tonner , Daniel V. Samarov , A. Gilad Kusne

Bayesian optimization (BO) offers an elegant approach for efficiently optimizing black-box functions. However, acquisition criteria demand their own challenging inner-optimization, which can induce significant overhead. Many practical BO…

Machine Learning · Statistics 2024-12-09 Nathan Wycoff , John W. Smith , Annie S. Booth , Robert B. Gramacy

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

Machine Learning · Computer Science 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner
‹ Prev 1 4 5 6 7 8 10 Next ›