English
Related papers

Related papers: A Quantile-based Approach for Hyperparameter Trans…

200 papers

Bayesian optimization (BO) is a popular method for computationally expensive black-box optimization. However, traditional BO methods need to solve new problems from scratch, leading to slow convergence. Recent studies try to extend BO to a…

Machine Learning · Computer Science 2024-12-11 Shukuan Wang , Ke Xue , Lei Song , Xiaobin Huang , Chao Qian

Bayesian Optimization (BO) is a common solution to search optimal hyperparameters based on sample observations of a machine learning model. Existing BO algorithms could converge slowly even collapse when the potential observation noise…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Lei Cui , Yangguang Li , Xin Lu , Dong An , Fenggang Liu

Bayesian optimization (BO) offers an elegant approach for efficiently optimizing black-box functions. However, acquisition criteria demand their own challenging inner-optimization, which can induce significant overhead. Many practical BO…

Machine Learning · Statistics 2024-12-09 Nathan Wycoff , John W. Smith , Annie S. Booth , Robert B. Gramacy

Experimental (design) optimization is a key driver in designing and discovering new products and processes. Bayesian Optimization (BO) is an effective tool for optimizing expensive and black-box experimental design processes. While Bayesian…

Machine Learning · Computer Science 2024-02-28 Arun Kumar A , Alistair Shilton , Sunil Gupta , Santu Rana , Stewart Greenhill , Svetha Venkatesh

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

Machine Learning · Computer Science 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

Bayesian optimization (BO) and its batch extensions are successful for optimizing expensive black-box functions. However, these traditional BO approaches are not yet ideal for optimizing less expensive functions when the computational cost…

Machine Learning · Computer Science 2018-11-06 Vu Nguyen , Sunil Gupta , Santu Rana , Cheng Li , Svetha Venkatesh

Bayesian optimisation (BO) is a well-known efficient algorithm for finding the global optimum of expensive, black-box functions. The current practical BO algorithms have regret bounds ranging from $\mathcal{O}(\frac{logN}{\sqrt{N}})$ to…

Machine Learning · Computer Science 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

Bayesian Optimisation (BO) refers to a class of methods for global optimisation of a function $f$ which is only accessible via point evaluations. It is typically used in settings where $f$ is expensive to evaluate. A common use case for BO…

Machine Learning · Computer Science 2019-03-19 Kirthevasan Kandasamy , Willie Neiswanger , Jeff Schneider , Barnabas Poczos , Eric Xing

This paper presents novel mixed-type Bayesian optimization (BO) algorithms to accelerate the optimization of a target objective function by exploiting correlated auxiliary information of binary type that can be more cheaply obtained, such…

Machine Learning · Statistics 2019-06-19 Yehong Zhang , Zhongxiang Dai , Kian Hsiang Low

This article develops a Bayesian optimization (BO) method which acts directly over raw strings, proposing the first uses of string kernels and genetic algorithms within BO loops. Recent applications of BO over strings have been hindered by…

Machine Learning · Computer Science 2020-10-05 Henry B. Moss , Daniel Beck , Javier Gonzalez , David S. Leslie , Paul Rayson

We address the problem of optimizing over functions defined on node subsets in a graph. The optimization of such functions is often a non-trivial task given their combinatorial, black-box and expensive-to-evaluate nature. Although various…

Machine Learning · Computer Science 2025-01-07 Huidong Liang , Xingchen Wan , Xiaowen Dong

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where…

Machine Learning · Computer Science 2026-02-12 Aashwin Mishra , Matt Seaberg , Ryan Roussel , Daniel Ratner , Apurva Mehta

Scaling Bayesian optimisation (BO) to high-dimensional search spaces is a active and open research problems particularly when no assumptions are made on function structure. The main reason is that at each iteration, BO requires to find…

Machine Learning · Statistics 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Svetha Venkatesh

The goal of Multi-task Bayesian Optimization (MBO) is to minimize the number of queries required to accurately optimize a target black-box function, given access to offline evaluations of other auxiliary functions. When offline datasets are…

Machine Learning · Computer Science 2022-03-11 Kourosh Hakhamaneshi , Pieter Abbeel , Vladimir Stojanovic , Aditya Grover

Bayesian optimization is a powerful method for optimizing black-box functions with limited function evaluations. Recent works have shown that optimization in a latent space through deep generative models such as variational autoencoders…

Machine Learning · Computer Science 2023-11-21 Seunghun Lee , Jaewon Chu , Sihyeon Kim , Juyeon Ko , Hyunwoo J. Kim

Optimization of high-dimensional black-box functions is an extremely challenging problem. While Bayesian optimization has emerged as a popular approach for optimizing black-box functions, its applicability has been limited to…

Machine Learning · Statistics 2018-08-06 Zi Wang , Chengtao Li , Stefanie Jegelka , Pushmeet Kohli

The optimization of high-dimensional black-box functions is a challenging problem. When a low-dimensional linear embedding structure can be assumed, existing Bayesian optimization (BO) methods often transform the original problem into…

Machine Learning · Statistics 2022-11-03 Shuhei A. Horiguchi , Tomoharu Iwata , Taku Tsuzuki , Yosuke Ozawa

Bayesian optimization (BO) is an efficient framework for optimizing expensive black-box functions. However, it is typically formulated as learning an end-to-end mapping from inputs to scalar objectives, thereby discarding the potentially…

Machine Learning · Computer Science 2026-05-12 Wenbin Wang , Colin N. Jones

Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing expensive black-box functions with multiple objectives. However, existing MOBO methods often struggle with coverage, scalability with respect to the…

Machine Learning · Computer Science 2026-04-20 Yaohong Yang , Sammie Katt , Samuel Kaski

We have developed a Bayesian optimization (BO) workflow that integrates intra-step noise optimization into automated experimental cycles. Traditional BO approaches in automated experiments focus on optimizing experimental trajectories but…