English
Related papers

Related papers: Bayesian Optimization with High-Dimensional Output…

200 papers

Bayesian optimization is a powerful paradigm to optimize black-box functions based on scarce and noisy data. Its data efficiency can be further improved by transfer learning from related tasks. While recent transfer models meta-learn a…

Bayesian optimisation is a sample efficient method for finding a global optimum of expensive black-box objective functions. Historic datasets from related problems can be exploited to help improve performance of Bayesian optimisation by…

Machine Learning · Computer Science 2026-01-23 Natasha Trinkle , Huong Ha , Jeffrey Chan

Controller tuning and parameter optimization are crucial in system design to improve closed-loop system performance. Bayesian optimization has been established as an efficient model-free controller tuning and adaptation method. However,…

Systems and Control · Electrical Eng. & Systems 2024-04-24 Christopher König , Raamadaas Krishnadas , Efe C. Balta , Alisa Rupenyan

Bayesian optimization is a highly efficient approach to optimizing objective functions which are expensive to query. These objectives are typically represented by Gaussian process (GP) surrogate models which are easy to optimize and support…

Machine Learning · Computer Science 2024-05-09 Yucen Lily Li , Tim G. J. Rudner , Andrew Gordon Wilson

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Gaussian Process based Bayesian Optimization is a well-known sample efficient sequential strategy for globally optimizing black-box, expensive, and multi-extremal functions. The role of the Gaussian Process is to provide a probabilistic…

Machine Learning · Computer Science 2023-05-16 Antonio Candelieri

Physical simulation-based optimization is a common task in science and engineering. Many such simulations produce image- or tensor-based outputs where the desired objective is a function of those outputs, and optimization is performed over…

Machine Learning · Computer Science 2021-12-01 Wesley Maddox , Qing Feng , Max Balandat

The increasing availability of graph-structured data motivates the task of optimising over functions defined on the node set of graphs. Traditional graph search algorithms can be applied in this case, but they may be sample-inefficient and…

Machine Learning · Computer Science 2023-10-31 Xingchen Wan , Pierre Osselin , Henry Kenlay , Binxin Ru , Michael A. Osborne , Xiaowen Dong

Optimizing discrete black-box functions is key in several domains, e.g. protein engineering and drug design. Due to the lack of gradient information and the need for sample efficiency, Bayesian optimization is an ideal candidate for these…

Bayesian optimization has shown to be a fundamental global optimization algorithm in many applications: ranging from automatic machine learning, robotics, reinforcement learning, experimental design, simulations, etc. The most popular and…

Machine Learning · Computer Science 2015-06-09 Ruben Martinez-Cantin

Bayesian optimization is a sequential decision making framework for optimizing expensive-to-evaluate black-box functions. Computing a full lookahead policy amounts to solving a highly intractable stochastic dynamic program. Myopic…

Machine Learning · Computer Science 2020-06-30 Shali Jiang , Daniel R. Jiang , Maximilian Balandat , Brian Karrer , Jacob R. Gardner , Roman Garnett

A solution that is only reliable under favourable conditions is hardly a safe solution. Min Max Optimization is an approach that returns optima that are robust against worst case conditions. We propose algorithms that perform Min Max…

Machine Learning · Computer Science 2021-07-30 Dorina Weichert , Alexander Kister

We describe a method for Bayesian optimization by which one may incorporate data from multiple systems whose quantitative interrelationships are unknown a priori. All general (nonreal-valued) features of the systems are associated with…

Machine Learning · Computer Science 2020-01-06 Steven Atkinson , Sayan Ghosh , Natarajan Chennimalai-Kumar , Genghis Khan , Liping Wang

Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and…

Machine Learning · Statistics 2020-01-22 Chao Qian , Hang Xiong , Ke Xue

Gaussian Process (GP) regression is a popular and sample-efficient approach for many engineering applications, where observations are expensive to acquire, and is also a central ingredient of Bayesian optimization (BO), a highly prevailing…

Machine Learning · Statistics 2025-06-06 Sébastien Da Veiga

Bayesian optimization has demonstrated impressive success in finding the optimum input x* and output f* = f(x*) = max f(x) of a black-box function f. In some applications, however, the optimum output f* is known in advance and the goal is…

Machine Learning · Statistics 2020-08-18 Vu Nguyen , Michael A. Osborne

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

Machine Learning · Computer Science 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Bayesian optimization (BO) is an attractive machine learning framework for performing sample-efficient global optimization of black-box functions. The optimization process is guided by an acquisition function that selects points to acquire…

Machine Learning · Computer Science 2024-10-14 Felix Teufel , Carsten Stahlhut , Jesper Ferkinghoff-Borg

Bayesian Optimization (BO) is an effective method for optimizing expensive-to-evaluate black-box functions with a wide range of applications for example in robotics, system design and parameter optimization. However, scaling BO to problems…

Systems and Control · Electrical Eng. & Systems 2020-01-22 Lukas P. Fröhlich , Edgar D. Klenske , Christian G. Daniel , Melanie N. Zeilinger

Classical evolutionary approaches for multiobjective optimization are quite accurate but incur a lot of queries to the objectives; this can be prohibitive when objectives are expensive oracles. A sample-efficient approach to solving…

Optimization and Control · Mathematics 2025-02-18 Ashwin Renganathan , Kade E. Carlson