English
Related papers

Related papers: Bayesian Optimization of Composite Functions

200 papers

We consider Bayesian algorithm execution (BAX), a framework for efficiently selecting evaluation points of an expensive function to infer a property of interest encoded as the output of a base algorithm. Since the base algorithm typically…

Machine Learning · Computer Science 2024-10-29 Chu Xin Cheng , Raul Astudillo , Thomas Desautels , Yisong Yue

Application domains of Bayesian optimization include optimizing black-box functions or very complex functions. The functions we are interested in describe complex real-world systems applied in industrial settings. Even though they do have…

Machine Learning · Computer Science 2021-06-14 Franz Brauße , Zurab Khasidashvili , Konstantin Korovin

The aim of black-box optimization is to optimize an objective function within the constraints of a given evaluation budget. In this problem, it is generally assumed that the computational cost for evaluating a point is large; thus, it is…

Machine Learning · Statistics 2019-12-03 Masahiro Nomura , Kenshi Abe

We consider the problem of chance constrained optimization where it is sought to optimize a function and satisfy constraints, both of which are affected by uncertainties. The real world declinations of this problem are particularly…

We deal with the efficient parallelization of Bayesian global optimization algorithms, and more specifically of those based on the expected improvement criterion and its variants. A closed form formula relying on multivariate Gaussian…

Machine Learning · Statistics 2016-09-12 Sébastien Marmin , Clément Chevalier , David Ginsbourger

Thompson sampling (TS) is a simple, effective stochastic policy in Bayesian decision making. It samples the posterior belief about the reward profile and optimizes the sample to obtain a candidate decision. In continuous optimization, the…

Machine Learning · Computer Science 2024-10-11 Taiwo A. Adebiyi , Bach Do , Ruda Zhang

Bayesian optimization has demonstrated impressive success in finding the optimum input x* and output f* = f(x*) = max f(x) of a black-box function f. In some applications, however, the optimum output f* is known in advance and the goal is…

Machine Learning · Statistics 2020-08-18 Vu Nguyen , Michael A. Osborne

Many real-world optimisation problems such as hyperparameter tuning in machine learning or simulation-based optimisation can be formulated as expensive-to-evaluate black-box functions. A popular approach to tackle such problems is Bayesian…

Machine Learning · Computer Science 2021-05-28 Juan Ungredda , Juergen Branke

This paper presents an algorithm for solving multiobjective optimization problems involving composite functions, where we minimize a quadratic model that approximates $F(x) - F(x^k)$ and that can be derivative-free. We establish theoretical…

Optimization and Control · Mathematics 2026-01-29 V. S. Amaral , P. B. Assunção , D. R. Souza

Bayesian optimization has been successfully applied throughout Chemical Engineering for the optimization of functions that are expensive-to-evaluate, or where gradients are not easily obtainable. However, domain experts often possess…

Human-Computer Interaction · Computer Science 2024-04-18 Tom Savage , Ehecatl Antonio del Rio Chanona

To optimize efficiently over discrete data and with only few available target observations is a challenge in Bayesian optimization. We propose a continuous relaxation of the objective function and show that inference and optimization can be…

This article revisits the problem of Bayesian shape-restricted inference in the light of a recently developed approximate Gaussian process that admits an equivalent formulation of the shape constraints in terms of the basis coefficients. We…

Methodology · Statistics 2019-02-14 Pallavi Ray , Debdeep Pati , Anirban Bhattacharya

Bayesian optimization is an effective method for optimizing expensive-to-evaluate black-box functions. High-dimensional problems are particularly challenging as the surrogate model of the objective suffers from the curse of dimensionality,…

Machine Learning · Computer Science 2023-10-06 Erik Orm Hellsten , Carl Hvarfner , Leonard Papenmeier , Luigi Nardi

Recently, there has been rising interest in Bayesian optimization -- the optimization of an unknown function with assumptions usually expressed by a Gaussian Process (GP) prior. We study an optimization strategy that directly uses an…

Machine Learning · Statistics 2018-08-14 Zi Wang , Bolei Zhou , Stefanie Jegelka

Building surrogate models is one common approach when we attempt to learn unknown black-box functions. Bayesian optimization provides a framework which allows us to build surrogate models based on sequential samples drawn from the function…

Machine Learning · Computer Science 2021-09-17 Hengrui Luo , James W. Demmel , Younghyun Cho , Xiaoye S. Li , Yang Liu

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still…

Machine Learning · Computer Science 2024-02-13 Yihang Shen , Carl Kingsford

The Gaussian process bandit is a problem in which we want to find a maximizer of a black-box function with the minimum number of function evaluations. If the black-box function varies with time, then time-varying Bayesian optimization is a…

The performance of acquisition functions for Bayesian optimisation to locate the global optimum of continuous functions is investigated in terms of the Pareto front between exploration and exploitation. We show that Expected Improvement…

Machine Learning · Computer Science 2021-04-29 George De Ath , Richard M. Everson , Alma A. M. Rahat , Jonathan E. Fieldsend

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg

Gaussian Process based Bayesian Optimization is a well-known sample efficient sequential strategy for globally optimizing black-box, expensive, and multi-extremal functions. The role of the Gaussian Process is to provide a probabilistic…

Machine Learning · Computer Science 2023-05-16 Antonio Candelieri