English
Related papers

Related papers: Maximizing acquisition functions for Bayesian opti…

200 papers

Bayesian optimization is a powerful collection of methods for optimizing stochastic expensive black box functions. One key component of a Bayesian optimization algorithm is the acquisition function that determines which solution should be…

Machine Learning · Computer Science 2022-10-03 Juan Ungredda , Michael Pearce , Juergen Branke

We consider parallel global optimization of derivative-free expensive-to-evaluate functions, and propose an efficient method based on stochastic approximation for implementing a conceptual Bayesian optimization algorithm proposed by…

Machine Learning · Statistics 2019-05-07 Jialei Wang , Scott C. Clark , Eric Liu , Peter I. Frazier

Bayesian decision theory outlines a rigorous framework for making optimal decisions based on maximizing expected utility over a model posterior. However, practitioners often do not have access to the full posterior and resort to approximate…

Machine Learning · Statistics 2019-10-29 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

The popularity of Bayesian optimization methods for efficient exploration of parameter spaces has lead to a series of papers applying Gaussian processes as surrogates in the optimization of functions. However, most proposed approaches only…

Machine Learning · Statistics 2015-10-16 Javier González , Zhenwen Dai , Philipp Hennig , Neil D. Lawrence

Bayesian optimization is a technique for optimizing black-box target functions. At the core of Bayesian optimization is a surrogate model that predicts the output of the target function at previously unseen inputs to facilitate the…

Machine Learning · Computer Science 2022-03-04 Felix Jimenez , Matthias Katzfuss

Estimating posteriors and the associated model evidences, with desired accuracy and affordable computational cost, is a core issue of Bayesian model updating, and can be of great challenge given expensive-to-evaluate models and posteriors…

Computation · Statistics 2026-04-09 Jingwen Song , Pengfei Wei

Bayesian optimization is a class of global optimization techniques. In Bayesian optimization, the underlying objective function is modeled as a realization of a Gaussian process. Although the Gaussian process assumption implies a random…

Statistics Theory · Mathematics 2023-05-08 Rui Tuo , Wenjia Wang

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

Machine Learning · Statistics 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propose a new method that…

Machine Learning · Computer Science 2019-12-02 Dang Nguyen , Sunil Gupta , Santu Rana , Alistair Shilton , Svetha Venkatesh

Bayesian optimization has emerged as a prominent methodology for optimizing expensive black-box functions by leveraging Gaussian process surrogates, which focus on capturing the global characteristics of the objective function. However, in…

Machine Learning · Computer Science 2026-03-03 Qiyu Wei , Haowei Wang , Richard Allmendinger , Mauricio A. Álvarez

Numerical simulation of complex optical structures enables their optimization with respect to specific objectives. Often, optimization is done by multiple successive parameter scans, which are time consuming and computationally expensive.…

Computational Physics · Physics 2017-07-27 P. -I. Schneider , X. Garcia Santiago , C. Rockstuhl , S. Burger

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

Optimization and Control · Mathematics 2021-10-01 Rodolphe Le Riche , Victor Picheny

Bayesian Optimization, the application of Bayesian function approximation to finding optima of expensive functions, has exploded in popularity in recent years. In particular, much attention has been paid to improving its efficiency on…

Optimization and Control · Mathematics 2022-05-18 Mickael Binois , Nathan Wycoff

Complex processes in science and engineering are often formulated as multistage decision-making problems. In this paper, we consider a type of multistage decision-making process called a cascade process. A cascade process is a multistage…

Identification of optimal dose combinations in early phase dose-finding trials is challenging, due to the trade-off between precisely estimating the many parameters required to flexibly model the possibly non-monotonic dose-response…

Methodology · Statistics 2024-02-13 James Willard , Shirin Golchi , Erica E. M. Moodie , Bruno Boulanger , Bradley P. Carlin

One of the most interesting features of Bayesian optimization for direct policy search is that it can leverage priors (e.g., from simulation or from previous tasks) to accelerate learning on a robot. In this paper, we are interested in…

Robotics · Computer Science 2018-03-14 Rémi Pautrat , Konstantinos Chatzilygeroudis , Jean-Baptiste Mouret

We study the problem of causal discovery through targeted interventions. Starting from few observational measurements, we follow a Bayesian active learning approach to perform those experiments which, in expectation with respect to the…

Machine Learning · Statistics 2019-10-10 Julius von Kügelgen , Paul K Rubenstein , Bernhard Schölkopf , Adrian Weller

Bayesian optimization involves "inner optimization" over a new-data acquisition criterion which is non-convex/highly multi-modal, may be non-differentiable, or may otherwise thwart local numerical optimizers. In such cases it is common to…

Computation · Statistics 2022-05-23 Robert B. Gramacy , Annie Sauer , Nathan Wycoff

We propose an algorithm for Bayesian functional optimisation - that is, finding the function to optimise a process - guided by experimenter beliefs and intuitions regarding the expected characteristics (length-scale, smoothness, cyclicity…

Machine Learning · Computer Science 2020-09-09 Alistair Shilton , Sunil Gupta , Santu Rana , Svetha Venkatesh

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

Machine Learning · Computer Science 2021-09-02 Eero Siivola , Akash Kumar Dhaka , Michael Riis Andersen , Javier Gonzalez , Pablo Garcia Moreno , Aki Vehtari