English
Related papers

Related papers: Curvature-aware Expected Free Energy as an Acquisi…

200 papers

We are often interested in identifying the feasible subset of a decision space under multiple constraints to permit effective design exploration. If determining feasibility required computationally expensive simulations, the cost of…

Machine Learning · Computer Science 2020-06-25 Alma Rahat , Michael Wood

The expected improvement (EI) is one of the most popular acquisition functions for Bayesian optimization (BO) and has demonstrated good empirical performances in many applications for the minimization of simple regret. However, under the…

Machine Learning · Computer Science 2024-10-04 Shouri Hu , Haowei Wang , Zhongxiang Dai , Bryan Kian Hsiang Low , Szu Hui Ng

Bayesian Optimization has become the reference method for the global optimization of black box, expensive and possibly noisy functions. Bayesian Op-timization learns a probabilistic model about the objective function, usually a Gaussian…

Machine Learning · Statistics 2020-03-10 Antonio Candelieri , Ilaria Giordani , Riccardo Perego , Francesco Archetti

Bayesian optimization is a sample-efficient method for finding a global optimum of an expensive-to-evaluate black-box function. A global solution is found by accumulating a pair of query point and its function value, repeating these two…

Machine Learning · Statistics 2020-06-17 Jungtaek Kim , Seungjin Choi

In order to improve the performance of Bayesian optimisation, we develop a modified Gaussian process upper confidence bound (GP-UCB) acquisition function. This is done by sampling the exploration-exploitation trade-off parameter from a…

Machine Learning · Computer Science 2020-06-09 Julian Berk , Sunil Gupta , Santu Rana , Svetha Venkatesh

Exact free energy minimization is a convex optimization problem that is usually approximated with stochastic sampling methods. Deterministic approximations have been less successful because many desirable properties have been difficult to…

Computational Physics · Physics 2016-03-17 Jonathan E. Moussa

Transferring knowledge across tasks to improve data-efficiency is one of the open key challenges in the field of global black-box optimization. Readily available algorithms are typically designed to be universal optimizers and, therefore,…

Bayesian optimization (BO) is a typical approach to solve expensive optimization problems. In each iteration of BO, a Gaussian process(GP) model is trained using the previously evaluated solutions; then next candidate solutions for…

Neural and Evolutionary Computing · Computer Science 2022-06-23 Jixiang Chen , Fu Luo , Zhenkun Wang

This paper investigates a new class of modifier-adaptation schemes to overcome plant-model mismatch in real-time optimization of uncertain processes. The main contribution lies in the integration of concepts from the areas of Bayesian…

Bayesian optimization is a powerful optimization tool for problems where native first-order derivatives are unavailable. Recently, constrained Bayesian optimization (CBO) has been applied to many engineering applications where constraints…

Optimization and Control · Mathematics 2024-03-21 J. Wang , C. G. Petra , J. L. Peterson

Bayesian Optimization (BO) is a principled framework for optimizing expensive black-box functions, with Expected Improvement (EI) among its most widely used acquisition functions. Despite its empirical success, EI is agnostic to first-order…

Machine Learning · Computer Science 2026-05-19 Joshua Hang Sai Ip , Georgios Makrygiorgos , Ali Mesbah

A solution that is only reliable under favourable conditions is hardly a safe solution. Min Max Optimization is an approach that returns optima that are robust against worst case conditions. We propose algorithms that perform Min Max…

Machine Learning · Computer Science 2021-07-30 Dorina Weichert , Alexander Kister

Expected Improvement (EI) is arguably the most widely used acquisition function in Bayesian optimization. However, it is often challenging to enhance the performance with EI due to its sensitivity to numerical precision. Previously, Hutter…

Machine Learning · Computer Science 2024-11-28 Shuhei Watanabe

Bayesian optimization is a sample-efficient approach to solving global optimization problems. Along with a surrogate model, this approach relies on theoretically motivated value heuristics (acquisition functions) to guide the search…

Machine Learning · Statistics 2017-12-04 James T. Wilson , Riccardo Moriconi , Frank Hutter , Marc Peter Deisenroth

We introduce a class of acquisition functions for sample selection that leads to faster convergence in applications related to Bayesian experimental design and uncertainty quantification. The approach follows the paradigm of active…

Machine Learning · Statistics 2021-04-12 Antoine Blanchard , Themistoklis Sapsis

We consider the problem of chance constrained optimization where it is sought to optimize a function and satisfy constraints, both of which are affected by uncertainties. The real world declinations of this problem are particularly…

Given a multivariate function taking deterministic and uncertain inputs, we consider the problem of estimating a quantile set: a set of deterministic inputs for which the probability that the output belongs to a specific region remains…

Applications · Statistics 2025-07-25 Romain Ait Abdelmalek-Lomenech , Julien Bect , Emmanuel Vazquez

We propose a novel Bayesian method to solve the maximization of a time-dependent expensive-to-evaluate stochastic oracle. We are interested in the decision that maximizes the oracle at a finite time horizon, given a limited budget of noisy…

Computation · Statistics 2021-05-21 S. Ashwin Renganathan , Jeffrey Larson , Stefan M. Wild

This paper introduces a probabilistic framework to estimate parameters of an acquisition function given observed human behavior that can be modeled as a collection of sample paths from a Bayesian optimization procedure. The methodology…

Human-Computer Interaction · Computer Science 2022-02-04 Nathan Sandholtz , Yohsuke Miyamoto , Luke Bornn , Maurice Smith

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a…

Systems and Control · Computer Science 2019-01-24 Matthias Neumann-Brosig , Alonso Marco , Dieter Schwarzmann , Sebastian Trimpe