English
Related papers

Related papers: Bayesian Optimization with Informative Covariance

200 papers

Bayesian Optimization aims at optimizing an unknown non-convex/concave function that is costly to evaluate. We are interested in application scenarios where concurrent function evaluations are possible. Under such a setting, BO could choose…

Artificial Intelligence · Computer Science 2012-05-02 Javad Azimi , Ali Jalali , Xiaoli Fern

The notion of expense in Bayesian optimisation generally refers to the uniformly expensive cost of function evaluations over the whole search space. However, in some scenarios, the cost of evaluation for black-box objective functions is…

Machine Learning · Computer Science 2019-09-10 Majid Abdolshah , Alistair Shilton , Santu Rana , Sunil Gupta , Svetha Venkatesh

Boosting methods are widely used in statistical learning to deal with high-dimensional data due to their variable selection feature. However, those methods lack straightforward ways to construct estimators for the precision of the…

Methodology · Statistics 2021-06-10 Boyao Zhang , Colin Griesbach , Cora Kim , Nadia Müller-Voggel , Elisabeth Bergherr

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

Machine Learning · Computer Science 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

Line search is a fundamental part of iterative optimization methods for unconstrained and bound-constrained optimization problems to determine suitable step lengths that provide sufficient improvement in each iteration. Traditional line…

Optimization and Control · Mathematics 2025-07-22 Robin Labryga , Tomislav Prusina , Sören Laue

Bayesian optimization (BO) is an efficient method to optimize expensive black-box functions. It has been generalized to scenarios where objective function evaluations return stochastic binary feedback, such as success/failure in a given…

Machine Learning · Statistics 2021-11-08 Tristan Fauvel , Matthew Chalk

Most real optimization problems are defined over a mixed search space where the variables are both discrete and continuous. In engineering applications, the objective function is typically calculated with a numerically costly black-box…

Optimization and Control · Mathematics 2022-05-04 Jhouben Cuesta-Ramirez , Rodolphe Le Riche , Olivier Roustant , Guillaume Perrin , Cedric Durantin , Alain Gliere

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

Machine Learning · Computer Science 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

We provide a method to solve optimization problem when objective function is a complex stochastic simulator of an urban transportation system. To reach this goal, a Bayesian optimization framework is introduced. We show how the choice of…

Computation · Statistics 2019-01-15 Laura Schultz , Vadim Sokolov

Bayesian optimization (BO) based on Gaussian process models is a powerful paradigm to optimize black-box functions that are expensive to evaluate. While several BO algorithms provably converge to the global optimum of the unknown function,…

Machine Learning · Statistics 2019-04-03 Felix Berkenkamp , Angela P. Schoellig , Andreas Krause

We propose an algorithm for a family of optimization problems where the objective can be decomposed as a sum of functions with monotonicity properties. The motivating problem is optimization of hyperparameters of machine learning…

Machine Learning · Computer Science 2018-02-20 Wenyi Wang , William J. Welch

Bayesian optimization (BO) is a typical approach to solve expensive optimization problems. In each iteration of BO, a Gaussian process(GP) model is trained using the previously evaluated solutions; then next candidate solutions for…

Neural and Evolutionary Computing · Computer Science 2022-06-23 Jixiang Chen , Fu Luo , Zhenkun Wang

Bayesian optimization is a sample-efficient approach to solving global optimization problems. Along with a surrogate model, this approach relies on theoretically motivated value heuristics (acquisition functions) to guide the search…

Machine Learning · Statistics 2017-12-04 James T. Wilson , Riccardo Moriconi , Frank Hutter , Marc Peter Deisenroth

A bilevel optimization problem consists of two optimization problems nested as an upper- and a lower-level problem, in which the optimality of the lower-level problem defines a constraint for the upper-level problem. This paper considers…

Machine Learning · Computer Science 2026-02-27 Takuya Kanayama , Yuki Ito , Tomoyuki Tamura , Masayuki Karasuyama

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

Machine Learning · Computer Science 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen

Sample efficiency is one of the key factors when applying policy search to real-world problems. In recent years, Bayesian Optimization (BO) has become prominent in the field of robotics due to its sample efficiency and little prior…

Robotics · Computer Science 2020-11-19 Lukas P. Fröhlich , Melanie N. Zeilinger , Edgar D. Klenske

In typical applications of Bayesian optimization, minimal assumptions are made about the objective function being optimized. This is true even when researchers have prior information about the shape of the function with respect to one or…

Machine Learning · Statistics 2016-12-30 Michael Jauch , Víctor Peña

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

Machine Learning · Computer Science 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

A solution that is only reliable under favourable conditions is hardly a safe solution. Min Max Optimization is an approach that returns optima that are robust against worst case conditions. We propose algorithms that perform Min Max…

Machine Learning · Computer Science 2021-07-30 Dorina Weichert , Alexander Kister

Inferring viscoelasticity parameters is a key challenge that often leads to non-unique solutions when fitting rheological data. In this context, we propose a machine learning approach that utilizes Bayesian optimization for parameter…

Soft Condensed Matter · Physics 2025-02-27 Isaac Y. Miranda-Valdez , Tero Mäkinen , Juha Koivisto , Mikko J. Alava