English
Related papers

Related papers: Bayesian Optimization of Hyperparameters from Nois…

200 papers

In Bayesian optimization, accounting for the importance of the output relative to the input is a crucial yet challenging exercise, as it can considerably improve the final result but often involves inaccurate and cumbersome entropy…

Machine Learning · Computer Science 2020-12-30 Antoine Blanchard , Themistoklis Sapsis

Bayesian optimization has emerged as a highly effective tool for the safe online optimization of systems, due to its high sample efficiency and noise robustness. To further enhance its efficiency, reduced physical models of the system can…

Machine Learning · Computer Science 2024-06-18 Jannis O. Lübsen , Christian Hespe , Annika Eichler

This paper introduces a probabilistic framework to estimate parameters of an acquisition function given observed human behavior that can be modeled as a collection of sample paths from a Bayesian optimization procedure. The methodology…

Human-Computer Interaction · Computer Science 2022-02-04 Nathan Sandholtz , Yohsuke Miyamoto , Luke Bornn , Maurice Smith

Likelihood functions evaluated using particle filters are typically noisy, computationally expensive, and non-differentiable due to Monte Carlo variability. These characteristics make conventional optimization methods difficult to apply…

Methodology · Statistics 2026-01-13 Genshiro Kitagawa

We study Bayesian methods for large-scale linear inverse problems, focusing on the challenging task of hyperparameter estimation. Typical hierarchical Bayesian formulations that follow a Markov Chain Monte Carlo approach are possible for…

Numerical Analysis · Mathematics 2024-01-05 Khalil A Hall-Hooper , Arvind K Saibaba , Julianne Chung , Scot M Miller

We consider the problem of chance constrained optimization where it is sought to optimize a function and satisfy constraints, both of which are affected by uncertainties. The real world declinations of this problem are particularly…

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during…

Machine Learning · Statistics 2017-11-22 Peter I. Frazier , Jialei Wang

Bayesian optimization through Gaussian process regression is an effective method of optimizing an unknown function for which every measurement is expensive. It approximates the objective function and then recommends a new measurement point…

Machine Learning · Statistics 2017-05-17 Hildo Bijl , Thomas B. Schön , Jan-Willem van Wingerden , Michel Verhaegen

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a…

Systems and Control · Computer Science 2019-01-24 Matthias Neumann-Brosig , Alonso Marco , Dieter Schwarzmann , Sebastian Trimpe

Bayesian optimization (BO) is a class of sample-efficient global optimization methods, where a probabilistic model conditioned on previous observations is used to determine future evaluations via the optimization of an acquisition function.…

Machine Learning · Computer Science 2020-06-22 Eric Hans Lee , David Eriksson , Bolong Cheng , Michael McCourt , David Bindel

Bayesian optimization has become a popular method for high-throughput computing, like the design of computer experiments or hyperparameter tuning of expensive models, where sample efficiency is mandatory. In these applications, distributed…

Machine Learning · Computer Science 2019-07-08 Javier Garcia-Barcos , Ruben Martinez-Cantin

Bayesian optimization offers a flexible framework to optimize an objective function that is expensive to be evaluated. A Bayesian optimizer iteratively queries the function values on its carefully selected points. Subsequently, it makes a…

Machine Learning · Computer Science 2019-06-25 Yang Li , Yaqiang Yao

Bayesian optimization (BO) is a popular algorithm for solving challenging optimization tasks. It is designed for problems where the objective function is expensive to evaluate, perhaps not available in exact form, without gradient…

Machine Learning · Statistics 2018-08-22 Umberto Noè , Dirk Husmeier

The key idea of Bayesian optimization is replacing an expensive target function with a cheap surrogate model. By selection of an acquisition function for Bayesian optimization, we trade off between exploration and exploitation. The…

Machine Learning · Statistics 2019-02-20 Leonid Matyushin , Alexey Zaytsev , Oleg Alenkin , Andrey Ustuzhanin

Bilevel optimization, a hierarchical mathematical framework where one optimization problem is nested within another, has emerged as a powerful tool for modeling complex decision-making processes in various fields such as economics,…

Machine Learning · Computer Science 2024-12-25 Omer Ekmekcioglu , Nursen Aydin , Juergen Branke

Optimal portfolio allocation is often formulated as a constrained risk problem, where one aims to minimize a risk measure subject to some performance constraints. This paper presents new Bayesian Optimization algorithms for such constrained…

Portfolio Management · Quantitative Finance 2025-03-25 Robert Millar , Jinglai Li

This work proposes a Bayesian inference method for the reduced-order modeling of time-dependent systems. Informed by the structure of the governing equations, the task of learning a reduced-order model from data is posed as a Bayesian…

Numerical Analysis · Mathematics 2023-01-18 Mengwu Guo , Shane A. McQuarrie , Karen E. Willcox

Bayesian optimization has proven to be a highly effective methodology for the global optimization of unknown, expensive and multimodal functions. The ability to accurately model distributions over functions is critical to the effectiveness…

Machine Learning · Statistics 2014-06-13 Jasper Snoek , Kevin Swersky , Richard S. Zemel , Ryan P. Adams

We describe a method for Bayesian optimization by which one may incorporate data from multiple systems whose quantitative interrelationships are unknown a priori. All general (nonreal-valued) features of the systems are associated with…

Machine Learning · Computer Science 2020-01-06 Steven Atkinson , Sayan Ghosh , Natarajan Chennimalai-Kumar , Genghis Khan , Liping Wang

Bayesian optimisation presents a sample-efficient methodology for global optimisation. Within this framework, a crucial performance-determining subroutine is the maximisation of the acquisition function, a task complicated by the fact that…

Machine Learning · Computer Science 2020-12-18 Antoine Grosnit , Alexander I. Cowen-Rivers , Rasul Tutunov , Ryan-Rhys Griffiths , Jun Wang , Haitham Bou-Ammar