English
Related papers

Related papers: Wasserstein Barycenter Gaussian Process based Baye…

200 papers

Bayesian optimization (BO) has become a popular strategy for global optimization of expensive real-world functions. Contrary to a common expectation that BO is suited to optimizing black-box functions, it actually requires domain knowledge…

Machine Learning · Computer Science 2024-08-06 Zi Wang , George E. Dahl , Kevin Swersky , Chansoo Lee , Zachary Nado , Justin Gilmer , Jasper Snoek , Zoubin Ghahramani

Gaussian processes are important models in the field of probabilistic numerics. We present a procedure for optimizing Mat\'ern kernel temporal Gaussian processes with respect to the kernel covariance function's hyperparameters. It is based…

Machine Learning · Computer Science 2025-08-14 Wouter M. Kouw

We propose a practical Bayesian optimization method using Gaussian process regression, of which the marginal likelihood is maximized where the number of model selection steps is guided by a pre-defined threshold. Since Bayesian optimization…

Machine Learning · Statistics 2020-10-19 Jungtaek Kim , Seungjin Choi

Gaussian Processes (GPs) are a generic modelling tool for supervised learning. While they have been successfully applied on large datasets, their use in safety-critical applications is hindered by the lack of good performance guarantees. To…

Machine Learning · Statistics 2019-08-27 David Reeb , Andreas Doerr , Sebastian Gerwinn , Barbara Rakitsch

Bayesian optimization through Gaussian process regression is an effective method of optimizing an unknown function for which every measurement is expensive. It approximates the objective function and then recommends a new measurement point…

Machine Learning · Statistics 2017-05-17 Hildo Bijl , Thomas B. Schön , Jan-Willem van Wingerden , Michel Verhaegen

Bayesian Optimization (BO) methods are useful for optimizing functions that are expen- sive to evaluate, lack an analytical expression and whose evaluations can be contaminated by noise. These methods rely on a probabilistic model of the…

Machine Learning · Statistics 2020-02-04 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Gaussian processes (GPs) are nonparametric Bayesian models that have been applied to regression and classification problems. One of the approaches to alleviate their cubic training cost is the use of local GP experts trained on subsets of…

Machine Learning · Statistics 2021-02-16 Samuel Cohen , Rendani Mbuvha , Tshilidzi Marwala , Marc Peter Deisenroth

In this paper, we focus on the analysis of the regularized Wasserstein barycenter problem. We provide uniqueness and a characterization of the barycenter for two important classes of probability measures: (i) Gaussian distributions and (ii)…

Optimization and Control · Mathematics 2022-08-09 S. Kum , M. H. Duong , Y. Lim , S. Yun

Much recent research has been conducted in the area of Bayesian learning, particularly with regard to the optimization of hyper-parameters via Gaussian process regression. The methodologies rely chiefly on the method of maximizing the…

Machine Learning · Statistics 2014-05-13 James Brofos

High-precision measurements require optimal setups and analysis tools to achieve continuous improvements. Systematic corrections need to be modeled with high accuracy and known uncertainty to reconstruct underlying physical phenomena. To…

Data Analysis, Statistics and Probability · Physics 2022-05-31 Max Lamparth , Mattis Bestehorn , Bastian Märkisch

Bayesian optimization (BO) has established itself as a leading strategy for efficiently optimizing expensive-to-evaluate functions. Existing BO methods mostly rely on Gaussian process (GP) surrogate models and are not applicable to…

Machine Learning · Computer Science 2024-01-29 Yongsheng Mei , Mahdi Imani , Tian Lan

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

Machine Learning · Statistics 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Bayesian optimization has become a fundamental global optimization algorithm in many problems where sample efficiency is of paramount importance. Recently, there has been proposed a large number of new applications in fields such as…

Artificial Intelligence · Computer Science 2019-02-06 Ruben Martinez-Cantin

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

Machine Learning · Computer Science 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner

Bayesian optimization is a sequential method for minimizing objective functions that are expensive to evaluate and about which few assumptions can be made. By using all gathered data to train a Gaussian process model for the function and…

Machine Learning · Computer Science 2026-05-07 Jesse Schneider , William J. Welch

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical…

Machine Learning · Computer Science 2024-07-18 Hwanwoo Kim , Daniel Sanz-Alonso

Bayesian optimisation is a popular technique for hyperparameter learning but typically requires initial exploration even in cases where similar prior tasks have been solved. We propose to transfer information across tasks using learnt…

Machine Learning · Statistics 2019-05-28 Ho Chung Leon Law , Peilin Zhao , Lucian Chan , Junzhou Huang , Dino Sejdinovic

Many functions have approximately-known upper and/or lower bounds, potentially aiding the modeling of such functions. In this paper, we introduce Gaussian process models for functions where such bounds are (approximately) known. More…

Machine Learning · Computer Science 2022-10-20 Vu Nguyen , Marc Peter Deisenroth , Michael A. Osborne

We introduce and study a novel model-selection strategy for Bayesian learning, based on optimal transport, along with its associated predictive posterior law: the Wasserstein population barycenter of the posterior law over models. We first…

Machine Learning · Statistics 2022-11-10 Julio Backhoff-Veraguas , Joaquin Fontbona , Gonzalo Rios , Felipe Tobar

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

Machine Learning · Computer Science 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau