English
Related papers

Related papers: Adaptive Parameter Optimization in Gaussian Proces…

200 papers

We present a novel approach for explaining Gaussian processes (GPs) that can utilize the full analytical covariance structure present in GPs. Our method is based on the popular solution concept of Shapley values extended to stochastic…

Machine Learning · Statistics 2023-05-25 Siu Lun Chau , Krikamol Muandet , Dino Sejdinovic

Adaptive exploration methods propose ways to learn complex policies via alternating between exploration and exploitation. An important question for such methods is to determine the appropriate moment to switch between exploration and…

Artificial Intelligence · Computer Science 2026-02-11 Leonidas Bakopoulos , Georgios Chalkiadakis

Choosing appropriate hyperparameters plays a crucial role in the success of neural networks as hyper-parameters directly control the behavior and performance of the training algorithms. To obtain efficient tuning, Bayesian optimization…

Machine Learning · Statistics 2024-02-08 Jiazhao Zhang , Ying Hung , Chung-Ching Lin , Zicheng Liu

The main objective of this paper is to outline a theoretical framework to analyse how humans' decision-making strategies under uncertainty manage the trade-off between information gathering (exploration) and reward seeking (exploitation). A…

Artificial Intelligence · Computer Science 2021-02-16 Antonio Candelieri , Andrea Ponti , Francesco Archetti

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

Machine Learning · Statistics 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

In several applications such as databases, planning, and sensor networks, parameters such as selectivity, load, or sensed values are known only with some associated uncertainty. The performance of such a system (as captured by some…

Data Structures and Algorithms · Computer Science 2010-01-28 Sudipto Guha , Kamesh Munagala

A Gaussian Process (GP) is a prominent mathematical framework for stochastic function approximation in science and engineering applications. This success is largely attributed to the GP's analytical tractability, robustness, non-parametric…

Machine Learning · Statistics 2022-05-19 Marcus M. Noack , Harinarayan Krishnan , Mark D. Risser , Kristofer G. Reyes

In this paper, the problem of maximizing a black-box function $f:\mathcal{X} \to \mathbb{R}$ is studied in the Bayesian framework with a Gaussian Process (GP) prior. In particular, a new algorithm for this problem is proposed, and high…

Machine Learning · Statistics 2018-01-09 Shubhanshu Shekhar , Tara Javidi

Data-driven forecasts of air quality have recently achieved more accurate short-term predictions. Despite their success, most of the current data-driven solutions lack proper quantifications of model uncertainty that communicate how much to…

Machine Learning · Computer Science 2021-12-07 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor

The composition of multiple Gaussian Processes as a Deep Gaussian Process (DGP) enables a deep probabilistic nonparametric approach to flexibly tackle complex machine learning problems with sound quantification of uncertainty. Existing…

Machine Learning · Statistics 2017-03-02 Kurt Cutajar , Edwin V. Bonilla , Pietro Michiardi , Maurizio Filippone

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

Learning human preferences is essential for human-robot interaction, as it enables robots to adapt their behaviors to align with human expectations and goals. However, the inherent uncertainties in both human behavior and robotic systems…

Robotics · Computer Science 2025-10-24 Shaoting Peng , Haonan Chen , Katherine Driggs-Campbell

In order to improve the performance of Bayesian optimisation, we develop a modified Gaussian process upper confidence bound (GP-UCB) acquisition function. This is done by sampling the exploration-exploitation trade-off parameter from a…

Machine Learning · Computer Science 2020-06-09 Julian Berk , Sunil Gupta , Santu Rana , Svetha Venkatesh

Gaussian process modeling is a standard tool for building emulators for computer experiments, which are usually used to study deterministic functions, for example, a solution to a given system of partial differential equations. This work…

Statistics Theory · Mathematics 2021-10-01 Wenjia Wang

Gaussian Processes (\textbf{GPs}) are flexible non-parametric models with strong probabilistic interpretation. While being a standard choice for performing inference on time series, GPs have few techniques to work in a streaming setting.…

Machine Learning · Statistics 2021-07-22 Théo Galy-Fajou , Manfred Opper

Model selection in Gaussian processes scales prohibitively with the size of the training dataset, both in time and memory. While many approximations exist, all incur inevitable approximation error. Recent work accounts for this error in the…

Machine Learning · Computer Science 2025-07-08 Jonathan Wenger , Kaiwen Wu , Philipp Hennig , Jacob R. Gardner , Geoff Pleiss , John P. Cunningham

Gaussian processes provide a compact representation for modeling and estimating an unknown function, that can be updated as new measurements of the function are obtained. This paper extends this powerful framework to the case where the…

Systems and Control · Electrical Eng. & Systems 2023-11-30 Jilles van Hulst , Roy van Zuijlen , Duarte Antunes , W. P. M. H. , Heemels

In this paper, we consider the problem of Gaussian process (GP) optimization with an added robustness requirement: The returned point may be perturbed by an adversary, and we require the function value to remain as high as possible even…

Machine Learning · Statistics 2018-11-05 Ilija Bogunovic , Jonathan Scarlett , Stefanie Jegelka , Volkan Cevher

Bayesian hyperparameter optimization relies heavily on Gaussian Process (GP) surrogates, due to robust distributional posteriors and strong performance on limited training samples. GPs however underperform in categorical hyperparameter…

Machine Learning · Computer Science 2025-09-23 Riccardo Doyle

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen