English
Related papers

Related papers: AutoGP: Exploring the Capabilities and Limitations…

200 papers

Gaussian Process (GP) models provide a flexible framework for prediction and uncertainty quantification. For most covariance functions, however, exact GP prediction with $n$ points scales as $\mathcal{O}(n^3)$, making it prohibitively…

Computation · Statistics 2026-05-29 Samanyu Arora , Christopher J. Geoga

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

Gaussian Processes (GPs) can be used as flexible, non-parametric function priors. Inspired by the growing body of work on Normalizing Flows, we enlarge this class of priors through a parametric invertible transformation that can be made…

Machine Learning · Computer Science 2021-02-26 Juan Maroñas , Oliver Hamelijnck , Jeremias Knoblauch , Theodoros Damoulas

The growing demand for accurate, efficient, and scalable solutions in computational mechanics highlights the need for advanced operator learning algorithms that can efficiently handle large datasets while providing reliable uncertainty…

Machine Learning · Statistics 2024-09-18 Sawan Kumar , Rajdip Nayek , Souvik Chakraborty

This monograph studies the relations between two approaches using positive definite kernels: probabilistic methods using Gaussian processes, and non-probabilistic methods using reproducing kernel Hilbert spaces (RKHS). They are widely…

Machine Learning · Statistics 2025-06-24 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K. Sriperumbudur

Gaussian processes are powerful, yet analytically tractable models for supervised learning. A Gaussian process is characterized by a mean function and a covariance function (kernel), which are determined by a model selection criterion. The…

Machine Learning · Statistics 2016-10-05 Benjamin Fischer , Nico Gorbach , Stefan Bauer , Yatao Bian , Joachim M. Buhmann

Multifidelity models integrate data from multiple sources to produce a single approximator for the underlying process. Dense low-fidelity samples are used to reduce interpolation error, while sparse high-fidelity samples are used to…

Machine Learning · Statistics 2024-02-27 Viv Bone , Chris van der Heide , Kieran Mackle , Ingo H. J. Jahn , Peter M. Dower , Chris Manzie

The Gaussian Process with a deep kernel is an extension of the classic GP regression model and this extended model usually constructs a new kernel function by deploying deep learning techniques like long short-term memory networks. A…

Computational Finance · Quantitative Finance 2021-05-27 Yong Shi , Wei Dai , Wen Long , Bo Li

A fundamental drawback of kernel-based statistical models is their limited scalability to large data sets, which requires resorting to approximations. In this work, we focus on the popular Gaussian kernel and on techniques to linearize…

Machine Learning · Statistics 2022-04-13 Jonas Wacker , Maurizio Filippone

Gaussian processes (GPs) are powerful models for human-in-the-loop experiments due to their flexibility and well-calibrated uncertainty. However, GPs modeling human responses typically ignore auxiliary information, including a priori domain…

Machine Learning · Computer Science 2025-03-07 Kaiwen Wu , Craig Sanders , Benjamin Letham , Phillip Guan

Gaussian processes (GPs) defined through intrinsic random fields provide a flexible framework for modeling spatial phenomena, and have been advocated in a variety of applications over the past several decades. Nevertheless, their adoption…

Numerical Analysis · Mathematics 2026-05-19 Christopher Beattie , David Higdon , Leanna House , Colby Stakun-Pickering , Jared Clark

Multi-output regression models must exploit dependencies between outputs to maximise predictive performance. The application of Gaussian processes (GPs) to this setting typically yields models that are computationally demanding and have…

Machine Learning · Statistics 2019-02-27 James Requeima , Will Tebbutt , Wessel Bruinsma , Richard E. Turner

We propose two methods for exact Gaussian process (GP) inference and learning on massive image, video, spatial-temporal, or multi-output datasets with missing values (or "gaps") in the observed responses. The first method ignores the gaps…

Machine Learning · Statistics 2018-08-13 Trefor W. Evans , Prasanth B. Nair

Optimizing wheat variety selection for high performance in different environmental conditions is critical for reliable food production and stable incomes for growers. We employ a statistical machine learning framework utilizing Gaussian…

In this paper we introduce GP+, an open-source library for kernel-based learning via Gaussian processes (GPs) which are powerful statistical models that are completely characterized by their parametric covariance and mean functions. GP+ is…

Machine Learning · Computer Science 2024-06-06 Amin Yousefpour , Zahra Zanjani Foumani , Mehdi Shishehbor , Carlos Mora , Ramin Bostanabad

We introduce a fast algorithm for Gaussian process regression in low dimensions, applicable to a widely-used family of non-stationary kernels. The non-stationarity of these kernels is induced by arbitrary spatially-varying vertical and…

Numerical Analysis · Mathematics 2025-03-28 P. Michael Kielstra , Michael Lindsey

A key challenge with controlling complex dynamical systems is to accurately model them. However, this requirement is very hard to satisfy in practice. Data-driven approaches such as Gaussian processes (GPs) have proved quite effective by…

Robotics · Computer Science 2022-03-08 Mouhyemen Khan , Akash Patel , Abhijit Chatterjee

Gaussian process models are flexible, Bayesian non-parametric approaches to regression. Properties of multivariate Gaussians mean that they can be combined linearly in the manner of additive models and via a link function (like in…

Machine Learning · Statistics 2016-04-19 Alan D. Saul , James Hensman , Aki Vehtari , Neil D. Lawrence

Deep Gaussian Processes (DGPs) were proposed as an expressive Bayesian model capable of a mathematically grounded estimation of uncertainty. The expressivity of DPGs results from not only the compositional character but the distribution…

Machine Learning · Computer Science 2021-11-23 Chi-Ken Lu , Patrick Shafto

We propose an active learning method for discovering low-dimensional structure in high-dimensional Gaussian process (GP) tasks. Such problems are increasingly frequent and important, but have hitherto presented severe practical…

Machine Learning · Statistics 2013-10-28 Roman Garnett , Michael A. Osborne , Philipp Hennig