English
Related papers

Related papers: Influence of Prior Distributions on Gaussian Proce…

200 papers

The accurate prediction of time-changing variances is an important task in the modeling of financial data. Standard econometric models are often limited as they assume rigid functional relationships for the variances. Moreover, function…

Methodology · Statistics 2014-02-14 Yue Wu , Jose Miguel Hernandez Lobato , Zoubin Ghahramani

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies…

Machine Learning · Statistics 2018-08-01 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

Gaussian processes (GPs) are Bayesian non-parametric models useful in a myriad of applications. Despite their popularity, the cost of GP predictions (quadratic storage and cubic complexity with respect to the number of training points)…

Machine Learning · Computer Science 2022-05-24 Alec M. Dunton , Benjamin W. Priest , Amanda Muyskens

Bayesian optimization (BO) with Gaussian processes (GP) as surrogate models is widely used to optimize analytically unknown and expensive-to-evaluate functions. In this paper, we propose Prior-mean-RObust Bayesian Optimization (PROBO) that…

Artificial Intelligence · Computer Science 2021-11-17 Julian Rodemann , Thomas Augustin

Motivated by the statistical evaluation of complex computer models, we deal with the issue of objective prior specification for the parameters of Gaussian processes. In particular, we derive the Jeffreys-rule, independence Jeffreys and…

Statistics Theory · Mathematics 2007-06-13 Rui Paulo

Deep Gaussian processes have recently been proposed as natural objects to fit, similarly to deep neural networks, possibly complex features present in modern data samples, such as compositional structures. Adopting a Bayesian nonparametric…

Statistics Theory · Mathematics 2025-02-04 Ismaël Castillo , Thibault Randrianarisoa

Gaussian process (GP) models provide a powerful tool for prediction but are computationally prohibitive using large data sets. In such scenarios, one has to resort to approximate methods. We derive an approximation based on a composite…

Machine Learning · Statistics 2018-02-02 Xiuming Liu , Dave Zachariah , Edith C. H. Ngai

Gaussian random fields (GFs) are fundamental tools in spatial modeling and can be represented flexibly and efficiently as solutions to stochastic partial differential equations (SPDEs). The SPDEs depend on specific parameters, which enforce…

Methodology · Statistics 2026-05-04 Liam Llamazares-Elias , Jonas Latz , Finn Lindgren

Gaussian process (GP) models form a core part of probabilistic machine learning. Considerable research effort has been made into attacking three issues with GP models: how to compute efficiently when the number of data is large; how to…

Machine Learning · Statistics 2015-06-15 James Hensman , Alexander G. de G. Matthews , Maurizio Filippone , Zoubin Ghahramani

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

Gaussian processes constitute a very powerful and well-understood method for non-parametric regression and classification. In the classical framework, the training data consists of deterministic vector-valued inputs and the corresponding…

Systems and Control · Computer Science 2018-09-26 Maxim Dolgov , Uwe D. Hanebeck

In the literature surrounding Bayesian penalized regression, the two primary choices of prior distribution on the regression coefficients are zero-mean Gaussian and Laplace. While both have been compared numerically and theoretically, there…

Methodology · Statistics 2010-01-26 Luke Bornn , Raphael Gottardo , Arnaud Doucet

Predictive models for binary data are fundamental in various fields, and the growing complexity of modern applications has motivated several flexible specifications for modeling the relationship between the observed predictors and the…

Computation · Statistics 2022-01-31 Jian Cao , Daniele Durante , Marc G. Genton

Bayesian hierarchical models are frequently used in practical data analysis contexts. One interpretation of these models is that they provide an indirect way of assigning a prior for unknown parameters, through the introduction of…

Machine Learning · Statistics 2026-05-01 Brendon J. Brewer

When constructing a Bayesian Machine Learning model, we might be faced with multiple different prior distributions and thus are required to properly consider them in a sensible manner in our model. While this situation is reasonably well…

Machine Learning · Computer Science 2021-04-20 Sarem Seitz

Gaussian Processes (GPs) are powerful non-parametric Bayesian regression models that allow exact posterior inference, but exhibit high computational and memory costs. In order to improve scalability of GPs, approximate posterior inference…

Machine Learning · Computer Science 2020-04-28 Martin Trapp , Robert Peharz , Franz Pernkopf , Carl E. Rasmussen

This work introduces the concept of parametric Gaussian processes (PGPs), which is built upon the seemingly self-contradictory idea of making Gaussian processes parametric. Parametric Gaussian processes, by construction, are designed to…

Machine Learning · Statistics 2017-05-08 Maziar Raissi

Gaussian processes are flexible probabilistic regression models which are widely used in statistics and machine learning. However, a drawback is their limited scalability to large data sets. To alleviate this, full-scale approximations…

Methodology · Statistics 2026-01-13 Tim Gyger , Reinhard Furrer , Fabio Sigrist

Model Updating is frequently used in Structural Health Monitoring to determine structures' operating conditions and whether maintenance is required. Data collected by sensors are used to update the values of some initially unknown…

Computation · Statistics 2024-01-23 Felipe Igea , Alice Cicirello