English
Related papers

Related papers: Adaptive finite element type decomposition of Gaus…

200 papers

The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially…

Machine Learning · Statistics 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

Machine Learning · Computer Science 2012-03-19 Yuan , Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka

Adaptive learning is necessary for non-stationary environments where the learning machine needs to forget past data distribution. Efficient algorithms require a compact model update to not grow in computational burden with the incoming data…

Machine Learning · Computer Science 2023-07-11 Vanessa Gómez-Verdejo , Emilio Parrado-Hernández , Manel Martínez-Ramón

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang

In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that…

Numerical Analysis · Mathematics 2025-04-24 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Gaussian processes (GPs) are a Bayesian machine learning approach widely used to construct surrogate models for the uncertainty quantification of computer simulation codes in industrial applications. It provides both a mean predictor and an…

Variational inference is a powerful tool for approximate inference, and it has been recently applied for representation learning with deep generative models. We develop the variational Gaussian process (VGP), a Bayesian nonparametric…

Machine Learning · Statistics 2016-04-19 Dustin Tran , Rajesh Ranganath , David M. Blei

Standard sparse pseudo-input approximations to the Gaussian process (GP) cannot handle complex functions well. Sparse spectrum alternatives attempt to answer this but are known to over-fit. We suggest the use of variational inference for…

Machine Learning · Statistics 2015-03-23 Yarin Gal , Richard Turner

We propose a nested Gaussian process (nGP) as a locally adaptive prior for Bayesian nonparametric regression. Specified through a set of stochastic differential equations (SDEs), the nGP imposes a Gaussian process prior for the function's…

Methodology · Statistics 2012-01-24 Bin Zhu , David B. Dunson

Inverse problems are prevalent in both scientific research and engineering applications. In the context of Bayesian inverse problems, sampling from the posterior distribution can be particularly challenging when the forward models are…

Computation · Statistics 2026-02-17 Zhihang Xu , Xiaoyu Zhu , Daoji Li , Qifeng Liao

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

Fitting a theoretical model to experimental data in a Bayesian manner using Markov chain Monte Carlo typically requires one to evaluate the model thousands (or millions) of times. When the model is a slow-to-compute physics simulation,…

Machine Learning · Statistics 2022-08-25 Steven Stetzler , Michael Grosskopf , Earl Lawrence

Gaussian processes (GPs) provide a framework for Bayesian inference that can offer principled uncertainty estimates for a large range of problems. For example, if we consider regression problems with Gaussian likelihoods, a GP model enjoys…

Machine Learning · Computer Science 2022-12-21 Felix Leibfried , Vincent Dutordoir , ST John , Nicolas Durrande

Gaussian Process (GP) regression is shown to be effective for learning unknown dynamics, enabling efficient and safety-aware control strategies across diverse applications. However, existing GP-based model predictive control (GP-MPC)…

Systems and Control · Electrical Eng. & Systems 2025-05-13 Manish Prajapat , Johannes Köhler , Amon Lahr , Andreas Krause , Melanie N. Zeilinger

Decoders built on Gaussian processes (GPs) are enticing due to the marginalisation over the non-linear function space. Such models (also known as GP-LVMs) are often expensive and notoriously difficult to train in practice, but can be scaled…

Machine Learning · Statistics 2022-11-28 Pablo Moreno-Muñoz , Cilie W Feldager , Søren Hauberg

A generalized Gaussian process model (GGPM) is a unifying framework that encompasses many existing Gaussian process (GP) models, such as GP regression, classification, and counting. In the GGPM framework, the observation likelihood of the…

Machine Learning · Statistics 2013-11-28 Lifeng Shang , Antoni B. Chan

The use of Gaussian processes (GPs) is supported by efficient sampling algorithms, a rich methodological literature, and strong theoretical grounding. However, due to their prohibitive computation and storage demands, the use of exact GPs…

Statistics Theory · Mathematics 2022-07-27 Kelly R. Moran , Matthew W. Wheeler

Gaussian processes (GPs) are powerful and widely used probabilistic regression models, but their effectiveness in practice is often limited by the choice of kernel function. This kernel function is typically handcrafted from a small set of…

Machine Learning · Computer Science 2026-02-13 Jihao Andreas Lin , Sebastian Ament , Louis C. Tiao , David Eriksson , Maximilian Balandat , Eytan Bakshy

Sparse pseudo-point approximations for Gaussian process (GP) models provide a suite of methods that support deployment of GPs in the large data regime and enable analytic intractabilities to be sidestepped. However, the field lacks a…

Machine Learning · Statistics 2017-11-15 Thang D. Bui , Cuong V. Nguyen , Richard E. Turner

In many real-world applications we are interested in approximating costly functions that are analytically unknown, e.g. complex computer codes. An emulator provides a fast approximation of such functions relying on a limited number of…

Methodology · Statistics 2020-10-02 Hossein Mohammadi , Peter Challenor , Marc Goodfellow , Daniel Williamson