English
Related papers

Related papers: Function-space Inference with Sparse Implicit Proc…

200 papers

Gaussian Processes (GPs) are highly expressive, probabilistic models. A major limitation is their computational complexity. Naively, exact GP inference requires $\mathcal{O}(N^3)$ computations with $N$ denoting the number of modeled points.…

Machine Learning · Computer Science 2022-06-23 Gordian Edenhofer , Reimar H. Leike , Philipp Frank , Torsten A. Enßlin

Gaussian processes (GPs) offer a flexible class of priors for nonparametric Bayesian regression, but popular GP posterior inference methods are typically prohibitively slow or lack desirable finite-data guarantees on quality. We develop an…

Machine Learning · Statistics 2019-03-28 Jonathan H. Huggins , Trevor Campbell , Mikołaj Kasprzak , Tamara Broderick

Gaussian processes (GPs) are sophisticated distributions to model functional data. Whilst theoretically appealing, they are computationally cumbersome except for small datasets. We implement two methods for scaling GP inference in Stan:…

Methodology · Statistics 2024-01-11 Till Hoffmann , Jukka-Pekka Onnela

One obstacle to the use of Gaussian processes (GPs) in large-scale problems, and as a component in deep learning system, is the need for bespoke derivations and implementations for small variations in the model or inference. In order to…

Machine Learning · Statistics 2020-03-04 Mark van der Wilk , Vincent Dutordoir , ST John , Artem Artemev , Vincent Adam , James Hensman

We introduce a simple, rigorous, and unified framework for solving nonlinear partial differential equations (PDEs), and for solving inverse problems (IPs) involving the identification of parameters in PDEs, using the framework of Gaussian…

Numerical Analysis · Mathematics 2021-08-12 Yifan Chen , Bamdad Hosseini , Houman Owhadi , Andrew M Stuart

Gaussian processes (GPs) are a good choice for function approximation as they are flexible, robust to over-fitting, and provide well-calibrated predictive uncertainty. Deep Gaussian processes (DGPs) are multi-layer generalisations of GPs,…

Machine Learning · Statistics 2017-11-15 Hugh Salimbeni , Marc Deisenroth

We consider Bayesian inference problems with computationally intensive likelihood functions. We propose a Gaussian process (GP) based method to approximate the joint distribution of the unknown parameters and the data. In particular, we…

Computation · Statistics 2018-03-15 Hongqiao Wang , Jinglai Li

Gaussian processes are popular and flexible models for spatial, temporal, and functional data, but they are computationally infeasible for large datasets. We discuss Gaussian-process approximations that use basis functions at multiple…

Methodology · Statistics 2020-12-22 Matthias Katzfuss , Wenlong Gong

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the…

Methodology · Statistics 2020-11-09 A. Fradi , Y. Feunteun , C. Samir , M. Baklouti , F. Bachoc , J-M. Loubes

Laplace approximations are popular techniques for endowing deep networks with epistemic uncertainty estimates as they can be applied without altering the predictions of the trained network, and they scale to large models and datasets. While…

Machine Learning · Computer Science 2024-11-01 Tristan Cinquin , Marvin Pförtner , Vincent Fortuin , Philipp Hennig , Robert Bamler

Gaussian processes (GPs) are non-parametric Bayesian models that are widely used for diverse prediction tasks. Previous work in adding strong privacy protection to GPs via differential privacy (DP) has been limited to protecting only the…

Machine Learning · Computer Science 2021-11-12 Antti Honkela , Laila Melkas

Inter-domain Gaussian processes (GPs) allow for high flexibility and low computational cost when performing approximate inference in GP models. They are particularly suitable for modeling data exhibiting global structure but are limited to…

Machine Learning · Statistics 2020-11-03 Tim G. J. Rudner , Dino Sejdinovic , Yarin Gal

Solving Bayesian inverse problems typically involves deriving a posterior distribution using Bayes' rule, followed by sampling from this posterior for analysis. Sampling methods, such as general-purpose Markov chain Monte Carlo (MCMC), are…

Mathematical Software · Computer Science 2025-09-16 Jasper M. Everink , Chao Zhang , Amal M. A. Alghamdi , Rémi Laumont , Nicolai A. B. Riis , Jakob S. Jørgensen

Missing values are common in many real-life datasets. However, most of the current machine learning methods can not handle missing values. This means that they should be imputed beforehand. Gaussian Processes (GPs) are non-parametric models…

We propose a representation of Gaussian processes (GPs) based on powers of the integral operator defined by a kernel function, we call these stochastic processes integral Gaussian processes (IGPs). Sample paths from IGPs are functions…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Sayan Mukherjee

Gaussian Processes (GPs) are powerful non-parametric Bayesian regression models that allow exact posterior inference, but exhibit high computational and memory costs. In order to improve scalability of GPs, approximate posterior inference…

Machine Learning · Computer Science 2020-04-28 Martin Trapp , Robert Peharz , Franz Pernkopf , Carl E. Rasmussen

Many statistical problems include model parameters that are defined as the solutions to optimization sub-problems. These include classical approaches such as profile likelihood as well as modern applications involving flow networks or…

Methodology · Statistics 2025-03-17 Cheng Zeng , Yaozhi Yang , Jason Xu , Leo L Duan

Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of…

Machine Learning · Computer Science 2018-09-11 Linfeng Liu , Liping Liu

Adaptive learning is necessary for non-stationary environments where the learning machine needs to forget past data distribution. Efficient algorithms require a compact model update to not grow in computational burden with the incoming data…

Machine Learning · Computer Science 2023-07-11 Vanessa Gómez-Verdejo , Emilio Parrado-Hernández , Manel Martínez-Ramón

Gaussian processes (GPs) are widely used in non-parametric Bayesian modeling, and play an important role in various statistical and machine learning applications. In a variety tasks of uncertainty quantification, generating random sample…

Computation · Statistics 2024-08-02 Haoyuan Chen , Rui Tuo