English
Related papers

Related papers: Streaming Sparse Gaussian Process Approximations

200 papers

The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially…

Machine Learning · Statistics 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Online Gaussian processes (GPs), typically used for learning models from time-series data, are more flexible and robust than offline GPs. Both local and sparse approximations of GPs can efficiently learn complex models online. Yet, these…

Robotics · Computer Science 2024-01-17 Wei Li , Zhiwen Li , Yiqi Liu , Yongping Pan

Deep Gaussian processes (DGPs) provide a rich class of models that can better represent functions with varying regimes or sharp changes, compared to conventional GPs. In this work, we propose a novel inference method for DGPs for computer…

Machine Learning · Statistics 2022-08-18 Deyu Ming , Daniel Williamson , Serge Guillas

Gaussian processes (GPs) have been proven to be powerful tools in various areas of machine learning. However, there are very few applications of GPs in the scenario of multi-view learning. In this paper, we present a new GP model for…

Machine Learning · Statistics 2017-01-18 Qiuyang Liu , Shiliang Sun

One obstacle to the use of Gaussian processes (GPs) in large-scale problems, and as a component in deep learning system, is the need for bespoke derivations and implementations for small variations in the model or inference. In order to…

Machine Learning · Statistics 2020-03-04 Mark van der Wilk , Vincent Dutordoir , ST John , Artem Artemev , Vincent Adam , James Hensman

Modeling sequential data has become more and more important in practice. Some applications are autonomous driving, virtual sensors and weather forecasting. To model such systems so called recurrent models are used. In this article we…

Machine Learning · Statistics 2017-11-21 Roman Föll , Bernard Haasdonk , Markus Hanselmann , Holger Ulmer

Mechanistic simulation models are inverted against observations in order to gain inference on modeled processes. However, with the increasing ability to collect high resolution observations, these observations represent more patterns of…

Computation · Statistics 2018-12-20 Thomas Wutzler

Predicting the labels of graph-structured data is crucial in scientific applications and is often achieved using graph neural networks (GNNs). However, when data is scarce, GNNs suffer from overfitting, leading to poor performance.…

Machine Learning · Computer Science 2025-05-19 Mathieu Alain , So Takao , Xiaowen Dong , Bastian Rieck , Emmanuel Noutahi

Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of…

Machine Learning · Computer Science 2018-09-11 Linfeng Liu , Liping Liu

A Gaussian process (GP)-based methodology is proposed to emulate complex dynamical computer models (or simulators). The method relies on emulating the numerical flow map of the system over an initial (short) time step, where the flow map is…

Methodology · Statistics 2024-11-26 Hossein Mohammadi , Peter Challenor , Marc Goodfellow

Gaussian process (GP) regression is a non-parametric, Bayesian framework to approximate complex models. Standard GP regression can lead to an unbounded model in which some points can take infeasible values. We introduce a new GP method that…

Machine Learning · Statistics 2024-04-04 Didem Kochan , Xiu Yang

Model selection in Gaussian processes scales prohibitively with the size of the training dataset, both in time and memory. While many approximations exist, all incur inevitable approximation error. Recent work accounts for this error in the…

Machine Learning · Computer Science 2025-07-08 Jonathan Wenger , Kaiwen Wu , Philipp Hennig , Jacob R. Gardner , Geoff Pleiss , John P. Cunningham

Building Free-Viewpoint Videos in a streaming manner offers the advantage of rapid responsiveness compared to offline training methods, greatly enhancing user experience. However, current streaming approaches face challenges of high…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jinbo Yan , Rui Peng , Zhiyan Wang , Luyang Tang , Jiayu Yang , Jie Liang , Jiahao Wu , Ronggang Wang

We present a sparse analogue to stochastic gradient descent that is guaranteed to perform well under similar conditions to the lasso. In the linear regression setup with irrepresentable noise features, our algorithm recovers the support set…

Statistics Theory · Mathematics 2014-12-16 Jacob Steinhardt , Stefan Wager , Percy Liang

While Gaussian processes (GPs) are the method of choice for regression tasks, they also come with practical difficulties, as inference cost scales cubic in time and quadratic in memory. In this paper, we introduce a natural and expressive…

Machine Learning · Computer Science 2018-09-13 Martin Trapp , Robert Peharz , Carl E. Rasmussen , Franz Pernkopf

This paper presents a new approach for Gaussian process (GP) regression for large datasets. The approach involves partitioning the regression input domain into multiple local regions with a different local GP model fitted in each region.…

Machine Learning · Computer Science 2018-07-10 Chiwoo Park , Daniel Apley

Gaussian processes (GPs) provide a nonparametric representation of functions. However, classical GP inference suffers from high computational cost and it is difficult to design nonstationary GP priors in practice. In this paper, we propose…

Machine Learning · Computer Science 2013-03-15 Yuan Qi , Bo Dai , Yao Zhu

Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are probabilistic and non-parametric…

The stochastic partial differential equation approach to Gaussian processes (GPs) represents Mat\'ern GP priors in terms of $n$ finite element basis functions and Gaussian coefficients with sparse precision matrix. Such representations…

Computation · Statistics 2022-04-11 Daniel Sanz-Alonso , Ruiyi Yang

In this paper, we investigate a class of approximate Gaussian processes (GP) obtained by taking a linear combination of compactly supported basis functions with the basis coefficients endowed with a dependent Gaussian prior distribution.…

Statistics Theory · Mathematics 2025-06-02 Jaehoan Kim , Anirban Bhattacharya , Debdeep Pati