中文
相关论文

相关论文: When Gaussian Process Meets Big Data: A Review of …

200 篇论文

Gaussian process (GP) models have received increasing attention in recent years due to their superb prediction accuracy and modeling flexibility. To address the computational burdens of GP models for large-scale datasets, distributed…

机器学习 · 统计学 2026-02-11 Haoyuan Chen , Rui Tuo

Gaussian Processes (GPs) offer an attractive method for regression over small, structured and correlated datasets. However, their deployment is hindered by computational costs and limited guidelines on how to apply GPs beyond simple…

机器学习 · 计算机科学 2023-07-18 Kenza Tazi , Jihao Andreas Lin , Ross Viljoen , Alex Gardner , ST John , Hong Ge , Richard E. Turner

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

机器学习 · 统计学 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Gaussian processes (GPs) provide a framework for Bayesian inference that can offer principled uncertainty estimates for a large range of problems. For example, if we consider regression problems with Gaussian likelihoods, a GP model enjoys…

机器学习 · 计算机科学 2022-12-21 Felix Leibfried , Vincent Dutordoir , ST John , Nicolas Durrande

Gaussian processes (GPs) are a popular class of Bayesian nonparametric models, but its training can be computationally burdensome for massive training datasets. While there has been notable work on scaling up these models for big data,…

统计方法学 · 统计学 2023-11-16 Kevin Li , Simon Mak

Gaussian process classification (GPC) provides a flexible and powerful statistical framework describing joint distributions over function space. Conventional GPCs however suffer from (i) poor scalability for big data due to the full kernel…

机器学习 · 统计学 2019-09-17 Haitao Liu , Yew-Soon Ong , Ziwei Yu , Jianfei Cai , Xiaobo Shen

One obstacle to the use of Gaussian processes (GPs) in large-scale problems, and as a component in deep learning system, is the need for bespoke derivations and implementations for small variations in the model or inference. In order to…

机器学习 · 统计学 2020-03-04 Mark van der Wilk , Vincent Dutordoir , ST John , Artem Artemev , Vincent Adam , James Hensman

Geostatistics is a branch of statistics concerned with stochastic processes over continuous domains, with Gaussian processes (GPs) providing a flexible and principled modelling framework. However, the high computational cost of simulating…

统计计算 · 统计学 2026-03-20 Flávio B. Gonçalves , Marcos O. Prates , Gareth O. Roberts

In this work, we propose a novel framework for large-scale Gaussian process (GP) modeling. Contrary to the global, and local approximations proposed in the literature to address the computational bottleneck with exact GP modeling, we employ…

机器学习 · 统计学 2023-12-19 Akhil Vakayil , Roshan Joseph

In order to scale standard Gaussian process (GP) regression to large-scale datasets, aggregation models employ factorized training process and then combine predictions from distributed experts. The state-of-the-art aggregation models,…

机器学习 · 统计学 2018-06-05 Haitao Liu , Jianfei Cai , Yi Wang , Yew-Soon Ong

Model selection in Gaussian processes scales prohibitively with the size of the training dataset, both in time and memory. While many approximations exist, all incur inevitable approximation error. Recent work accounts for this error in the…

机器学习 · 计算机科学 2025-07-08 Jonathan Wenger , Kaiwen Wu , Philipp Hennig , Jacob R. Gardner , Geoff Pleiss , John P. Cunningham

The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially…

机器学习 · 统计学 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Gaussian processes (GPs) defined through intrinsic random fields provide a flexible framework for modeling spatial phenomena, and have been advocated in a variety of applications over the past several decades. Nevertheless, their adoption…

Gaussian processes are a powerful framework for uncertainty-aware function approximation and sequential decision-making. Unfortunately, their classical formulation does not scale gracefully to large amounts of data and modern hardware for…

机器学习 · 计算机科学 2025-07-10 Jihao Andreas Lin

Gaussian processes (GPs) are flexible, probabilistic, nonparametric models widely used in fields such as spatial statistics and machine learning. A drawback of Gaussian processes is their computational cost, with $O(N^3)$ time and $O(N^2)$…

统计计算 · 统计学 2026-05-20 Filippo Rambelli , Fabio Sigrist

We introduce a new scalable approximation for Gaussian processes with provable guarantees which hold simultaneously over its entire parameter space. Our approximation is obtained from an improved sample complexity analysis for sparse…

机器学习 · 计算机科学 2020-11-18 Quang Minh Hoang , Trong Nghia Hoang , Hai Pham , David P. Woodruff

This work introduces the concept of parametric Gaussian processes (PGPs), which is built upon the seemingly self-contradictory idea of making Gaussian processes parametric. Parametric Gaussian processes, by construction, are designed to…

机器学习 · 统计学 2017-05-08 Maziar Raissi

The Gaussian process (GP) is a widely used probabilistic machine learning method with implicit uncertainty characterization for stochastic function approximation, stochastic modeling, and analyzing real-world measurements of nonlinear…

机器学习 · 统计学 2026-04-14 Mark D. Risser , Marcus M. Noack , Hengrui Luo , Ronald Pandolfi

Exact Gaussian Process (GP) regression has O(N^3) runtime for data size N, making it intractable for large N. Many algorithms for improving GP scaling approximate the covariance with lower rank matrices. Other work has exploited structure…

机器学习 · 统计学 2012-09-24 Elad Gilboa , Yunus Saatçi , John P. Cunningham

Gaussian Processes are widely used for regression tasks. A known limitation in the application of Gaussian Processes to regression tasks is that the computation of the solution requires performing a matrix inversion. The solution also…

机器学习 · 计算机科学 2017-08-22 Sourish Das , Sasanka Roy , Rajiv Sambasivan