English
Related papers

Related papers: Fully Scalable Gaussian Processes using Subspace I…

200 papers

Gaussian processes are flexible, probabilistic, non-parametric models widely used in machine learning and statistics. However, their scalability to large data sets is limited by computational constraints. To overcome these challenges, we…

Machine Learning · Statistics 2026-05-25 Tim Gyger , Reinhard Furrer , Fabio Sigrist

Gaussian processes are notorious for scaling cubically with the size of the training set, preventing application to very large regression problems. Computation-aware Gaussian processes (CAGPs) tackle this scaling issue by exploiting…

Machine Learning · Statistics 2025-03-24 Disha Hegde , Mohamed Adil , Jon Cockayne

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

Reinforcement learning provides a framework for learning to control which actions to take towards completing a task through trial-and-error. In many applications observing interactions is costly, necessitating sample-efficient learning. In…

Machine Learning · Statistics 2020-11-04 Charles Gadd , Markus Heinonen , Harri Lähdesmäki , Samuel Kaski

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the…

Methodology · Statistics 2020-11-09 A. Fradi , Y. Feunteun , C. Samir , M. Baklouti , F. Bachoc , J-M. Loubes

Gaussian processes are popular and flexible models for spatial, temporal, and functional data, but they are computationally infeasible for large datasets. We discuss Gaussian-process approximations that use basis functions at multiple…

Methodology · Statistics 2020-12-22 Matthias Katzfuss , Wenlong Gong

The main challenges that arise when adopting Gaussian Process priors in probabilistic modeling are how to carry out exact Bayesian inference and how to account for uncertainty on model parameters when making model-based predictions on…

Machine Learning · Statistics 2014-04-08 Maurizio Filippone , Mark Girolami

The log-Gaussian Cox process is a flexible and popular class of point pattern models for capturing spatial and space-time dependence for point patterns. Model fitting requires approximation of stochastic integrals which is implemented…

Computation · Statistics 2018-10-24 Shinichiro Shirota , Sudipto Banerjee

We present a framework for transfer learning based on modular variational Gaussian processes (GP). We develop a module-based method that having a dictionary of well fitted GPs, one could build ensemble GP models without revisiting any data.…

Machine Learning · Statistics 2021-10-27 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

Sparse Gaussian processes and various extensions thereof are enabled through inducing points, that simultaneously bottleneck the predictive capacity and act as the main contributor towards model complexity. However, the number of inducing…

Machine Learning · Computer Science 2021-07-27 Anders Kirk Uhrenholt , Valentin Charvet , Bjørn Sand Jensen

Gaussian Process state-space models capture complex temporal dependencies in a principled manner by placing a Gaussian Process prior on the transition function. These models have a natural interpretation as discretized stochastic…

Machine Learning · Computer Science 2022-02-24 Krista Longi , Jakob Lindinger , Olaf Duennbier , Melih Kandemir , Arto Klami , Barbara Rakitsch

High dimensional time series are endemic in applications of machine learning such as robotics (sensor data), computational biology (gene expression data), vision (video sequences) and graphics (motion capture data). Practical nonlinear…

Machine Learning · Statistics 2011-07-26 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

Complex computer codes are often too time expensive to be directly used to perform uncertainty, sensitivity, optimization and robustness analyses. A widely accepted method to circumvent this problem consists in replacing cpu-time expensive…

Statistics Theory · Mathematics 2017-04-25 Bertrand Iooss , Amandine Marrel

Gaussian processes are now commonly used in dimensionality reduction approaches tailored to neuroscience, especially to describe changes in high-dimensional neural activity over time. As recording capabilities expand to include neuronal…

Machine Learning · Statistics 2024-12-24 Evren Gokcen , Anna I. Jasper , Adam Kohn , Christian K. Machens , Byron M. Yu

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

Machine Learning · Computer Science 2010-02-23 Yuan Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka

Large-scale Gaussian process models are becoming increasingly important and widely used in many areas, such as, computer experiments, stochastic optimization via simulation, and machine learning using Gaussian processes. The standard…

Methodology · Statistics 2018-08-02 Yongxiang Li , Qiang Zhou , Kwok Leung Tsui , Javier Cabrera

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

Nonstationary non-Gaussian spatial data are common in many disciplines, including climate science, ecology, epidemiology, and social sciences. Examples include count data on disease incidence and binary satellite data on cloud mask…

Computation · Statistics 2020-11-30 Benjamin Seiyon Lee , Jaewoo Park

We propose a data-efficient Gaussian process-based Bayesian approach to the semi-supervised learning problem on graphs. The proposed model shows extremely competitive performance when compared to the state-of-the-art graph neural networks…

Machine Learning · Computer Science 2018-10-15 Yin Cheng Ng , Nicolo Colombo , Ricardo Silva