English
Related papers

Related papers: Variational Fourier features for Gaussian processe…

200 papers

Gaussian Processes are widely used for regression tasks. A known limitation in the application of Gaussian Processes to regression tasks is that the computation of the solution requires performing a matrix inversion. The solution also…

Machine Learning · Computer Science 2017-08-22 Sourish Das , Sasanka Roy , Rajiv Sambasivan

Gaussian processes (GPs) provide a framework for Bayesian inference that can offer principled uncertainty estimates for a large range of problems. For example, if we consider regression problems with Gaussian likelihoods, a GP model enjoys…

Machine Learning · Computer Science 2022-12-21 Felix Leibfried , Vincent Dutordoir , ST John , Nicolas Durrande

We propose non-stationary spectral kernels for Gaussian process regression. We propose to model the spectral density of a non-stationary kernel function as a mixture of input-dependent Gaussian process frequency density surfaces. We solve…

Machine Learning · Statistics 2019-09-25 Sami Remes , Markus Heinonen , Samuel Kaski

Gaussian processes have become a popular tool for nonparametric regression because of their flexibility and uncertainty quantification. However, they often use stationary kernels, which limit the expressiveness of the model and may be…

Machine Learning · Computer Science 2025-07-17 Zachary James , Joseph Guinness

Gaussian processes (GPs) offer appealing properties but are costly to train at scale. Sparse variational GP (SVGP) approximations reduce cost yet still rely on Cholesky decompositions of kernel matrices, ill-suited to low-precision,…

Machine Learning · Statistics 2026-04-02 Stefano Cortinovis , Laurence Aitchison , Stefanos Eleftheriadis , Mark van der Wilk

Gaussian process regression generally does not scale to beyond a few thousands data points without applying some sort of kernel approximation method. Most approximations focus on the high eigenvalue part of the spectrum of the kernel…

Machine Learning · Statistics 2018-01-31 Yi Ding , Risi Kondor , Jonathan Eskreis-Winkler

We introduce a novel Bayesian approach for variable selection using Gaussian process regression, which is crucial for enhancing interpretability and model regularization. Our method employs nearest neighbor Gaussian processes, serving as…

Brown-Resnick processes are max-stable processes that are associated to Gaussian processes. Their simulation is often based on the corresponding spectral representation which is not unique. We study to what extent simulation accuracy and…

Probability · Mathematics 2018-10-17 Marco Oesting , Kirstin Strokorb

Good sparse approximations are essential for practical inference in Gaussian Processes as the computational cost of exact methods is prohibitive for large datasets. The Fully Independent Training Conditional (FITC) and the Variational Free…

Machine Learning · Statistics 2017-05-31 Matthias Bauer , Mark van der Wilk , Carl Edward Rasmussen

Single-spin quantum sensors, for example based on nitrogen-vacancy centres in diamond, provide nanoscale mapping of magnetic fields. In applications where the magnetic field may be changing rapidly, total sensing time is crucial and must be…

Quantum Physics · Physics 2021-05-26 K. Craigie , E. M. Gauger , Y. Altmann , C. Bonato

We propose new methods for multivariate linear regression when the regression coefficient matrix is sparse and the error covariance matrix is dense. We assume that the error covariance matrix has equicorrelation across the response…

Methodology · Statistics 2025-08-13 Daeyoung Ham , Bradley S. Price , Adam J. Rothman

Fourier feature approximations have been successfully applied in the literature for scalable Gaussian Process (GP) regression. In particular, Quadrature Fourier Features (QFF) derived from Gaussian quadrature rules have gained popularity in…

Machine Learning · Statistics 2023-10-24 Kevin Li , Max Balakirsky , Simon Mak

Model selection in Gaussian processes scales prohibitively with the size of the training dataset, both in time and memory. While many approximations exist, all incur inevitable approximation error. Recent work accounts for this error in the…

Machine Learning · Computer Science 2025-07-08 Jonathan Wenger , Kaiwen Wu , Philipp Hennig , Jacob R. Gardner , Geoff Pleiss , John P. Cunningham

Gaussian processes (GPs) are typically criticised for their unfavourable scaling in both computational and memory requirements. For large datasets, sparse GPs reduce these demands by conditioning on a small set of inducing variables…

Gaussian Mixture Models (GMMs) range among the most frequently used models in machine learning. However, training large, general GMMs becomes computationally prohibitive for datasets that have many data points $N$ of high-dimensionality…

Machine Learning · Statistics 2025-12-12 Sebastian Salwig , Till Kahlke , Florian Hirschberger , Dennis Forster , Jörg Lücke

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg

We introduce fully scalable Gaussian processes, an implementation scheme that tackles the problem of treating a high number of training instances together with high dimensional input data. Our key idea is a representation trick over the…

Machine Learning · Statistics 2018-07-16 Aristeidis Panos , Petros Dellaportas , Michalis K. Titsias

A Gaussian process (GP)-based methodology is proposed to emulate complex dynamical computer models (or simulators). The method relies on emulating the numerical flow map of the system over an initial (short) time step, where the flow map is…

Methodology · Statistics 2024-11-26 Hossein Mohammadi , Peter Challenor , Marc Goodfellow

We introduce a variational theory for processes adapted to the multi-dimensional Brownian motion filtration. The theory provides a differential structure which describes the infinitesimal evolution of Wiener functionals at very small…

Probability · Mathematics 2017-07-13 Alberto Ohashi , Dorival Leão , Alexandre B. Simas

Gaussian Process Regression is a well-known machine learning technique for which several quantum algorithms have been proposed. We show here that in a wide range of scenarios these algorithms show no exponential speedup. We achieve this by…

Quantum Physics · Physics 2025-07-04 Dominic Lowe , M. S. Kim , Roberto Bondesan
‹ Prev 1 8 9 10 Next ›