English
Related papers

Related papers: Deep recurrent Gaussian process with variational S…

200 papers

We propose a novel online Gaussian process (GP) model that is capable of capturing long-term memory in sequential data in an online learning setting. Our model, Online HiPPO Sparse Variational Gaussian Process (OHSVGP), leverages the HiPPO…

Machine Learning · Computer Science 2025-09-30 Wenlong Chen , Naoki Kiyohara , Harrison Bo Hua Zhu , Jacob Curran-Sebastian , Samir Bhatt , Yingzhen Li

This paper introduces warped Gaussian processes (WGP) regression in remote sensing applications. WGP models output observations as a parametric nonlinear transformation of a GP. The parameters of such prior model are then learned via…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Anna Mateo-Sanchis , Jordi Muñoz-Marí , Adrián Pérez-Suay , Gustau Camps-Valls

We employ Gaussian process (GP) regression to adjust for systematic errors in D3-type dispersion corrections introducing the associated, statistically improved model D3-GP. We generated a data set containing interaction energies for 1,248…

Chemical Physics · Physics 2019-12-03 Jonny Proppe , Stefan Gugler , Markus Reiher

We introduce a new class of inter-domain variational Gaussian processes (GP) where data is mapped onto the unit hypersphere in order to use spherical harmonic representations. Our inference scheme is comparable to variational Fourier…

Machine Learning · Statistics 2020-07-01 Vincent Dutordoir , Nicolas Durrande , James Hensman

Inducing-point-based sparse variational Gaussian processes have become the standard workhorse for scaling up GP models. Recent advances show that these methods can be improved by introducing a diagonal scaling matrix to the conditional…

Machine Learning · Statistics 2025-07-04 Thang D. Bui , Michalis K. Titsias

Gaussian processes (GPs) are nonparametric priors over functions. Fitting a GP implies computing a posterior distribution of functions consistent with the observed data. Similarly, deep Gaussian processes (DGPs) should allow us to compute a…

In this paper, we revisit batch state estimation through the lens of Gaussian process (GP) regression. We consider continuous-discrete estimation problems wherein a trajectory is viewed as a one-dimensional GP, with time as the independent…

Robotics · Computer Science 2014-12-02 Sean Anderson , Timothy D. Barfoot , Chi Hay Tong , Simo Särkkä

This thesis is mainly concerned with state-space approaches for solving deep (temporal) Gaussian process (DGP) regression problems. More specifically, we represent DGPs as hierarchically composed systems of stochastic differential equations…

Methodology · Statistics 2021-11-25 Zheng Zhao

Multifidelity models integrate data from multiple sources to produce a single approximator for the underlying process. Dense low-fidelity samples are used to reduce interpolation error, while sparse high-fidelity samples are used to…

Machine Learning · Statistics 2024-02-27 Viv Bone , Chris van der Heide , Kieran Mackle , Ingo H. J. Jahn , Peter M. Dower , Chris Manzie

Neural-net-induced Gaussian process (NNGP) regression inherits both the high expressivity of deep neural networks (deep NNs) as well as the uncertainty quantification property of Gaussian processes (GPs). We generalize the current NNGP to…

Machine Learning · Computer Science 2019-03-27 Guofei Pang , Liu Yang , George Em Karniadakis

Deep Gaussian processes (DGPs) are increasingly popular as predictive models in machine learning (ML) for their non-stationary flexibility and ability to cope with abrupt regime changes in training data. Here we explore DGPs as surrogates…

Methodology · Statistics 2021-08-27 Annie Sauer , Robert B. Gramacy , David Higdon

This work introduces the concept of parametric Gaussian processes (PGPs), which is built upon the seemingly self-contradictory idea of making Gaussian processes parametric. Parametric Gaussian processes, by construction, are designed to…

Machine Learning · Statistics 2017-05-08 Maziar Raissi

Deep Gaussian process models typically employ discrete hierarchies, but recent advancements in differential Gaussian processes (DiffGPs) have extended these models to infinite depths. However, existing DiffGP approaches often overlook the…

Machine Learning · Computer Science 2025-12-16 Jian Xu , Zhiqi Lin , Min Chen , Junmei Yang , Delu Zeng , John Paisley

Deep Gaussian Processes (DGPs) are hierarchical generalizations of Gaussian Processes that combine well calibrated uncertainty estimates with the high flexibility of multilayer models. One of the biggest challenges with these models is that…

Machine Learning · Statistics 2018-11-13 Marton Havasi , José Miguel Hernández-Lobato , Juan José Murillo-Fuentes

We investigate the connections between sparse approximation methods for making kernel methods and Gaussian processes (GPs) scalable to large-scale data, focusing on the Nystr\"om method and the Sparse Variational Gaussian Processes (SVGP).…

Machine Learning · Statistics 2023-02-09 Veit Wild , Motonobu Kanagawa , Dino Sejdinovic

We introduce Deep Sigma Point Processes, a class of parametric models inspired by the compositional structure of Deep Gaussian Processes (DGPs). Deep Sigma Point Processes (DSPPs) retain many of the attractive features of (variational)…

Machine Learning · Statistics 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Gaussian processes (GPs) are widely used as surrogate models for emulating computer code, which simulate complex physical phenomena. In many problems, additional boundary information (i.e., the behavior of the phenomena along input…

Methodology · Statistics 2019-08-26 Liang Ding , Simon Mak , C. F. Jeff Wu

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

Machine Learning · Computer Science 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

Gaussian processes (GPs) are popular nonparametric statistical models for learning unknown functions and quantifying the spatiotemporal uncertainty in data. Recent works have extended GPs to model scalar and vector quantities distributed…

Gaussian Processes (GPs) are powerful kernelized methods for non-parameteric regression used in many applications. However, their use is limited to a few thousand of training samples due to their cubic time complexity. In order to scale GPs…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon