中文
相关论文

相关论文: A Sparse Expansion For Deep Gaussian Processes

200 篇论文

This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of…

机器学习 · 统计学 2021-09-24 Zheng Zhao , Muhammad Emzir , Simo Särkkä

Spatial process models for analyzing geostatistical data entail computations that become prohibitive as the number of spatial locations become large. This manuscript develops a class of highly scalable Nearest Neighbor Gaussian Process…

统计方法学 · 统计学 2016-01-05 Abhirup Datta , Sudipto Banerjee , Andrew O. Finley , Alan E. Gelfand

We introduce Deep Sigma Point Processes, a class of parametric models inspired by the compositional structure of Deep Gaussian Processes (DGPs). Deep Sigma Point Processes (DSPPs) retain many of the attractive features of (variational)…

机器学习 · 统计学 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

We present a multi-task learning formulation for Deep Gaussian processes (DGPs), through non-linear mixtures of latent processes. The latent space is composed of private processes that capture within-task information and shared processes…

机器学习 · 统计学 2020-02-25 Ayman Boustati , Theodoros Damoulas , Richard S. Savage

Fitting a theoretical model to experimental data in a Bayesian manner using Markov chain Monte Carlo typically requires one to evaluate the model thousands (or millions) of times. When the model is a slow-to-compute physics simulation,…

机器学习 · 统计学 2022-08-25 Steven Stetzler , Michael Grosskopf , Earl Lawrence

Variational inference is a powerful tool for approximate inference, and it has been recently applied for representation learning with deep generative models. We develop the variational Gaussian process (VGP), a Bayesian nonparametric…

机器学习 · 统计学 2016-04-19 Dustin Tran , Rajesh Ranganath , David M. Blei

Deep Gaussian processes (DGPs) provide a robust paradigm for Bayesian deep learning. In DGPs, a set of sparse integration locations called inducing points are selected to approximate the posterior distribution of the model. This is done to…

机器学习 · 计算机科学 2024-07-25 Jian Xu , Delu Zeng , John Paisley

This paper introduces deep Gaussian processes (DGPs) for geophysical parameter retrieval. Unlike the standard full GP model, the DGP accounts for complicated (modular, hierarchical) processes, provides an efficient solution that scales well…

Gaussian processes (GPs) are frequently used in machine learning and statistics to construct powerful models. However, when employing GPs in practice, important considerations must be made, regarding the high computational burden,…

统计计算 · 统计学 2021-03-08 Karla Monterrubio-Gómez , Sara Wade

Neural-net-induced Gaussian process (NNGP) regression inherits both the high expressivity of deep neural networks (deep NNs) as well as the uncertainty quantification property of Gaussian processes (GPs). We generalize the current NNGP to…

机器学习 · 计算机科学 2019-03-27 Guofei Pang , Liu Yang , George Em Karniadakis

Gaussian Processes (GPs) are Bayesian models that provide uncertainty estimates associated to the predictions made. They are also very flexible due to their non-parametric nature. Nevertheless, GPs suffer from poor scalability as the number…

机器学习 · 计算机科学 2021-07-16 Bahram Jafrasteh , Carlos Villacampa-Calvo , Daniel Hernández-Lobato

We propose DistGP: a multi-robot learning method for collaborative learning of a global function using only local experience and computation. We utilise a sparse Gaussian process (GP) model with a factorisation that mirrors the multi-robot…

机器人学 · 计算机科学 2026-03-10 Seth Nabarro , Mark van der Wilk , Andrew J. Davison

Learning mappings between functional spaces, also known as function-on-function regression, is a fundamental problem in functional data analysis with broad applications, including spatiotemporal forecasting, curve prediction, and climate…

机器学习 · 计算机科学 2026-04-07 Matthew Lowery , Zhitong Xu , Da Long , Keyan Chen , Daniel S. Johnson , Yang Bai , Varun Shankar , Shandian Zhe

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

机器学习 · 统计学 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Gaussian processes (GPs) are a popular class of Bayesian nonparametric models, but its training can be computationally burdensome for massive training datasets. While there has been notable work on scaling up these models for big data,…

统计方法学 · 统计学 2023-11-16 Kevin Li , Simon Mak

Inference in Gaussian process (GP) models is computationally challenging for large data, and often difficult to approximate with a small number of inducing points. We explore an alternative approximation that employs stochastic inference…

机器学习 · 统计学 2019-05-28 Jiaxin Shi , Mohammad Emtiyaz Khan , Jun Zhu

In this paper we introduce a novel model for Gaussian process (GP) regression in the fully Bayesian setting. Motivated by the ideas of sparsification, localization and Bayesian additive modeling, our model is built around a recursive…

统计理论 · 数学 2022-06-06 Hengrui Luo , Giovanni Nattino , Matthew T. Pratola

Gaussian processes (GPs) provide a nonparametric representation of functions. However, classical GP inference suffers from high computational cost for big data. In this paper, we propose a new Bayesian approach, EigenGP, that learns both…

机器学习 · 计算机科学 2015-07-14 Hao Peng , Yuan Qi

Deep Gaussian process models typically employ discrete hierarchies, but recent advancements in differential Gaussian processes (DiffGPs) have extended these models to infinite depths. However, existing DiffGP approaches often overlook the…

机器学习 · 计算机科学 2025-12-16 Jian Xu , Zhiqi Lin , Min Chen , Junmei Yang , Delu Zeng , John Paisley

This thesis is mainly concerned with state-space approaches for solving deep (temporal) Gaussian process (DGP) regression problems. More specifically, we represent DGPs as hierarchically composed systems of stochastic differential equations…

统计方法学 · 统计学 2021-11-25 Zheng Zhao