中文
相关论文

相关论文: A Sparse Expansion For Deep Gaussian Processes

200 篇论文

Gaussian processes are powerful models for probabilistic machine learning, but are limited in application by their $O(N^3)$ inference complexity. We propose a method for deriving parametric families of kernel functions with compact spatial…

机器学习 · 计算机科学 2020-06-09 Jarred Barber

This paper presents a probabilistic framework to obtain both reliable and fast uncertainty estimates for predictions with Deep Neural Networks (DNNs). Our main contribution is a practical and principled combination of DNNs with sparse…

机器人学 · 计算机科学 2021-09-22 Jongseok Lee , Jianxiang Feng , Matthias Humt , Marcus G. Müller , Rudolph Triebel

Gaussian processes (GPs) provide a nonparametric representation of functions. However, classical GP inference suffers from high computational cost and it is difficult to design nonstationary GP priors in practice. In this paper, we propose…

机器学习 · 计算机科学 2013-03-15 Yuan Qi , Bo Dai , Yao Zhu

Gaussian Processes (GPs) are powerful non-parametric Bayesian regression models that allow exact posterior inference, but exhibit high computational and memory costs. In order to improve scalability of GPs, approximate posterior inference…

机器学习 · 计算机科学 2020-04-28 Martin Trapp , Robert Peharz , Franz Pernkopf , Carl E. Rasmussen

Deep Gaussian processes have recently been proposed as natural objects to fit, similarly to deep neural networks, possibly complex features present in modern data samples, such as compositional structures. Adopting a Bayesian nonparametric…

统计理论 · 数学 2025-02-04 Ismaël Castillo , Thibault Randrianarisoa

Multi-task learning models using Gaussian processes (GP) have been developed and successfully applied in various applications. The main difficulty with this approach is the computational cost of inference using the union of examples from…

机器学习 · 计算机科学 2012-11-29 Yuyang Wang , Roni Khardon

In this paper we introduce deep Gaussian process (GP) models. Deep GPs are a deep belief network based on Gaussian process mappings. The data is modeled as the output of a multivariate GP. The inputs to that Gaussian process are then…

机器学习 · 统计学 2013-03-26 Andreas C. Damianou , Neil D. Lawrence

Multitask Gaussian processes (MTGP) are the Gaussian process (GP) framework's solution for multioutput regression problems in which the $T$ elements of the regressors cannot be considered conditionally independent given the observations.…

机器学习 · 计算机科学 2022-08-26 Óscar García-Hinde , Vanessa Gómez-Verdejo , Manel Martínez-Ramón

Deep Learning Gaussian Processes (DL-GP) are proposed as a methodology for analyzing (approximating) computer models that produce heteroskedastic and high-dimensional output. Computer simulation models have many areas of applications,…

应用统计 · 统计学 2022-09-07 Laura Schultz , Vadim Sokolov

We introduce a framework and early results for massively scalable Gaussian processes (MSGP), significantly extending the KISS-GP approach of Wilson and Nickisch (2015). The MSGP framework enables the use of Gaussian processes (GPs) on…

机器学习 · 计算机科学 2015-11-06 Andrew Gordon Wilson , Christoph Dann , Hannes Nickisch

Deep Gaussian Process (DGP) as a model prior in Bayesian learning intuitively exploits the expressive power in function composition. DGPs also offer diverse modeling capabilities, but inference is challenging because marginalization in…

机器学习 · 计算机科学 2022-08-02 Chi-Ken Lu , Patrick Shafto

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

统计方法学 · 统计学 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

With the development of new remote sensing technology, large or even massive spatial datasets covering the globe become available. Statistical analysis of such data is challenging. This article proposes a semiparametric approach to model…

统计方法学 · 统计学 2019-10-24 Pulong Ma , Emily L. Kang

Gaussian processes provide a compact representation for modeling and estimating an unknown function, that can be updated as new measurements of the function are obtained. This paper extends this powerful framework to the case where the…

系统与控制 · 电气工程与系统科学 2023-11-30 Jilles van Hulst , Roy van Zuijlen , Duarte Antunes , W. P. M. H. , Heemels

Multi-robot systems require scalable and federated methods to model complex environments under computational and communication constraints. Gaussian Processes (GPs) offer robust probabilistic modeling, but suffer from cubic computational…

多智能体系统 · 计算机科学 2026-02-13 Sanket A. Salunkhe , George P. Kontoudis

Distributed Gaussian process (DGP) is a popular approach to scale GP to big data which divides the training data into some subsets, performs local inference for each partition, and aggregates the results to acquire global prediction. To…

机器学习 · 计算机科学 2022-02-08 Hamed Jalali , Gjergji Kasneci

Parameter retrieval and model inversion are key problems in remote sensing and Earth observation. Currently, different approximations exist: a direct, yet costly, inversion of radiative transfer models (RTMs); the statistical inversion with…

信号处理 · 电气工程与系统科学 2021-04-22 Daniel Heestermans Svendsen , Pablo Morales-Alvarez , Ana Belen Ruescas , Rafael Molina , Gustau Camps-Valls

Sparse variational Gaussian process (SVGP) methods are a common choice for non-conjugate Gaussian process inference because of their computational benefits. In this paper, we improve their computational efficiency by using a dual…

机器学习 · 计算机科学 2022-01-20 Vincent Adam , Paul E. Chang , Mohammad Emtiyaz Khan , Arno Solin

The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension,…

机器学习 · 计算机科学 2023-09-06 Zhidi Lin , Juan Maroñas , Ying Li , Feng Yin , Sergios Theodoridis

This work introduces the Efficient Transformed Gaussian Process (ETGP), a new way of creating C stochastic processes characterized by: 1) the C processes are non-stationary, 2) the C processes are dependent by construction without needing a…

机器学习 · 计算机科学 2022-06-01 Juan Maroñas , Daniel Hernández-Lobato