中文
相关论文

相关论文: A Sparse Expansion For Deep Gaussian Processes

200 篇论文

The Gaussian process (GP) is a nonparametric prior distribution over functions indexed by time, space, or other high-dimensional index set. The GP is a flexible model yet its limitation is given by its very nature: it can only model…

机器学习 · 统计学 2019-07-15 Gonzalo Rios , Felipe Tobar

Sparse pseudo-point approximations for Gaussian process (GP) models provide a suite of methods that support deployment of GPs in the large data regime and enable analytic intractabilities to be sidestepped. However, the field lacks a…

机器学习 · 统计学 2017-11-15 Thang D. Bui , Cuong V. Nguyen , Richard E. Turner

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

机器学习 · 统计学 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

We develop deep Poisson-gamma dynamical systems (DPGDS) to model sequentially observed multivariate count data, improving previously proposed models by not only mining deep hierarchical latent structure from the data, but also capturing…

机器学习 · 统计学 2019-01-03 Dandan Guo , Bo Chen , Hao Zhang , Mingyuan Zhou

The use of Gaussian process models is typically limited to datasets with a few tens of thousands of observations due to their complexity and memory footprint. The two most commonly used methods to overcome this limitation are 1) the…

机器学习 · 统计学 2020-01-16 Vincent Adam , Stefanos Eleftheriadis , Nicolas Durrande , Artem Artemev , James Hensman

In this paper, we introduce an efficient sparse Gaussian process (E-SGP) for the surrogate modelling of fluid mechanics. This novel Bayesian machine learning algorithm allows efficient model training using databases of different structures.…

机器学习 · 计算机科学 2023-12-18 Yu Duan , Matthew Eaton , Michael Bluck

We propose a representation of Gaussian processes (GPs) based on powers of the integral operator defined by a kernel function, we call these stochastic processes integral Gaussian processes (IGPs). Sample paths from IGPs are functions…

机器学习 · 统计学 2019-03-08 Zilong Tan , Sayan Mukherjee

In many areas of science and engineering, computer simulations are widely used as proxies for physical experiments, which can be infeasible or unethical. Such simulations can often be computationally expensive, and an emulator can be…

机器学习 · 统计学 2023-02-03 Tao Tang , Simon Mak , David Dunson

We introduce a novel stochastic variational inference method for Gaussian process ($\mathcal{GP}$) regression, by deriving a posterior over a learnable set of coresets: i.e., over pseudo-input/output, weighted pairs. Unlike former free-form…

机器学习 · 计算机科学 2025-03-06 Mert Ketenci , Adler Perotte , Noémie Elhadad , Iñigo Urteaga

We introduce new Gaussian Process (GP) high-order approximations to linear operations that are frequently used in various numerical methods. Our method employs the kernel-based GP regression modeling, a non-parametric Bayesian approach to…

计算物理 · 物理学 2025-06-09 Christopher DeGrendele , Dongwook Lee

Gaussian processes (GPs) play an essential role in biostatistics, scientific machine learning, and Bayesian optimization for their ability to provide probabilistic predictions and model uncertainty. However, GP inference struggles to scale…

The class of Gaussian Process (GP) methods for Temporal Difference learning has shown promise for data-efficient model-free Reinforcement Learning. In this paper, we consider a recent variant of the GP-SARSA algorithm, called Sparse…

机器学习 · 计算机科学 2018-11-20 John Martin , Brendan Englot

A multi-layer deep Gaussian process (DGP) model is a hierarchical composition of GP models with a greater expressive power. Exact DGP inference is intractable, which has motivated the recent development of deterministic and stochastic…

机器学习 · 计算机科学 2019-10-29 Haibin Yu , Yizhou Chen , Zhongxiang Dai , Kian Hsiang Low , Patrick Jaillet

We propose an efficient optimization algorithm for selecting a subset of training data to induce sparsity for Gaussian process regression. The algorithm estimates an inducing set and the hyperparameters using a single objective, either the…

机器学习 · 计算机科学 2013-11-12 Yanshuai Cao , Marcus A. Brubaker , David J. Fleet , Aaron Hertzmann

While much research effort has been dedicated to scaling up sparse Gaussian process (GP) models based on inducing variables for big data, little attention is afforded to the other less explored class of low-rank GP approximations that…

机器学习 · 统计学 2016-11-21 Quang Minh Hoang , Trong Nghia Hoang , Kian Hsiang Low

Geostatistics is a branch of statistics concerned with stochastic processes over continuous domains, with Gaussian processes (GPs) providing a flexible and principled modelling framework. However, the high computational cost of simulating…

统计计算 · 统计学 2026-03-20 Flávio B. Gonçalves , Marcos O. Prates , Gareth O. Roberts

Gaussian process (GP) models have received increasing attention in recent years due to their superb prediction accuracy and modeling flexibility. To address the computational burdens of GP models for large-scale datasets, distributed…

机器学习 · 统计学 2026-02-11 Haoyuan Chen , Rui Tuo

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

机器学习 · 统计学 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

Gaussian processes (GPs) are non-parametric, flexible, models that work well in many tasks. Combining GPs with deep learning methods via deep kernel learning (DKL) is especially compelling due to the strong representational power induced by…

机器学习 · 计算机科学 2021-07-14 Idan Achituve , Aviv Navon , Yochai Yemini , Gal Chechik , Ethan Fetaya

We propose a parallelizable sparse inverse formulation Gaussian process (SpInGP) for temporal models. It uses a sparse precision GP formulation and sparse matrix routines to speed up the computations. Due to the state-space formulation used…

机器学习 · 统计学 2017-09-29 Alexander Grigorievskiy , Neil Lawrence , Simo Särkkä