中文
相关论文

相关论文: Accelerated training of Gaussian processes using b…

200 篇论文

Gaussian processes (GPs) provide a nonparametric representation of functions. However, classical GP inference suffers from high computational cost for big data. In this paper, we propose a new Bayesian approach, EigenGP, that learns both…

机器学习 · 计算机科学 2015-07-14 Hao Peng , Yuan Qi

Gaussian Processes (GPs) provide powerful probabilistic frameworks for interpolation, forecasting, and smoothing, but have been hampered by computational scaling issues. Here we investigate data sampled on one dimension (e.g., a scalar or…

机器学习 · 统计学 2022-08-04 Jackson Loper , David Blei , John P. Cunningham , Liam Paninski

In this paper, we introduce an efficient sparse Gaussian process (E-SGP) for the surrogate modelling of fluid mechanics. This novel Bayesian machine learning algorithm allows efficient model training using databases of different structures.…

机器学习 · 计算机科学 2023-12-18 Yu Duan , Matthew Eaton , Michael Bluck

Gaussian process training decomposes into inference of the (approximate) posterior and learning of the hyperparameters. For non-Gaussian (non-conjugate) likelihoods, two common choices for approximate inference are Expectation Propagation…

机器学习 · 计算机科学 2022-11-14 Rui Li , ST John , Arno Solin

Gaussian Processes (GPs) provide a convenient framework for specifying function-space priors, making them a natural choice for modeling uncertainty. In contrast, Bayesian Neural Networks (BNNs) offer greater scalability and extendability…

机器学习 · 计算机科学 2025-06-12 Marcin Sendera , Amin Sorkhei , Tomasz Kuśmierczyk

Gaussian Processes (GPs) are highly expressive, probabilistic models. A major limitation is their computational complexity. Naively, exact GP inference requires $\mathcal{O}(N^3)$ computations with $N$ denoting the number of modeled points.…

机器学习 · 计算机科学 2022-06-23 Gordian Edenhofer , Reimar H. Leike , Philipp Frank , Torsten A. Enßlin

Gaussian process (GP) models are widely used to emulate propagation uncertainty in computer experiments. GP emulation sits comfortably within an analytically tractable Bayesian framework. Apart from propagating uncertainty of the input…

统计方法学 · 统计学 2015-01-30 Silvia Montagna , Surya T. Tokdar

Exact Gaussian Process (GP) regression has O(N^3) runtime for data size N, making it intractable for large N. Many algorithms for improving GP scaling approximate the covariance with lower rank matrices. Other work has exploited structure…

机器学习 · 统计学 2012-09-24 Elad Gilboa , Yunus Saatçi , John P. Cunningham

Gaussian process (GP) models are widely used to analyze spatially referenced data and to predict values at locations without observations. In contrast to many algorithmic procedures, GP models are based on a statistical framework, which…

统计计算 · 统计学 2020-01-01 Florian Gerber , Douglas W. Nychka

We present a theoretically grounded Gaussian process framework that leverages neural feature maps to construct expressive kernels. We show that the learned feature map can be interpreted as an optimal low-rank approximation to a Gram matrix…

机器学习 · 统计学 2026-05-12 Anthony Stephenson

Gaussian processes (GPs) are flexible models that can capture complex structure in large-scale dataset due to their non-parametric nature. However, the usage of GPs in real-world application is limited due to their high computational cost…

机器学习 · 统计学 2018-11-06 Congzheng Song , Yiming Sun

Inference in Gaussian process (GP) models is computationally challenging for large data, and often difficult to approximate with a small number of inducing points. We explore an alternative approximation that employs stochastic inference…

机器学习 · 统计学 2019-05-28 Jiaxin Shi , Mohammad Emtiyaz Khan , Jun Zhu

Generating simulated training data needed for constructing sufficiently accurate surrogate models to be used for efficient optimization or parameter identification can incur a huge computational effort in the offline phase. We consider a…

数值分析 · 数学 2024-04-03 Phillip Semler , Martin Weiser

In this paper we propose a novel Bayesian solution for nonlinear regression in complex fields. Previous solutions for kernels methods usually assume a complexification approach, where the real-valued kernel is replaced by a complex-valued…

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

机器学习 · 统计学 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

统计方法学 · 统计学 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

Gaussian processes (GPs) enable principled computation of model uncertainty, making them attractive for safety-critical applications. Such scenarios demand that GP decisions are not only accurate, but also robust to perturbations. In this…

机器学习 · 计算机科学 2021-04-08 Andrea Patane , Arno Blaas , Luca Laurenti , Luca Cardelli , Stephen Roberts , Marta Kwiatkowska

Gaussian processes are distributions over functions that are versatile and mathematically convenient priors in Bayesian modelling. However, their use is often impeded for data with large numbers of observations, $N$, due to the cubic (in…

机器学习 · 统计学 2020-08-04 David R. Burt , Carl Edward Rasmussen , Mark van der Wilk

Gaussian Process (GP) models provide a flexible framework for prediction and uncertainty quantification. For most covariance functions, however, exact GP prediction with $n$ points scales as $\mathcal{O}(n^3)$, making it prohibitively…

统计计算 · 统计学 2026-05-29 Samanyu Arora , Christopher J. Geoga

While Gaussian processes (GPs) are the method of choice for regression tasks, they also come with practical difficulties, as inference cost scales cubic in time and quadratic in memory. In this paper, we introduce a natural and expressive…

机器学习 · 计算机科学 2018-09-13 Martin Trapp , Robert Peharz , Carl E. Rasmussen , Franz Pernkopf