中文
相关论文

相关论文: Fixed-Mean Gaussian Processes for Post-hoc Bayesia…

200 篇论文

Gaussian process (GP) regression is a powerful probabilistic modeling technique with built-in uncertainty quantification. When one has access to multiple correlated simulations (tasks), it is common to fit a multitask GP (MTGP) surrogate…

统计计算 · 统计学 2026-03-18 Aleksei G. Sorokin , Pieterjan Robbe , Fred J. Hickernell

Deep Gaussian processes (DGPs) are popular surrogate models for complex nonstationary computer experiments. DGPs use one or more latent Gaussian processes (GPs) to warp the input space into a plausibly stationary regime, then use typical GP…

统计方法学 · 统计学 2025-12-23 Annie S. Booth

Deep neural networks (DNN) and Gaussian processes (GP) are two powerful models with several theoretical connections relating them, but the relationship between their training methods is not well understood. In this paper, we show that…

机器学习 · 统计学 2020-07-21 Mohammad Emtiyaz Khan , Alexander Immer , Ehsan Abedi , Maciej Korzepa

Bayesian neural networks (BNN) and deep ensembles are principled approaches to estimate the predictive uncertainty of a deep learning model. However their practicality in real-time, industrial-scale applications are limited due to their…

机器学习 · 计算机科学 2020-10-27 Jeremiah Zhe Liu , Zi Lin , Shreyas Padhy , Dustin Tran , Tania Bedrax-Weiss , Balaji Lakshminarayanan

The growing demand for accurate, efficient, and scalable solutions in computational mechanics highlights the need for advanced operator learning algorithms that can efficiently handle large datasets while providing reliable uncertainty…

机器学习 · 统计学 2024-09-18 Sawan Kumar , Rajdip Nayek , Souvik Chakraborty

The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially…

机器学习 · 统计学 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Deep Gaussian Processes (DGPs) are hierarchical generalizations of Gaussian Processes that combine well calibrated uncertainty estimates with the high flexibility of multilayer models. One of the biggest challenges with these models is that…

Sequential learning with Gaussian processes (GPs) is challenging when access to past data is limited, for example, in continual and active learning. In such cases, errors can accumulate over time due to inaccuracies in the posterior,…

机器学习 · 计算机科学 2023-06-07 Paul E. Chang , Prakhar Verma , S. T. John , Arno Solin , Mohammad Emtiyaz Khan

Deep Gaussian Processes (DGPs) are multi-layer, flexible extensions of Gaussian processes but their training remains challenging. Sparse approximations simplify the training but often require optimization over a large number of inducing…

机器学习 · 统计学 2021-07-20 Ayush Jain , P. K. Srijith , Mohammad Emtiyaz Khan

Gaussian Processes (GP) have become popular machine-learning methods for kernel-based learning on datasets with complicated covariance structures. In this paper, we present a novel extension to the GP framework using a contaminated normal…

机器学习 · 计算机科学 2024-07-03 Daniel Iong , Matthew McAnear , Yuezhou Qu , Shasha Zou , Gabor Toth , Yang Chen

We propose a nested Gaussian process (nGP) as a locally adaptive prior for Bayesian nonparametric regression. Specified through a set of stochastic differential equations (SDEs), the nGP imposes a Gaussian process prior for the function's…

统计方法学 · 统计学 2012-01-24 Bin Zhu , David B. Dunson

Deep Gaussian processes (DGPs), a hierarchical composition of GP models, have successfully boosted the expressive power of their single-layer counterpart. However, it is impossible to perform exact inference in DGPs, which has motivated the…

机器学习 · 计算机科学 2021-05-27 Haibin Yu , Dapeng Liu , Yizhou Chen , Bryan Kian Hsiang Low , Patrick Jaillet

Gaussian Processes (GPs) can be used as flexible, non-parametric function priors. Inspired by the growing body of work on Normalizing Flows, we enlarge this class of priors through a parametric invertible transformation that can be made…

机器学习 · 计算机科学 2021-02-26 Juan Maroñas , Oliver Hamelijnck , Jeremias Knoblauch , Theodoros Damoulas

The Gaussian process (GP) is a popular statistical technique for stochastic function approximation and uncertainty quantification from data. GPs have been adopted into the realm of machine learning in the last two decades because of their…

机器学习 · 统计学 2024-10-02 Marcus M. Noack , Hengrui Luo , Mark D. Risser

In recent years, the increasing size of deep learning models and their growing demand for computational resources have drawn significant attention to the practice of pruning neural networks, while aiming to preserve their accuracy. In…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Lingkai Zhu , Can Deniz Bezek , Orcun Goksel

We present Flow-Induced Diagonal Gaussian Processes (FiD-GP), a compression framework that incorporates a compact inducing weight matrix to project a neural network's weight uncertainty into a lower-dimensional subspace. Critically, FiD-GP…

机器学习 · 计算机科学 2025-10-06 Moule Lin , Andrea Patane , Weipeng Jing , Shuhao Guan , Goetz Botterweck

In spite of the diverse literature on nonstationary spatial modeling and approximate Gaussian process (GP) methods, there are no general approaches for conducting fully Bayesian inference for moderately sized nonstationary spatial data sets…

统计计算 · 统计学 2020-07-01 Mark D. Risser , Daniel Turek

Gaussian processes (GPs) are a good choice for function approximation as they are flexible, robust to over-fitting, and provide well-calibrated predictive uncertainty. Deep Gaussian processes (DGPs) are multi-layer generalisations of GPs,…

机器学习 · 统计学 2017-11-15 Hugh Salimbeni , Marc Deisenroth

Gaussian Processes (GPs) are Bayesian models that provide uncertainty estimates associated to the predictions made. They are also very flexible due to their non-parametric nature. Nevertheless, GPs suffer from poor scalability as the number…

机器学习 · 计算机科学 2021-07-16 Bahram Jafrasteh , Carlos Villacampa-Calvo , Daniel Hernández-Lobato

This research proposes a flexible Bayesian extension of the composite Gaussian process (CGP) model of Ba and Joseph (2012) for predicting (stationary or) non-stationary $y(\mathbf{x})$. The CGP generalizes the regression plus stationary…

统计方法学 · 统计学 2019-06-27 Casey B. Davis , Christopher M. Hans , Thomas J. Santner