English
Related papers

Related papers: Deep Intrinsic Coregionalization Multi-Output Gaus…

200 papers

Gaussian process (GP) surrogate modeling for large computer experiments is limited by cubic runtimes, especially with data from stochastic simulations with input-dependent noise. A popular workaround to reduce computational complexity…

Methodology · Statistics 2022-06-01 D Austin Cole , Robert B Gramacy , Mike Ludkovski

We introduce a scalable Gaussian process (GP) framework with deep product kernels for data-driven learning of parametrized spatio-temporal fields over fixed or parameter-dependent domains. The proposed framework learns a continuous…

Machine Learning · Computer Science 2026-03-03 Srinath Dama , Prasanth B. Nair

Computer models are used as a way to explore complex physical systems. Stationary Gaussian process emulators, with their accompanying uncertainty quantification, are popular surrogates for computer models. However, many computer models are…

Methodology · Statistics 2024-11-25 Faezeh Yazdi , Derek Bingham , Daniel Williamson

It is desirable to combine the expressive power of deep learning with Gaussian Process (GP) in one expressive Bayesian learning model. Deep kernel learning showed success in adopting a deep network for feature extraction followed by a GP…

Machine Learning · Computer Science 2021-10-26 Chi-Ken Lu , Patrick Shafto

We provide a survey of nonstationary surrogate models which utilize Gaussian processes (GPs) or variations thereof, including nonstationary kernel adaptations, partition and local GPs, and spatial warpings through deep Gaussian processes.…

Methodology · Statistics 2024-12-04 Annie S. Booth , Andrew Cooper , Robert B. Gramacy

Gaussian processes (GPs) offer a flexible, uncertainty-aware framework for modeling complex signals, but scale cubically with data, assume static targets, and are brittle to outliers, limiting their applicability in large-scale problems…

Machine Learning · Statistics 2025-09-23 Fernando Llorente , Daniel Waxman , Sanket Jantre , Nathan M. Urban , Susan E. Minkoff

We propose Deep Neural Coregionalization, a scalable framework for uncertainty-aware multivariate geostatistics. DNC models multivariate spatial effects through spatially varying latent factors and loadings, assigning deep Gaussian process…

Methodology · Statistics 2026-02-23 Yeseul Jeon , Aaron Scheffler , Rajarshi Guhaniyogi

This paper is concerned with a state-space approach to deep Gaussian process (DGP) regression. We construct the DGP by hierarchically putting transformed Gaussian process (GP) priors on the length scales and magnitudes of the next level of…

Machine Learning · Statistics 2021-09-24 Zheng Zhao , Muhammad Emzir , Simo Särkkä

Learning precise surrogate models of complex computer simulations and physical machines often require long-lasting or expensive experiments. Furthermore, the modeled physical dependencies exhibit nonlinear and nonstationary behavior.…

Machine Learning · Computer Science 2023-03-20 Matthias Bitzer , Mona Meister , Christoph Zimmer

This paper introduces an active learning framework for manifold Gaussian Process (GP) regression, combining manifold learning with strategic data selection to improve accuracy in high-dimensional spaces. Our method jointly optimizes a…

Machine Learning · Statistics 2026-05-12 Yuanxing Cheng , Lulu Kang , Yiwei Wang , Chun Liu

Deep Gaussian Process (DGP) as a model prior in Bayesian learning intuitively exploits the expressive power in function composition. DGPs also offer diverse modeling capabilities, but inference is challenging because marginalization in…

Machine Learning · Computer Science 2022-08-02 Chi-Ken Lu , Patrick Shafto

Gaussian Processes (GPs) are powerful non-parametric Bayesian regression models that allow exact posterior inference, but exhibit high computational and memory costs. In order to improve scalability of GPs, approximate posterior inference…

Machine Learning · Computer Science 2020-04-28 Martin Trapp , Robert Peharz , Franz Pernkopf , Carl E. Rasmussen

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

Gaussian processes (GPs) are a popular class of Bayesian nonparametric models, but its training can be computationally burdensome for massive training datasets. While there has been notable work on scaling up these models for big data,…

Methodology · Statistics 2023-11-16 Kevin Li , Simon Mak

Reliable uncertainty estimates are crucial in modern machine learning. Deep Gaussian Processes (DGPs) and Deep Sigma Point Processes (DSPPs) extend GPs hierarchically, offering promising methods for uncertainty quantification grounded in…

Machine Learning · Statistics 2025-04-25 Matthijs van der Lende , Jeremias Lino Ferrao , Niclas Müller-Hof

Gaussian process (GP) regression is a powerful probabilistic modeling technique with built-in uncertainty quantification. When one has access to multiple correlated simulations (tasks), it is common to fit a multitask GP (MTGP) surrogate…

Computation · Statistics 2026-03-18 Aleksei G. Sorokin , Pieterjan Robbe , Fred J. Hickernell

Multitask Gaussian processes (MTGP) are the Gaussian process (GP) framework's solution for multioutput regression problems in which the $T$ elements of the regressors cannot be considered conditionally independent given the observations.…

Machine Learning · Computer Science 2022-08-26 Óscar García-Hinde , Vanessa Gómez-Verdejo , Manel Martínez-Ramón

Understanding the structure of our universe and the distribution of matter is an area of active research. As cosmological surveys grow in complexity, the development of emulators to efficiently and effectively predict matter power spectra…

Applications · Statistics 2025-07-28 Stephen A. Walsh , Annie S. Booth , David Higdon , Jared Clark , Kelly R. Moran , Katrin Heitmann

In order to better model high-dimensional sequential data, we propose a collaborative multi-output Gaussian process dynamical system (CGPDS), which is a novel variant of GPDSs. The proposed model assumes that the output on each dimension is…

Machine Learning · Statistics 2019-06-11 Jing Zhao , Jingjing Fei , Shiliang Sun

Gaussian processes (GPs) can provide a principled approach to uncertainty quantification with easy-to-interpret kernel hyperparameters, such as the lengthscale, which controls the correlation distance of function values. However, selecting…