English
Related papers

Related papers: Scalable Bayesian Transformed Gaussian Processes

200 papers

We consider the problem of sampling from a product-of-experts-type model that encompasses many standard prior and posterior distributions commonly found in Bayesian imaging. We show that this model can be easily lifted into a novel latent…

Image and Video Processing · Electrical Eng. & Systems 2026-04-16 Muhamed Kuric , Martin Zach , Andreas Habring , Michael Unser , Thomas Pock

Gaussian processes (GPs) are Bayesian non-parametric models useful in a myriad of applications. Despite their popularity, the cost of GP predictions (quadratic storage and cubic complexity with respect to the number of training points)…

Machine Learning · Computer Science 2022-05-24 Alec M. Dunton , Benjamin W. Priest , Amanda Muyskens

Bayesian methods in machine learning, such as Gaussian processes, have great advantages com-pared to other techniques. In particular, they provide estimates of the uncertainty associated with a prediction. Extending the Bayesian approach to…

Quantum Physics · Physics 2019-05-20 Zhikuan Zhao , Alejandro Pozas-Kerstjens , Patrick Rebentrost , Peter Wittek

Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are nonparametric probabilistic models…

Gaussian graphical models are widely used to infer dependence structures. Bayesian methods are appealing to quantify uncertainty associated with structural learning, i.e., the plausibility of conditional independence statements given the…

Methodology · Statistics 2025-11-05 Deborah Sulem , Jack Jewson , David Rossell

We introduce a Bayesian Gaussian process latent variable model that explicitly captures spatial correlations in data using a parameterized spatial kernel and leveraging structure-exploiting algebra on the model covariance matrices for…

Machine Learning · Statistics 2018-05-23 Steven Atkinson , Nicholas Zabaras

The Gaussian process (GP) regression model is a widely employed surrogate modeling technique for computer experiments, offering precise predictions and statistical inference for the computer simulators that generate experimental data.…

Methodology · Statistics 2024-04-02 Lulu Kang , Yuanxing Cheng , Yiwei Wang , Chun Liu

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Computer Science 2014-08-12 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Statistics 2013-05-27 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

Researchers increasingly wish to estimate time-varying parameter (TVP) regressions which involve a large number of explanatory variables. Including prior information to mitigate over-parameterization concerns has led to many using Bayesian…

Econometrics · Economics 2020-02-25 Florian Huber , Gary Koop , Michael Pfarrhofer

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when…

Methodology · Statistics 2018-02-14 Daniela Calvetti , Matthew M. Dunlop , Erkki Somersalo , Andrew M. Stuart

Fitting a theoretical model to experimental data in a Bayesian manner using Markov chain Monte Carlo typically requires one to evaluate the model thousands (or millions) of times. When the model is a slow-to-compute physics simulation,…

Machine Learning · Statistics 2022-08-25 Steven Stetzler , Michael Grosskopf , Earl Lawrence

\noindent Hyper-parameter selection is a central practical problem in modern machine learning, governing regularization strength, model capacity, and robustness choices. Cross-validation is often computationally prohibitive at scale, while…

Machine Learning · Statistics 2025-12-24 Hedibert Lopes , Nick Polson , Vadim Sokolov

Gaussian process (GP) models provide a powerful tool for prediction but are computationally prohibitive using large data sets. In such scenarios, one has to resort to approximate methods. We derive an approximation based on a composite…

Machine Learning · Statistics 2018-02-02 Xiuming Liu , Dave Zachariah , Edith C. H. Ngai

In this paper, we propose an analytical method for performing tractable approximate Gaussian inference (TAGI) in Bayesian neural networks. The method enables the analytical Gaussian inference of the posterior mean vector and diagonal…

Machine Learning · Computer Science 2021-12-08 James-A. Goulet , Luong Ha Nguyen , Saeid Amiri

Real engineering and scientific applications often involve one or more qualitative inputs. Standard Gaussian processes (GPs), however, cannot directly accommodate qualitative inputs. The recently introduced latent variable Gaussian process…

Machine Learning · Statistics 2023-03-21 Suraj Yerramilli , Akshay Iyer , Wei Chen , Daniel W. Apley

We consider nonparametric Bayesian estimation inference using a rescaled smooth Gaussian field as a prior for a multidimensional function. The rescaling is achieved using a Gamma variable and the procedure can be viewed as choosing an…

Statistics Theory · Mathematics 2009-08-26 A. W. van der Vaart , J. H. van Zanten

Variable selection in Gaussian processes (GPs) is typically undertaken by thresholding the inverse lengthscales of automatic relevance determination kernels, but in high-dimensional datasets this approach can be unreliable. A more…

Machine Learning · Statistics 2022-02-25 Hugh Dance , Brooks Paige

Gaussian process (GP) models have received increasing attention in recent years due to their superb prediction accuracy and modeling flexibility. To address the computational burdens of GP models for large-scale datasets, distributed…

Machine Learning · Statistics 2026-02-11 Haoyuan Chen , Rui Tuo