English
Related papers

Related papers: Pseudo-Marginal Bayesian Inference for Gaussian Pr…

200 papers

We consider priors for several nonparametric Bayesian models which use finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

Markov chain Monte Carlo (MCMC) algorithms have become powerful tools for Bayesian inference. However, they do not scale well to large-data problems. Divide-and-conquer strategies, which split the data into batches and, for each batch, run…

Computation · Statistics 2017-07-18 Christopher Nemeth , Chris Sherlock

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

Machine Learning · Statistics 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Bayesian methods for learning Gaussian graphical models offer a principled framework for quantifying model uncertainty and incorporating prior knowledge. However, their scalability is constrained by the computational cost of jointly…

Methodology · Statistics 2025-08-28 Reza Mohammadi , Marit Schoonhoven , Lucas Vogels , S. Ilker Birbil

We deal with Bayesian inference for Beta autoregressive processes. We restrict our attention to the class of conditionally linear processes. These processes are particularly suitable for forecasting purposes, but are difficult to estimate…

Statistics Theory · Mathematics 2010-08-03 R. Casarin , L. Dalla Valle , F. Leisen

Gaussian processes (GPs) are widely used metamodels for approximating expensive computer simulations, particularly in engineering design and spatial prediction. However, their performance can deteriorate significantly when covariance…

Computation · Statistics 2025-11-17 Ayumi Mutoh , Junoh Heo

We propose a determinant-free approach for simulation-based Bayesian inference in high-dimensional Gaussian models. We introduce auxiliary variables with covariance equal to the inverse covariance of the model. The joint probability of the…

Computation · Statistics 2017-09-12 Louis Ellam , Heiko Strathmann , Mark Girolami , Iain Murray

Predictive models for binary data are fundamental in various fields, and the growing complexity of modern applications has motivated several flexible specifications for modeling the relationship between the observed predictors and the…

Computation · Statistics 2022-01-31 Jian Cao , Daniele Durante , Marc G. Genton

Bayesian low-rank matrix factorization techniques have become an essential tool for relational data analysis and matrix completion. A standard approach is to assign zero-mean Gaussian priors on the columns or rows of factor matrices to…

Machine Learning · Statistics 2020-11-11 Saibal De , Hadi Salehi , Alex Gorodetsky

Increasingly complex applications involve large datasets in combination with non-linear and high dimensional mathematical models. In this context, statistical inference is a challenging issue that calls for pragmatic approaches that take…

Data Analysis, Statistics and Probability · Physics 2013-01-31 Andreas Raue , Clemens Kreutz , Fabian Joachim Theis , Jens Timmer

We introduce a novel Bayesian approach for variable selection using Gaussian process regression, which is crucial for enhancing interpretability and model regularization. Our method employs nearest neighbor Gaussian processes, serving as…

Given a set of moment restrictions (MRs) that overidentify a parameter $\theta$, we investigate a semiparametric Bayesian approach for inference on $\theta$ that does not restrict the data distribution $F$ apart from the MRs. As main…

Statistics Theory · Mathematics 2019-09-11 Jean-Pierre Florens , Anna Simoni

Gaussian processes retain the linear model either as a special case, or in the limit. We show how this relationship can be exploited when the data are at least partially linear. However from the perspective of the Bayesian posterior, the…

Methodology · Statistics 2008-07-13 Robert B. Gramacy , Herbert K. H. Lee

Gaussian process (GP) models form a core part of probabilistic machine learning. Considerable research effort has been made into attacking three issues with GP models: how to compute efficiently when the number of data is large; how to…

Machine Learning · Statistics 2015-06-15 James Hensman , Alexander G. de G. Matthews , Maurizio Filippone , Zoubin Ghahramani

Gaussian process priors are a popular choice for Bayesian analysis of regression problems. However, the implementation of these models can be complex, and ensuring that the implementation is correct can be challenging. In this paper we…

Machine Learning · Computer Science 2021-10-29 John Mcleod , Fergus Simpson

Gaussian processes are valuable tools for non-parametric modelling, where typically an assumption of stationarity is employed. While removing this assumption can improve prediction, fitting such models is challenging. In this work,…

Computation · Statistics 2019-05-02 Karla Monterrubio-Gómez , Lassi Roininen , Sara Wade , Theo Damoulas , Mark Girolami

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

Recent advances in stochastic gradient variational inference have made it possible to perform variational Bayesian inference with posterior approximations containing auxiliary random variables. This enables us to explore a new synthesis of…

Computation · Statistics 2015-05-20 Tim Salimans , Diederik P. Kingma , Max Welling