English
Related papers

Related papers: Scalable Bayesian Inference for Generalized Linear…

200 papers

The edge partition model (EPM) is a generative model for extracting an overlapping community structure from static graph-structured data. In the EPM, the gamma process (GaP) prior is adopted to infer the appropriate number of latent…

Social and Information Networks · Computer Science 2024-03-04 Sikun Yang , Heinz Koeppl

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Bayesian inference methods such as Markov Chain Monte Carlo (MCMC) typically require repeated computations of the likelihood function, but in some scenarios this is infeasible and alternative methods are needed. Simulation-based inference…

Machine Learning · Computer Science 2025-12-10 Linnea M Wolniewicz , Peter Sadowski , Claudio Corti

We consider the problem of Bayesian inference for changepoints where the number and position of the changepoints are both unknown. In particular, we consider product partition models where it is possible to integrate out model parameters…

Computation · Statistics 2017-03-14 Alan Benson , Nial Friel

Stochastic gradient Markov chain Monte Carlo (SGMCMC) has become a popular method for scalable Bayesian inference. These methods are based on sampling a discrete-time approximation to a continuous time process, such as the Langevin…

Computation · Statistics 2018-10-29 Jack Baker , Paul Fearnhead , Emily B Fox , Christopher Nemeth

In the stochastic gradient descent (SGD) for sequential simulations such as the neural stochastic differential equations, the Multilevel Monte Carlo (MLMC) method is known to offer better theoretical computational complexity compared to the…

Machine Learning · Computer Science 2023-10-11 Kei Ishikawa

This work describes a domain embedding technique between two non-matching meshes used for generating realizations of spatially correlated random fields with applications to large-scale sampling-based uncertainty quantification. The goal is…

Numerical Analysis · Mathematics 2017-12-20 Sarah Osborn , Patrick Zulian , Thomas Benson , Umberto Villa , Rolf Krause , Panayot S. Vassilevski

It is well known that Markov chain Monte Carlo (MCMC) methods scale poorly with dataset size. A popular class of methods for solving this issue is stochastic gradient MCMC. These methods use a noisy estimate of the gradient of the log…

Computation · Statistics 2017-12-15 Jack Baker , Paul Fearnhead , Emily B. Fox , Christopher Nemeth

This article presents an approach to Bayesian semiparametric inference for Gaussian multivariate response regression. We are motivated by various small and medium dimensional problems from the physical and social sciences. The statistical…

Methodology · Statistics 2020-06-18 Georgios Papageorgiou , Benjamin C. Marshall

To conduct Bayesian inference with large data sets, it is often convenient or necessary to distribute the data across multiple machines. We consider a likelihood function expressed as a product of terms, each associated with a subset of the…

Computation · Statistics 2020-04-09 Lewis J. Rendell , Adam M. Johansen , Anthony Lee , Nick Whiteley

Quasi-Monte Carlo (QMC) methods for estimating integrals are attractive since the resulting estimators typically converge at a faster rate than pseudo-random Monte Carlo. However, they can be difficult to set up on arbitrary posterior…

Statistics Theory · Mathematics 2018-10-03 Tobias Schwedes , Ben Calderhead

Bayesian inference in state-space models is challenging due to high-dimensional state trajectories. A viable approach is particle Markov chain Monte Carlo, combining MCMC and sequential Monte Carlo to form "exact approximations" to…

Computation · Statistics 2022-10-27 Anna Wigren , Riccardo Sven Risuleo , Lawrence Murray , Fredrik Lindsten

This work introduces a Bayesian methodology for fitting large discrete graphical models with spike-and-slab priors to encode sparsity. We consider a quasi-likelihood approach that enables node-wise parallel computation resulting in reduced…

Methodology · Statistics 2019-10-21 Anwesha Bhattacharyya , Yves Atchade

The Markov Chain Monte Carlo (MCMC) algorithm is a widely recognised as an efficient method for sampling a specified posterior distribution. However, when the posterior is multi-modal, conventional MCMC algorithms either tend to become…

Instrumentation and Methods for Astrophysics · Physics 2014-08-19 Yi-Ming Hu , Martin Hendry , Ik Siong Heng

Markov chain Monte Carlo (MCMC) allows one to generate dependent replicates from a posterior distribution for effectively any Bayesian hierarchical model. However, MCMC can produce a significant computational burden. This motivates us to…

Methodology · Statistics 2023-05-22 Jonathan R. Bradley , Madelyn Clinch

Latent Gaussian models (LGMs) are a popular class of Bayesian hierarchical models that include Gaussian processes, as well as certain spatial models and mixed-effect models. Efficient Bayesian inference of LGMs often requires marginalizing…

Machine Learning · Statistics 2026-05-21 Jinlin Lai , Charles C. Margossian , Daniel R. Sheldon

Recent advances in Markov chain Monte Carlo (MCMC) extend the scope of Bayesian inference to models for which the likelihood function is intractable. Although these developments allow us to estimate model parameters, other basic problems…

Computation · Statistics 2019-12-12 Minh-Ngoc Tran , Marcel Scharth , David Gunawan , Robert Kohn , Scott D. Brown , Guy E. Hawkins

Inference on the minimum clinically important difference, or MCID, is an important practical problem in medicine. The basic idea is that a treatment being statistically significant may not lead to an improvement in the patients' well-being.…

Methodology · Statistics 2022-08-29 Pei-Shien Wu , Ryan Martin

There has been considerable interest in making Bayesian inference more scalable. In big data settings, most literature focuses on reducing the computing time per iteration, with less focused on reducing the number of iterations needed in…

Methodology · Statistics 2017-09-28 Leo L. Duan , James E. Johndrow , David B. Dunson

Stochastic gradient Markov chain Monte Carlo (SG-MCMC) methods are Bayesian analogs to popular stochastic optimization methods; however, this connection is not well studied. We explore this relationship by applying simulated annealing to an…

Machine Learning · Statistics 2016-08-08 Changyou Chen , David Carlson , Zhe Gan , Chunyuan Li , Lawrence Carin