English
Related papers

Related papers: Using deterministic approximations to accelerate S…

200 papers

Driven by the critical needs of biomanufacturing 4.0, we introduce a probabilistic knowledge graph hybrid model characterizing the risk- and science-based understanding of bioprocess mechanisms. It can faithfully capture the important…

Machine Learning · Statistics 2022-10-03 Wei Xie , Keqi Wang , Hua Zheng , Ben Feng

Sequential Monte Carlo (SMC) methods offer a principled approach to Bayesian uncertainty quantification but are traditionally limited by the need for full-batch gradient evaluations. We introduce a scalable variant by incorporating…

Machine Learning · Statistics 2025-05-20 Andrew Millard , Zheng Zhao , Joshua Murphy , Simon Maskell

Sequential Monte Carlo samplers represent a compelling approach to posterior inference in Bayesian models, due to being parallelisable and providing an unbiased estimate of the posterior normalising constant. In this work, we significantly…

Methodology · Statistics 2022-11-24 Samuel Duffield , Sumeetpal S. Singh

Deriving Bayesian inference for exponential random graph models (ERGMs) is a challenging "doubly intractable" problem as the normalizing constants of the likelihood and posterior density are both intractable. Markov chain Monte Carlo (MCMC)…

Computation · Statistics 2019-11-26 Linda S. L. Tan , Nial Friel

We consider the problem of Bayesian parameter estimation for deep neural networks, which is important in problem settings where we may have little data, and/ or where we need accurate posterior predictive densities, e.g., for applications…

Machine Learning · Computer Science 2015-11-10 Anoop Korattikara , Vivek Rathod , Kevin Murphy , Max Welling

Symbolic regression is a powerful tool for discovering governing equations directly from data, but its sensitivity to noise hinders its broader application. This paper introduces a Sequential Monte Carlo (SMC) framework for Bayesian…

Machine Learning · Computer Science 2025-12-12 Geoffrey F. Bomarito , Patrick E. Leser

Many statistical models can be simulated forwards but have intractable likelihoods. Approximate Bayesian Computation (ABC) methods are used to infer properties of these models from data. Traditionally these methods approximate the posterior…

Machine Learning · Statistics 2018-04-03 George Papamakarios , Iain Murray

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte…

Computation · Statistics 2017-10-13 Richard G. Everitt , Dennis Prangle , Philip Maybank , Mark Bell

The advantages of sequential Monte Carlo (SMC) are exploited to develop parameter estimation and model selection methods for GARCH (Generalized AutoRegressive Conditional Heteroskedasticity) style models. It provides an alternative method…

Applications · Statistics 2020-03-06 Dan Li , Adam Clements , Christopher Drovandi

We present a sequential Monte Carlo sampler algorithm for the Bayesian analysis of generalised linear mixed models (GLMMs). These models support a variety of interesting regression-type analyses, but performing inference is often extremely…

Computation · Statistics 2008-10-08 Y. Fan , D. S. Leslie , M. P. Wand

We consider continuous-time diffusion models driven by fractional Brownian motion. Observations are assumed to possess a non-trivial likelihood given the latent path. Due to the non-Markovianity and high-dimensionality of the latent paths,…

Methodology · Statistics 2015-03-25 Alexandros Beskos , Joseph Dureau , Konstantinos Kalogeropoulos

Despite recent advances, sampling-based inference for Bayesian Neural Networks (BNNs) remains a significant challenge in probabilistic deep learning. While sampling-based approaches do not require a variational distribution assumption,…

Machine Learning · Computer Science 2025-02-11 Emanuel Sommer , Jakob Robnik , Giorgi Nozadze , Uros Seljak , David Rügamer

Sequential Monte Carlo (SMC) methods are widely used to draw samples from intractable target distributions. Particle degeneracy can hinder the use of SMC when the target distribution is highly constrained or multimodal. As a motivating…

Methodology · Statistics 2022-10-26 Zhaoran Hou , Samuel W. K. Wong

In the following article we provide an exposition of exact computational methods to perform parameter inference from partially observed network models. In particular, we consider the duplication attachment (DA) model which has a likelihood…

Computation · Statistics 2013-06-20 Junshan Wang , Ajay Jasra , Maria De Iorio

The Bayesian approach to inverse problems typically relies on posterior sampling approaches, such as Markov chain Monte Carlo, for which the generation of each sample requires one or more evaluations of the parameter-to-observable map or…

Computation · Statistics 2014-12-23 Jinglai Li , Youssef M. Marzouk

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Modern macroeconometrics often relies on time series models for which it is time-consuming to evaluate the likelihood function. We demonstrate how Bayesian computations for such models can be drastically accelerated by reweighting and…

Econometrics · Economics 2024-09-10 Marko Mlikota , Frank Schorfheide

Approximate Bayesian computation (ABC) is computationally intensive for complex model simulators. To exploit expensive simulations, data-resampling via bootstrapping can be employed to obtain many artificial datasets at little cost.…

Computation · Statistics 2021-07-05 Umberto Picchini , Richard G. Everitt

High-dimensional data are routinely collected in many areas. We are particularly interested in Bayesian classification models in which one or more variables are imbalanced. Current Markov chain Monte Carlo algorithms for posterior…

Methodology · Statistics 2024-01-15 Deborshee Sen , Matthias Sachs , Jianfeng Lu , David Dunson

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal…

Methodology · Statistics 2024-01-17 Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra