English
Related papers

Related papers: Adaptive Sequential Posterior Simulators for Massi…

200 papers

Posterior sampling is a task of central importance in Bayesian inference. For many applications in Bayesian meta-analysis and Bayesian transfer learning, the prior distribution is unknown and needs to be estimated from samples. In practice,…

Computation · Statistics 2024-08-06 Chenyang Zhong , Shouxuan Ji , Tian Zheng

Sequential Monte Carlo (SMC) is a class of algorithms that approximate high-dimensional expectations of a Markov chain. SMC algorithms typically include a resampling step. There are many possible ways to resample, but the relative…

Numerical Analysis · Mathematics 2019-04-01 Robert J. Webber

Markov chain Monte Carlo algorithms have important applications in counting problems and in machine learning problems, settings that involve estimating quantities that are difficult to compute exactly. How much can quantum computers speed…

Quantum Physics · Physics 2020-02-10 Aram W. Harrow , Annie Y. Wei

We propose a global optimization algorithm based on the Sequential Monte Carlo (SMC) sampling framework. In this framework, the objective function is normalized to be a probabilistic density function (pdf), based on which a sequence of…

Computation · Statistics 2016-07-15 Bin Liu

Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood…

Computation · Statistics 2026-01-09 Elliot Maceda , Emily C. Hector , Amanda Lenzi , Brian J. Reich

Approximate Bayesian computation (ABC) using a sequential Monte Carlo method provides a comprehensive platform for parameter estimation, model selection and sensitivity analysis in differential equations. However, this method, like other…

Machine Learning · Statistics 2015-07-21 Sanmitra Ghosh , Srinandan Dasmahapatra , Koushik Maharatna

We present a sequential Monte Carlo sampler algorithm for the Bayesian analysis of generalised linear mixed models (GLMMs). These models support a variety of interesting regression-type analyses, but performing inference is often extremely…

Computation · Statistics 2008-10-08 Y. Fan , D. S. Leslie , M. P. Wand

Particle smoothers are SMC (Sequential Monte Carlo) algorithms designed to approximate the joint distribution of the states given observations from a state-space model. We propose dSMC (de-Sequentialized Monte Carlo), a new particle…

Computation · Statistics 2022-02-07 Adrien Corenflos , Nicolas Chopin , Simo Särkkä

While MCMC methods have become a main work-horse for Bayesian inference, scaling them to large distributed datasets is still a challenge. Embarrassingly parallel MCMC strategies take a divide-and-conquer stance to achieve this by writing…

Machine Learning · Computer Science 2021-06-16 Diego Mesquita , Paul Blomstedt , Samuel Kaski

We propose sequential Monte Carlo (SMC) methods for sampling the posterior distribution of state-space models under highly informative observation regimes, a situation in which standard SMC methods can perform poorly. A special case is…

Computation · Statistics 2015-07-10 Pierre Del Moral , Lawrence M. Murray

We address the problem of approximating the posterior probability distribution of the fixed parameters of a state-space dynamical system using a sequential Monte Carlo method. The proposed approach relies on a nested structure that employs…

Computation · Statistics 2017-05-12 Dan Crisan , Joaquin Miguez

Recent work has suggested using Monte Carlo methods based on piecewise deterministic Markov processes (PDMPs) to sample from target distributions of interest. PDMPs are non-reversible continuous-time processes endowed with momentum, and…

Machine Learning · Statistics 2024-06-28 Paul Fearnhead , Sebastiano Grazzi , Chris Nemeth , Gareth O. Roberts

The Multilevel Monte Carlo (MLMC) method has proven to be an effective variance-reduction statistical method for Uncertainty Quantification (UQ) in Partial Differential Equation (PDE) models, combining model computations at different levels…

Mathematical Software · Computer Science 2023-05-24 Santiago Badia , Jerrad Hampton , Javier Principe

In the stochastic gradient descent (SGD) for sequential simulations such as the neural stochastic differential equations, the Multilevel Monte Carlo (MLMC) method is known to offer better theoretical computational complexity compared to the…

Machine Learning · Computer Science 2023-10-11 Kei Ishikawa

In many application areas, data are collected on a categorical response and high-dimensional categorical predictors, with the goals being to build a parsimonious model for classification while doing inferences on the important predictors.…

Methodology · Statistics 2013-01-22 Yun Yang , David B. Dunson

Approximate Bayesian inference for models with computationally expensive, black-box likelihoods poses a significant challenge, especially when the posterior distribution is complex. Many inference methods struggle to explore the parameter…

Machine Learning · Statistics 2025-11-11 Francesco Silvestrin , Chengkun Li , Luigi Acerbi

Approximate Bayesian Computation (ABC) methods have become essential tools for performing inference when likelihood functions are intractable or computationally prohibitive. However, their scalability remains a major challenge in…

Methodology · Statistics 2025-07-09 Antoine Luciano , Charly Andral , Christian P. Robert , Robin J. Ryder

This thesis describes work on two applications of probabilistic programming: the learning of probabilistic program code given specifications, in particular program code of one-dimensional samplers; and the facilitation of sequential Monte…

Artificial Intelligence · Computer Science 2020-05-21 Yura N Perov

A current challenge for many Bayesian analyses is determining when to terminate high-dimensional Markov chain Monte Carlo simulations. To this end, we propose using an automated sequential stopping procedure that terminates the simulation…

Computation · Statistics 2014-03-24 Lei Gong , James M. Flegal

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann