English
Related papers

Related papers: Nested Sequential Monte Carlo Methods

200 papers

Sampling from complicated probability distributions is a hard computational problem arising in many fields, including statistical physics, optimization, and machine learning. Quantum computers have recently been used to sample from…

Markov chain Monte Carlo (MCMC) methods are a powerful but computationally expensive way of performing non-parametric Bayesian inference. MCMC proposals which utilise gradients, such as Hamiltonian Monte Carlo (HMC), can better explore the…

Computation · Statistics 2026-01-30 Andrew Millard , Joshua Murphy , Daniel Frisch , Simon Maskell

Nested sampling (NS) is the preferred stochastic sampling algorithm for gravitational-wave inference for compact binary coalenscences (CBCs). It can handle the complex nature of the gravitational-wave likelihood surface and provides an…

Instrumentation and Methods for Astrophysics · Physics 2025-10-08 Michael J. Williams , Minas Karamanis , Yilin Luo , Uroš Seljak

We develop a modular approach to Markov chain Monte Carlo (MCMC) sampling for unnormalized target densities. In this approach, Markov chains are constructed in parallel, each constrained to a subset of the target space. The Monte Carlo…

Computation · Statistics 2026-05-05 Joonha Park

In the following article we provide an exposition of exact computational methods to perform parameter inference from partially observed network models. In particular, we consider the duplication attachment (DA) model which has a likelihood…

Computation · Statistics 2013-06-20 Junshan Wang , Ajay Jasra , Maria De Iorio

We show how to speed up Sequential Monte Carlo (SMC) for Bayesian inference in large data problems by data subsampling. SMC sequentially updates a cloud of particles through a sequence of distributions, beginning with a distribution that is…

Computation · Statistics 2020-03-25 David Gunawan , Khue-Dung Dang , Matias Quiroz , Robert Kohn , Minh-Ngoc Tran

Sequential Monte Carlo samplers represent a compelling approach to posterior inference in Bayesian models, due to being parallelisable and providing an unbiased estimate of the posterior normalising constant. In this work, we significantly…

Methodology · Statistics 2022-11-24 Samuel Duffield , Sumeetpal S. Singh

Many real-world problems require one to estimate parameters of interest, in a Bayesian framework, from data that are collected sequentially in time. Conventional methods for sampling from posterior distributions, such as {Markov Chain Monte…

Methodology · Statistics 2022-01-25 Jiangqi Wu , Linjie Wen , Peter L Green , Jinglai Li , Simon Maskell

Sequential Monte Carlo methods which involve sequential importance sampling and resampling are shown to provide a versatile approach to computing probabilities of rare events. By making use of martingale representations of the sequential…

Probability · Mathematics 2012-02-22 Hock Peng Chan , Tze Leung Lai

Hamiltonian Monte Carlo has emerged as a standard tool for posterior computation. In this article, we present an extension that can efficiently explore target distributions with discontinuous densities. Our extension in particular enables…

Computation · Statistics 2020-06-09 Akihiko Nishimura , David Dunson , Jianfeng Lu

We prove finite sample complexities for sequential Monte Carlo (SMC) algorithms which require only local mixing times of the associated Markov kernels. Our bounds are particularly useful when the target distribution is multimodal and global…

Computation · Statistics 2022-08-16 Joseph Mathews , Scott C. Schmidler

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

Computation · Statistics 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

In this paper we consider fully Bayesian inference in general state space models. Existing particle Markov chain Monte Carlo (MCMC) algorithms use an augmented model that takes into account all the variable sampled in a sequential Monte…

Methodology · Statistics 2014-07-31 Christopher K. Carter , Eduardo F. Mendes , Robert Kohn

This article reviews the application of advanced Monte Carlo techniques in the context of Multilevel Monte Carlo (MLMC). MLMC is a strategy employed to compute expectations which can be biased in some sense, for instance, by using the…

Computation · Statistics 2017-04-25 Ajay Jasra , Kody Law , Carina Suciu

Approximate inference in probabilistic graphical models (PGMs) can be grouped into deterministic methods and Monte-Carlo-based methods. The former can often provide accurate and rapid inferences, but are typically associated with biases…

Machine Learning · Statistics 2019-01-09 Fredrik Lindsten , Jouni Helske , Matti Vihola

In this article we consider the approximation of expectations w.r.t. probability distributions associated to the solution of partial differential equations (PDEs); this scenario appears routinely in Bayesian inverse problems. In practice,…

Computation · Statistics 2017-02-07 Alexandros Beskos , Ajay Jasra , Kody Law , Raul Tempone , Yan Zhou

This paper introduces a Bayesian framework that combines Markov chain Monte Carlo (MCMC) sampling, dimensionality reduction, and neural density estimation to efficiently handle inverse problems that (i) must be solved multiple times, and…

Computational Engineering, Finance, and Science · Computer Science 2026-02-24 Giacomo Bottacini , Matteo Torzoni , Andrea Manzoni

Markov chain Monte Carlo (MCMC) methods are widely used in machine learning. One of the major problems with MCMC is the question of how to design chains that mix fast over the whole state space; in particular, how to select the parameters…

Machine Learning · Computer Science 2019-07-16 Kiarash Shaloudegi , András György

In this paper, we propose an efficient pseudo-marginal Markov chain Monte Carlo (MCMC) sampling approach to draw samples from posterior shape distributions for image segmentation. The computation time of the proposed approach is independent…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Ertunc Erdil , Sinan Yildirim , Tolga Tasdizen , Mujdat Cetin

Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are…

Computation · Statistics 2012-07-02 Iain Murray , Zoubin Ghahramani , David MacKay