English
Related papers

Related papers: An Adaptive Sequential Monte Carlo Sampler

200 papers

Markov Chain Monte Carlo (MCMC) is a powerful method for drawing samples from non-standard probability distributions and is utilized across many fields and disciplines. Methods such as Metropolis-Adjusted Langevin (MALA) and Hamiltonian…

Computation · Statistics 2024-10-28 Lee Devlin , Paul Horridge , Peter L. Green , Simon Maskell

Recent advances in adaptive Markov chain Monte Carlo (AMCMC) include the need for regional adaptation in situations when the optimal transition kernel is different across different regions of the sample space. Motivated by these findings,…

Computation · Statistics 2010-12-30 Radu V. Craiu , Antonio Fabio Di Narzo

We propose a new framework for how to use sequential Monte Carlo (SMC) algorithms for inference in probabilistic graphical models (PGM). Via a sequential decomposition of the PGM we find a sequence of auxiliary distributions defined on a…

Methodology · Statistics 2014-10-07 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

Sequential Monte Carlo (SMC) is a class of algorithms that approximate high-dimensional expectations of a Markov chain. SMC algorithms typically include a resampling step. There are many possible ways to resample, but the relative…

Numerical Analysis · Mathematics 2019-04-01 Robert J. Webber

Being the most classical generative model for serial data, state-space models (SSM) are fundamental in AI and statistical machine learning. In SSM, any form of parameter learning or latent state inference typically involves the computation…

Machine Learning · Statistics 2024-07-04 Alessandro Mastrototaro , Jimmy Olsson

We present a Bayesian sampling algorithm called adaptive importance sampling or Population Monte Carlo (PMC), whose computational workload is easily parallelizable and thus has the potential to considerably reduce the wall-clock time…

Cosmology and Nongalactic Astrophysics · Physics 2009-09-02 Darren Wraith , Martin Kilbinger , Karim Benabed , Olivier Cappé , Jean-François Cardoso , Gersende Fort , Simon Prunet , Christian P. Robert

Sequential Monte Carlo (SMC) methods, also known as particle filters, are simulation-based recursive algorithms for the approximation of the a posteriori probability measures generated by state-space dynamical models. At any given time $t$,…

Computation · Statistics 2016-11-24 Dan Crisan , Joaquín Míguez

Over decades, Markov chain Monte Carlo (MCMC) methods have been widely studied, with a typical application being the quantification of posterior uncertainties in Bayesian system identification of structural dynamic models. To address the…

Applications · Statistics 2026-04-28 Xianghao Meng , Yong Huang , James L. Beck , Kui Jiang , Hui Li

Sequential Monte Carlo (SMC) methods offer a principled approach to Bayesian uncertainty quantification but are traditionally limited by the need for full-batch gradient evaluations. We introduce a scalable variant by incorporating…

Machine Learning · Statistics 2025-05-20 Andrew Millard , Zheng Zhao , Joshua Murphy , Simon Maskell

Sequential Monte Carlo (SMC), or particle filtering, is widely used in nonlinear state-space systems, but its performance often suffers from poorly approximated proposal and state-transition distributions. This work introduces a…

Machine Learning · Computer Science 2026-05-14 Wessel L. van Nierop , Nir Shlezinger , Ruud J. G. van Sloun

The Self-Learning Monte Carlo (SLMC) method is a Monte Carlo approach that has emerged in recent years by integrating concepts from machine learning with conventional Monte Carlo techniques. Designed to accelerate the numerical study of…

Strongly Correlated Electrons · Physics 2025-07-18 Gaopei Pan , Chuang Chen , Zi Yang Meng

Stochastic approximation Monte Carlo (SAMC) has recently been proposed by Liang, Liu and Carroll [J. Amer. Statist. Assoc. 102 (2007) 305--320] as a general simulation and optimization algorithm. In this paper, we propose to improve its…

Statistics Theory · Mathematics 2009-08-26 Faming Liang

We introduce a new class of sequential Monte Carlo methods which reformulates the essence of the nested sampling method of Skilling (2006) in terms of sequential Monte Carlo techniques. Two new algorithms are proposed, nested sampling via…

Fitting stochastic kinetic models represented by Markov jump processes within the Bayesian paradigm is complicated by the intractability of the observed data likelihood. There has therefore been considerable attention given to the design of…

Computation · Statistics 2017-08-04 Andrew Golightly , Theodore Kypraios

Switching state-space models (SSSM) are a very popular class of time series models that have found many applications in statistics, econometrics and advanced signal processing. Bayesian inference for these models typically relies on Markov…

Computation · Statistics 2010-11-11 Nick Whiteley , Christophe Andrieu , Arnaud Doucet

Monte Carlo (MC) techniques are often used to estimate integrals of a multivariate function using randomly generated samples of the function. In light of the increasing interest in uncertainty quantification and robust design applications…

Machine Learning · Statistics 2011-08-25 Brendan Tracey , David Wolpert , Juan J. Alonso

In the last decade, sequential Monte-Carlo methods (SMC) emerged as a key tool in computational statistics. These algorithms approximate a sequence of distributions by a sequence of weighted empirical measures associated to a weighted…

Statistics Theory · Mathematics 2007-06-13 R. Douc , France E. Moulines

We present an original simulation-based method to estimate likelihood ratios efficiently for general state-space models. Our method relies on a novel use of the conditional Sequential Monte Carlo (cSMC) algorithm introduced in…

Methodology · Statistics 2018-09-10 Sinan Yıldırım , Christophe Andrieu , Arnaud Doucet

We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured…

Recently there have been exciting developments in Monte Carlo methods, with the development of new MCMC and sequential Monte Carlo (SMC) algorithms which are based on continuous-time, rather than discrete-time, Markov processes. This has…

Computation · Statistics 2020-09-29 Paul Fearnhead , Joris Bierkens , Murray Pollock , Gareth O Roberts