English
Related papers

Related papers: Persistent Sampling: Enhancing the Efficiency of S…

200 papers

This paper brings explicit considerations of distributed computing architectures and data structures into the rigorous design of Sequential Monte Carlo (SMC) methods. A theoretical result established recently by the authors shows that…

Computation · Statistics 2014-06-24 Anthony Lee , Nick Whiteley

Sequential Monte Carlo methods, also known as particle methods, are a popular set of techniques for approximating high-dimensional probability distributions and their normalizing constants. These methods have found numerous applications in…

Computation · Statistics 2021-06-23 Jeremy Heng , Adrian N. Bishop , George Deligiannidis , Arnaud Doucet

Bayesian inference for factorial hidden Markov models is challenging due to the exponentially sized latent variable space. Standard Monte Carlo samplers can have difficulties effectively exploring the posterior landscape and are often…

Computation · Statistics 2019-02-28 Kaspar Märtens , Michalis K Titsias , Christopher Yau

We investigate the prevalence of sample repetition in a Sequential Monte Carlo (SMC) method recently introduced for political redistricting.

Probability · Mathematics 2024-10-01 Sarah Cannon , Daryl DeFord , Moon Duchin

Bayesian filtering aims at tracking sequentially a hidden process from an observed one. In particular, sequential Monte Carlo (SMC) techniques propagate in time weighted trajectories which represent the posterior probability density…

Computation · Statistics 2012-10-22 Yohan Petetin , François Desbouvries

This paper proposes Bayesian mosaic, a parallelizable composite posterior, for scalable Bayesian inference on a broad class of multivariate discrete data models. Sampling is embarrassingly parallel since Bayesian mosaic is a multiplication…

Methodology · Statistics 2018-04-03 Ye Wang , David Dunson

In the following article we provide an exposition of exact computational methods to perform parameter inference from partially observed network models. In particular, we consider the duplication attachment (DA) model which has a likelihood…

Computation · Statistics 2013-06-20 Junshan Wang , Ajay Jasra , Maria De Iorio

Sparsity has become a key concept for solving of high-dimensional inverse problems using variational regularization techniques. Recently, using similar sparsity-constraints in the Bayesian framework for inverse problems by encoding them in…

Numerical Analysis · Mathematics 2014-11-18 Felix Lucka

Switching state-space models (SSSM) are a very popular class of time series models that have found many applications in statistics, econometrics and advanced signal processing. Bayesian inference for these models typically relies on Markov…

Computation · Statistics 2010-11-11 Nick Whiteley , Christophe Andrieu , Arnaud Doucet

In a recent paper Beskos et al (2011), the Sequential Monte Carlo (SMC) sampler introduced in Del Moral et al (2006), Neal (2001) has been shown to be asymptotically stable in the dimension of the state space d at a cost that is only…

Computation · Statistics 2011-12-08 Alexandros Beskos , Dan Crisan , Ajay Jasra , Nick Whiteley

Sequential Monte Carlo samplers represent a compelling approach to posterior inference in Bayesian models, due to being parallelisable and providing an unbiased estimate of the posterior normalising constant. In this work, we significantly…

Methodology · Statistics 2022-11-24 Samuel Duffield , Sumeetpal S. Singh

In performing a Bayesian analysis, two difficult problems often emerge. First, in estimating the parameters of some model for the data, the resulting posterior distribution may be multi-modal or exhibit pronounced (curving) degeneracies.…

Instrumentation and Methods for Astrophysics · Physics 2013-12-20 F. Feroz , J. Skilling

We propose a novel sequential Monte Carlo (SMC) method for sampling from unnormalized target distributions based on a reverse denoising diffusion process. While recent diffusion-based samplers simulate the reverse diffusion using…

Computation · Statistics 2025-11-06 Luhuan Wu , Yi Han , Christian A. Naesseth , John P. Cunningham

This paper presents an improved implicit sampling method for hierarchical Bayesian inverse problems. A widely used approach for sampling posterior distribution is based on Markov chain Monte Carlo (MCMC). However, the samples generated by…

Numerical Analysis · Mathematics 2018-11-27 Xiaoyan Song , Lijian Jiang , Guanghui Zheng

In image processing, solving inverse problems is the task of finding plausible reconstructions of an image that was corrupted by some (usually known) degradation operator. Commonly, this process is done using a generative image model that…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Idan Achituve , Hai Victor Habi , Amir Rosenfeld , Arnon Netzer , Idit Diamant , Ethan Fetaya

When using Markov chain Monte Carlo (MCMC) algorithms to perform inference for Bayesian clustering models, such as mixture models, the output is typically a sample of clusterings (partitions) drawn from the posterior distribution. In…

Methodology · Statistics 2020-09-29 Alessandra Cabassi , Sylvia Richardson , Paul D. W. Kirk

Using Markov chain Monte Carlo to sample from posterior distributions was the key innovation which made Bayesian data analysis practical. Notoriously, however, MCMC is hard to tune, hard to diagnose, and hard to parallelize. This…

Computation · Statistics 2022-03-18 Cosma Rohilla Shalizi

The problem of sampling constrained continuous distributions has frequently appeared in many machine/statistical learning models. Many Monte Carlo Markov Chain (MCMC) sampling methods have been adapted to handle different types of…

Computation · Statistics 2023-02-21 Shiwei Lan , Lulu Kang

We present a comprehensive comparison of different Markov Chain Monte Carlo (MCMC) sampling methods, evaluating their performance on both standard test problems and cosmological parameter estimation. Our analysis includes traditional…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-28 Denitsa Staicova

Gaussian time-series models are often specified through their spectral density. Such models present several computational challenges, in particular because of the non-sparse nature of the covariance matrix. We derive a fast approximation of…

Computation · Statistics 2012-11-20 Nicolas Chopin , Judith Rousseau , Brunero Liseo