English
Related papers

Related papers: Decayed MCMC Filtering

200 papers

In this paper we consider fully Bayesian inference in general state space models. Existing particle Markov chain Monte Carlo (MCMC) algorithms use an augmented model that takes into account all the variable sampled in a sequential Monte…

Methodology · Statistics 2014-07-31 Christopher K. Carter , Eduardo F. Mendes , Robert Kohn

Many problems of practical interest rely on Continuous-time Markov chains~(CTMCs) defined over combinatorial state spaces, rendering the computation of transition probabilities, and hence probabilistic inference, difficult or impossible…

The particle filter (PF), also known as sequential Monte Carlo (SMC), approximates high-dimensional probability distributions and their normalizing constants in the discrete-time setting. To reduce the variance of the Monte Carlo…

Computation · Statistics 2026-05-05 Jianfeng Lu , Yuliang Wang

In the context of Bayesian inversion for scientific and engineering modeling, Markov chain Monte Carlo sampling strategies are the benchmark due to their flexibility and robustness in dealing with arbitrary posterior probability density…

Computation · Statistics 2021-12-07 Han Lu , Mohammad Khalil , Thomas Catanach , Jiefu Chen , Xuqing Wu , Xin Fu , Cosmin Safta , Yueqin Huang

The Pseudo-Marginal (PM) algorithm is a popular Markov chain Monte Carlo (MCMC) method used to sample from a target distribution when its density is inaccessible, but can be estimated with a non-negative unbiased estimator. Its performance…

Computation · Statistics 2025-09-30 Sarra Abaoubida , Mylène Bédard , Florian Maire

Bayesian filtering aims at tracking sequentially a hidden process from an observed one. In particular, sequential Monte Carlo (SMC) techniques propagate in time weighted trajectories which represent the posterior probability density…

Computation · Statistics 2012-10-22 Yohan Petetin , François Desbouvries

We develop an Evolutionary Markov Chain Monte Carlo (EMCMC) algorithm for sampling spatial partitions that lie within a large and complex spatial state space. Our algorithm combines the advantages of evolutionary algorithms (EAs) as…

Computation · Statistics 2021-01-19 Wendy K. Tam Cho , Yan Y. Liu

Efficient sampling of many-dimensional and multimodal density functions is a task of great interest in many research fields. We describe an algorithm that allows parallelizing inherently serial Markov chain Monte Carlo (MCMC) sampling by…

Computation · Statistics 2020-08-10 Vasyl Hafych , Philipp Eller , Oliver Schulz , Allen Caldwell

Sampling from complicated probability distributions is a hard computational problem arising in many fields, including statistical physics, optimization, and machine learning. Quantum computers have recently been used to sample from…

Markov Chain Monte Carlo (MCMC) techniques are now widely used for cosmological parameter estimation. Chains are generated to sample the posterior probability distribution obtained following the Bayesian approach. An important issue is how…

The modern scale of data has brought new challenges to Bayesian inference. In particular, conventional MCMC algorithms are computationally very expensive for large data sets. A promising approach to solve this problem is embarrassingly…

Machine Learning · Statistics 2015-10-27 Xiangyu Wang , Fangjian Guo , Katherine A. Heller , David B. Dunson

Markov chain Monte Carlo (MCMC) is a sampling-based method for estimating features of probability distributions. MCMC methods produce a serially correlated, yet representative, sample from the desired distribution. As such it can be…

Computation · Statistics 2019-12-10 Dootika Vats , Nathan Robertson , James M Flegal , Galin L Jones

Adaptive Markov Chain Monte Carlo (AMCMC) is a class of MCMC algorithms where the proposal distribution changes at every iteration of the chain. In this case it is important to verify that such a Markov Chain indeed has a stationary…

Probability · Mathematics 2015-09-07 Gopal K. Basak , Arunangshu Biswas

An efficient simulation-based methodology is proposed for the rolling window estimation of state space models, called particle rolling Markov chain Monte Carlo (MCMC) with double block sampling. In our method, which is based on Sequential…

Computation · Statistics 2021-09-17 Naoki Awaya , Yasuhiro Omori

We introduce a new version of particle filter in which the number of "children" of a particle at a given time has a Poisson distribution. As a result, the number of particles is random and varies with time. An advantage of this scheme is…

Computation · Statistics 2019-08-05 Tomasz Cąkała , Błażej Miasojedow , Wojciech Niemiro

Markov Chain Monte Carlo (MCMC) methods for sampling probability density functions (combined with abundant computational resources) have transformed the sciences, especially in performing probabilistic inferences, or fitting models to data.…

Instrumentation and Methods for Astrophysics · Physics 2018-05-23 David W. Hogg , Daniel Foreman-Mackey

Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are…

Computation · Statistics 2012-07-02 Iain Murray , Zoubin Ghahramani , David MacKay

We propose a novel approximate inference algorithm that approximates a target distribution by amortising the dynamics of a user-selected MCMC sampler. The idea is to initialise MCMC using samples from an approximation network, apply the…

Machine Learning · Statistics 2017-05-23 Yingzhen Li , Richard E. Turner , Qiang Liu

Posterior sampling is a task of central importance in Bayesian inference. For many applications in Bayesian meta-analysis and Bayesian transfer learning, the prior distribution is unknown and needs to be estimated from samples. In practice,…

Computation · Statistics 2024-08-06 Chenyang Zhong , Shouxuan Ji , Tian Zheng

Markov Chain Monte Carlo (MCMC) algorithms are often used for approximate inference inside learning, but their slow mixing can be difficult to diagnose and the approximations can seriously degrade learning. To alleviate these issues, we…

Machine Learning · Computer Science 2015-02-25 Jacob Steinhardt , Percy Liang