English
Related papers

Related papers: A flexible Particle Markov chain Monte Carlo metho…

200 papers

We present a sequential Monte Carlo sampler algorithm for the Bayesian analysis of generalised linear mixed models (GLMMs). These models support a variety of interesting regression-type analyses, but performing inference is often extremely…

Computation · Statistics 2008-10-08 Y. Fan , D. S. Leslie , M. P. Wand

Efficient sampling of many-dimensional and multimodal density functions is a task of great interest in many research fields. We describe an algorithm that allows parallelizing inherently serial Markov chain Monte Carlo (MCMC) sampling by…

Computation · Statistics 2020-08-10 Vasyl Hafych , Philipp Eller , Oliver Schulz , Allen Caldwell

Many probabilistic models introduce strong dependencies between variables using a latent multivariate Gaussian distribution or a Gaussian process. We present a new Markov chain Monte Carlo algorithm for performing inference in models with…

Computation · Statistics 2010-03-22 Iain Murray , Ryan Prescott Adams , David J. C. MacKay

We introduce a Monte Carlo algorithm to efficiently compute transport properties of chaotic dynamical systems. Our method exploits the importance sampling technique that favors trajectories in the tail of the distribution of displacements,…

Statistical Mechanics · Physics 2018-05-25 Diego Tapias , David P. Sanders , Eduardo G. Altmann

The Hamiltonian Monte Carlo (HMC) sampling algorithm exploits Hamiltonian dynamics to construct efficient Markov Chain Monte Carlo (MCMC), which has become increasingly popular in machine learning and statistics. Since HMC uses the gradient…

Machine Learning · Computer Science 2019-06-04 Minghao Gu , Shiliang Sun

The Markov Chain Monte Carlo (MCMC) algorithm is a widely recognised as an efficient method for sampling a specified posterior distribution. However, when the posterior is multi-modal, conventional MCMC algorithms either tend to become…

Instrumentation and Methods for Astrophysics · Physics 2014-08-19 Yi-Ming Hu , Martin Hendry , Ik Siong Heng

Sampling from lattice Gaussian distribution has emerged as an important problem in coding, decoding and cryptography. In this paper, the classic Gibbs algorithm from Markov chain Monte Carlo (MCMC) methods is demonstrated to be…

Information Theory · Computer Science 2018-12-03 Zheng Wang

The Markov Chain Monte Carlo (MCMC) methods are popular when considering sampling from a high-dimensional random variable $\mathbf{x}$ with possibly unnormalised probability density $p$ and observed data $\mathbf{d}$. However, MCMC requires…

Computation · Statistics 2020-03-11 Haoyun Ying , Keheng Mao , Klaus Mosegaard

In this paper, we present a method for computing the marginal likelihood, also known as the model likelihood or Bayesian evidence, from Markov Chain Monte Carlo (MCMC), or other sampled posterior distributions. In order to do this, one…

Computing the marginal likelihood or evidence is one of the core challenges in Bayesian analysis. While there are many established methods for estimating this quantity, they predominantly rely on using a large number of posterior samples…

Computation · Statistics 2021-02-26 Eric Chuu , Debdeep Pati , Anirban Bhattacharya

The availability of data sets with large numbers of variables is rapidly increasing. The effective application of Bayesian variable selection methods for regression with these data sets has proved difficult since available Markov chain…

Computation · Statistics 2019-05-08 Jim Griffin , Krys Latuszynski , Mark Steel

For several decades now, Bayesian inference techniques have been applied to theories of particle physics, cosmology and astrophysics to obtain the probability density functions of their free parameters. In this study, we review and compare…

High Energy Physics - Phenomenology · Physics 2025-09-03 Joshua Albert , Csaba Balazs , Andrew Fowlie , Will Handley , Nicholas Hunt-Smith , Roberto Ruiz de Austri , Martin White

In this article we consider computing expectations w.r.t.~probability laws associated to a certain class of stochastic systems. In order to achieve such a task, one must not only resort to numerical approximation of the expectation, but…

Computation · Statistics 2017-10-30 Ajay Jasra , Kengo Kamatani , Kody Law , Yan Zhou

Bayesian feature allocation models are a popular tool for modelling data with a combinatorial latent structure. Exact inference in these models is generally intractable and so practitioners typically apply Markov Chain Monte Carlo (MCMC)…

Computation · Statistics 2020-01-28 Alexandre Bouchard-Côté , Andrew Roth

Markov chain Monte Carlo (MCMC) algorithms provide a very general recipe for estimating properties of complicated distributions. While their use has become commonplace and there is a large literature on MCMC theory and practice, MCMC users…

Computation · Statistics 2012-05-03 Murali Haran , Luke Tierney

Monte Carlo methods are widely used for approximating complicated, multidimensional integrals for Bayesian inference. Population Monte Carlo (PMC) is an important class of Monte Carlo methods, which utilizes a population of proposals to…

Methodology · Statistics 2022-08-30 Chaofan Huang , V. Roshan Joseph , Simon Mak

I introduce a Markov chain Monte Carlo (MCMC) scheme in which sampling from a distribution with density pi(x) is done using updates operating on an "ensemble" of states. The current state x is first stochastically mapped to an ensemble,…

Computation · Statistics 2011-01-04 Radford M. Neal

We present here two irreversible Markov chain Monte Carlo algorithms for general discrete state systems, one of the algorithms is based on the random-scan Gibbs sampler for discrete states and the other on its improved version, the…

Statistical Mechanics · Physics 2020-05-08 Fahim Faizi , George Deligiannidis , Edina Rosta

We propose a sequential Markov chain Monte Carlo (SMCMC) algorithm to sample from a sequence of probability distributions, corresponding to posterior distributions at different times in on-line applications. SMCMC proceeds as in usual MCMC…

Statistics Theory · Mathematics 2013-08-20 Yun Yang , David B. Dunson

Non-linear state space models are a widely-used class of models for biological, economic, and physical processes. Fitting these models to observed data is a difficult inference problem that has no straightforward solution. We take a…

Computation · Statistics 2013-05-03 Alexander Y. Shestopaloff , Radford M. Neal