English
Related papers

Related papers: Sex as Gibbs Sampling: a probability model of evol…

200 papers

Sampling from lattice Gaussian distribution has emerged as an important problem in coding, decoding and cryptography. In this paper, the classic Gibbs algorithm from Markov chain Monte Carlo (MCMC) methods is demonstrated to be…

Information Theory · Computer Science 2018-12-03 Zheng Wang

Gibbs sampling is a widely used Markov chain Monte Carlo (MCMC) method for numerically approximating integrals of interest in Bayesian statistics and other mathematical sciences. Many implementations of MCMC methods do not extend easily to…

Computation · Statistics 2019-06-03 Alexander Terenin , Shawfeng Dong , David Draper

The combinatorial sequential Monte Carlo (CSMC) has been demonstrated to be an efficient complementary method to the standard Markov chain Monte Carlo (MCMC) for Bayesian phylogenetic tree inference using biological sequences. It is…

Computation · Statistics 2020-08-12 Shijia Wang , Liangliang Wang

Performing exact Bayesian inference for complex models is computationally intractable. Markov chain Monte Carlo (MCMC) algorithms can provide reliable approximations of the posterior distribution but are expensive for large datasets and…

Computation · Statistics 2021-12-09 Maxime Vono , Daniel Paulin , Arnaud Doucet

Standard MCMC methods can scale poorly to big data settings due to the need to evaluate the likelihood at each iteration. There have been a number of approximate MCMC algorithms that use sub-sampling ideas to reduce this computational…

Computation · Statistics 2020-09-29 Joris Bierkens , Paul Fearnhead , Gareth Roberts

Bayesian inference of Gibbs random fields (GRFs) is often referred to as a doubly intractable problem, since the likelihood function is intractable. The exploration of the posterior distribution of such models is typically carried out with…

Computation · Statistics 2017-10-16 Aidan Boland , Nial Friel , Florian Maire

Bayesian variable selection requires sampling from a posterior distribution that combines discrete model indicators with continuously varying parameters, a challenge often addressed through reversible jump Markov chain Monte Carlo (RJMCMC).…

Methodology · Statistics 2026-05-01 Don van den Bergh , Merlise A. Clyde , Adrian E. Raftery , Maarten Marsman

We present here two irreversible Markov chain Monte Carlo algorithms for general discrete state systems, one of the algorithms is based on the random-scan Gibbs sampler for discrete states and the other on its improved version, the…

Statistical Mechanics · Physics 2020-05-08 Fahim Faizi , George Deligiannidis , Edina Rosta

We consider Markov chain Monte Carlo (MCMC) algorithms for Bayesian high-dimensional regression with continuous shrinkage priors. A common challenge with these algorithms is the choice of the number of iterations to perform. This is…

Methodology · Statistics 2021-07-13 Niloy Biswas , Anirban Bhattacharya , Pierre E. Jacob , James E. Johndrow

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

Generative models derived from large protein sequence alignments define complex fitness landscapes, but their utility for accurately modeling non-equilibrium evolutionary dynamics remains unclear. In this work, we perform a rigorous…

Populations and Evolution · Quantitative Biology 2026-02-10 Leonardo Di Bari , Thierry Mora , Andrea Pagnani , Aleksandra M. Walczak , Francesco Zamponi , Saverio Rossi

Solving ill-posed inverse problems by Bayesian inference has recently attracted considerable attention. Compared to deterministic approaches, the probabilistic representation of the solution by the posterior distribution can be exploited to…

Numerical Analysis · Mathematics 2016-11-03 Felix Lucka

The Markov Chain Monte Carlo (MCMC) algorithm is a widely recognised as an efficient method for sampling a specified posterior distribution. However, when the posterior is multi-modal, conventional MCMC algorithms either tend to become…

Instrumentation and Methods for Astrophysics · Physics 2014-08-19 Yi-Ming Hu , Martin Hendry , Ik Siong Heng

We develop a framework for approximating collapsed Gibbs sampling in generative latent variable cluster models. Collapsed Gibbs is a popular MCMC method, which integrates out variables in the posterior to improve mixing. Unfortunately for…

Machine Learning · Statistics 2018-07-23 Christopher Aicher , Emily B. Fox

Markov chain Monte Carlo is a class of algorithms for drawing Markovian samples from high-dimensional target densities to approximate the numerical integration associated with computing statistical expectation, especially in Bayesian…

Computation · Statistics 2018-03-28 Khoa T. Tran

Many problems in the physical sciences, machine learning, and statistical inference necessitate sampling from a high-dimensional, multi-modal probability distribution. Markov Chain Monte Carlo (MCMC) algorithms, the ubiquitous tool for this…

Data Analysis, Statistics and Probability · Physics 2022-05-12 Marylou Gabrié , Grant M. Rotskoff , Eric Vanden-Eijnden

We study the continuous-time evolution of the recombination equation of population genetics. This evolution is given by a differential equation that acts on a product probability space, and its solution can be described by a Markov chain on…

Probability · Mathematics 2020-04-20 Ian Letter , Servet Martínez

This paper presents a new Markov chain Monte Carlo method to sample from the posterior distribution of conjugate mixture models. This algorithm relies on a flexible split-merge procedure built using the particle Gibbs sampler. Contrary to…

Computation · Statistics 2017-05-30 Alexandre Bouchard-Côté , Arnaud Doucet , Andrew Roth

Bayesian inference for Markov jump processes (MJPs) where available observations relate to either system states or jumps typically relies on data-augmentation Markov Chain Monte Carlo. State-of-the-art developments involve representing MJP…

Computation · Statistics 2019-04-18 Iker Perez , Theodore Kypraios

Gibbs sampling is a widely popular Markov chain Monte Carlo algorithm that can be used to analyze intractable posterior distributions associated with Bayesian hierarchical models. There are two standard versions of the Gibbs sampler: The…

Statistics Theory · Mathematics 2020-01-01 Grant Backlund , James P. Hobert , Yeun Ji Jung , Kshitij Khare