English
Related papers

Related papers: Driving Markov chain Monte Carlo with a dependent …

200 papers

We show that Markov couplings can be used to improve the accuracy of Markov chain Monte Carlo calculations in some situations where the steady-state probability distribution is not explicitly known. The technique generalizes the notion of…

Numerical Analysis · Mathematics 2015-05-13 Jonathan B. Goodman , Kevin K. Lin

Many applications in network analysis require algorithms to sample uniformly at random from the set of all graphs with a prescribed degree sequence. We present a Markov chain based approach which converges to the uniform distribution of all…

Discrete Mathematics · Computer Science 2010-03-05 Annabell Berger , Matthias Müller-Hannemann

We present several Monte Carlo strategies for simulating discrete-time Markov chains with continuous multi-dimensional state space; we focus on stratified techniques. We first analyze the variance of the calculation of the measure of a…

Statistics Theory · Mathematics 2016-03-22 Rana Fakhereddine , Rami El Haddad , Christian Lécot

We describe a general strategy for sampling configurations from a given distribution, NOT based on the standard Metropolis (Markov chain) strategy. It uses the fact that nontrivial problems in statistical physics are high dimensional and…

Statistical Mechanics · Physics 2009-11-07 P. Grassberger

Markov chain Monte Carlo methods are often deemed too computationally intensive to be of any practical use for big data applications, and in particular for inference on datasets containing a large number $n$ of individual data points, also…

Methodology · Statistics 2015-05-13 Rémi Bardenet , Arnaud Doucet , Chris Holmes

We consider a vector of $N$ independent binary variables, each with a different probability of success. The distribution of the vector conditional on its sum is known as the conditional Bernoulli distribution. Assuming that $N$ goes to…

Computation · Statistics 2020-12-08 Jeremy Heng , Pierre E. Jacob , Nianqiao Ju

Using Markov chain Monte Carlo to sample from posterior distributions was the key innovation which made Bayesian data analysis practical. Notoriously, however, MCMC is hard to tune, hard to diagnose, and hard to parallelize. This…

Computation · Statistics 2022-03-18 Cosma Rohilla Shalizi

Markov Chain Monte Carlo (MCMC) methods have become a cornerstone of many modern scientific analyses by providing a straightforward approach to numerically estimate uncertainties in the parameters of a model using a sequence of random…

Other Statistics · Statistics 2020-03-10 Joshua S. Speagle

In this paper we study asymptotic properties of different data-augmentation-type Markov chain Monte Carlo algorithms sampling from mixture models comprising discrete as well as continuous random variables. Of particular interest to us is…

Computation · Statistics 2014-04-04 Randal Douc , Florian Maire , Jimmy Olsson

There has been substantial interest in developing Markov chain Monte Carlo algorithms based on piecewise-deterministic Markov processes. However existing algorithms can only be used if the target distribution of interest is differentiable…

Statistics Theory · Mathematics 2021-11-12 Augustin Chevallier , Sam Power , Andi Q. Wang , Paul Fearnhead

Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time, it is natural to…

Machine Learning · Computer Science 2022-05-19 Lukas Köhs , Bastian Alt , Heinz Koeppl

Irreversible and rejection-free Monte Carlo methods, recently developed in Physics under the name Event-Chain and known in Statistics as Piecewise Deterministic Monte Carlo (PDMC), have proven to produce clear acceleration over standard…

Computation · Statistics 2020-04-28 Manon Michel , Alain Durmus , Stéphane Sénécal

Random graphs with prescribed degree sequences have been widely used as a model of complex networks. Comparing an observed network to an ensemble of such graphs allows one to detect deviations from randomness in network properties. Here we…

Statistical Mechanics · Physics 2007-05-23 R. Milo , N. Kashtan , S. Itzkovitz , M. E. J. Newman , U. Alon

In this paper a method based on a Markov chain Monte Carlo (MCMC) algorithm is proposed to compute the probability of a rare event. The conditional distribution of the underlying process given that the rare event occurs has the probability…

Probability · Mathematics 2012-11-12 Thorbjörn Gudmundsson , Henrik Hult

Markov chain Monte Carlo algorithms are used to simulate from complex statistical distributions by way of a local exploration of these distributions. This local feature avoids heavy requests on understanding the nature of the target, but it…

Computation · Statistics 2018-04-12 Christian P. Robert , Victor Elvira , Nick Tawn , Changye Wu

Importance sampling is a variance reduction technique for efficient estimation of rare-event probabilities by Monte Carlo. In standard importance sampling schemes, the system is simulated using an a priori fixed change of measure suggested…

Probability · Mathematics 2007-05-23 Paul Dupuis , Hui Wang

Many probabilistic models introduce strong dependencies between variables using a latent multivariate Gaussian distribution or a Gaussian process. We present a new Markov chain Monte Carlo algorithm for performing inference in models with…

Computation · Statistics 2010-03-22 Iain Murray , Ryan Prescott Adams , David J. C. MacKay

This paper investigates methods for estimating the optimal stochastic control policy for a Markov Decision Process with unknown transition dynamics and an unknown reward function. This form of model-free reinforcement learning comprises…

Machine Learning · Computer Science 2019-12-06 Brandon Trabucco , Albert Qu , Simon Li , Ganeshkumar Ashokavardhanan

Markov chain Monte Carlo (MCMC) is a powerful tool for sampling from complex probability distributions. Despite its versatility, MCMC often suffers from strong autocorrelation and the negative sign problem, leading to slowing down the…

Statistical Mechanics · Physics 2024-12-05 Synge Todo

We propose approaches for testing implementations of Markov Chain Monte Carlo methods as well as of general Monte Carlo methods. Based on statistical hypothesis tests, these approaches can be used in a unit testing framework to, for…

Methodology · Statistics 2021-09-21 Axel Gandy , James Scott