English
Related papers

Related papers: An effective introduction to the Markov Chain Mont…

200 papers

The Markov Chain Monte Carlo (MCMC) algorithm is a widely recognised as an efficient method for sampling a specified posterior distribution. However, when the posterior is multi-modal, conventional MCMC algorithms either tend to become…

Instrumentation and Methods for Astrophysics · Physics 2014-08-19 Yi-Ming Hu , Martin Hendry , Ik Siong Heng

Quasi-Monte Carlo (QMC) methods for estimating integrals are attractive since the resulting estimators typically converge at a faster rate than pseudo-random Monte Carlo. However, they can be difficult to set up on arbitrary posterior…

Statistics Theory · Mathematics 2018-10-03 Tobias Schwedes , Ben Calderhead

We propose a Markov chain simulation method to generate simple connected random graphs with a specified degree sequence and level of clustering. The networks generated by our algorithm are random in all other respects and can thus serve as…

Discrete Mathematics · Computer Science 2010-02-09 Shweta Bansal , Shashank Khandelwal , Lauren Ancel Meyers

As it has become common to use many computer cores in routine applications, finding good ways to parallelize popular algorithms has become increasingly important. In this paper, we present a parallelization scheme for Markov chain Monte…

Methodology · Statistics 2016-06-01 Guillaume W. Basse , Natesh S. Pillai , Aaron Smith

Atomistic simulations provide valuable insights into the physical processes governing material behavior. However, their applicability is fundamentally constrained by the limited time scales accessible to brute-force simulations. This…

Computational Physics · Physics 2026-02-16 Michael Kim , Wei Cai

This paper surveys various results about Markov chains on general (non-countable) state spaces. It begins with an introduction to Markov chain Monte Carlo (MCMC) algorithms, which provide the motivation and context for the theory which…

Probability · Mathematics 2009-09-29 Gareth O. Roberts , Jeffrey S. Rosenthal

The purpose of this paper is to introduce a new Markov chain Monte Carlo method and exhibit its efficiency by simulation and high-dimensional asymptotic theory. Key fact is that our algorithm has a reversible proposal transition kernel,…

Methodology · Statistics 2014-12-22 Kengo Kamatani

The simplest, and most common, stochastic model for population processes, including those from biochemistry and cell biology, are continuous time Markov chains. Simulation of such models is often relatively straightforward as there are…

Probability · Mathematics 2012-03-01 David F. Anderson , Masanori Koyama

We propose an algorithm for the efficient and robust sampling of the posterior probability distribution in Bayesian inference problems. The algorithm combines the local search capabilities of the Manifold Metropolis Adjusted Langevin…

This article is a tutorial on Markov chain Monte Carlo simulations and their statistical analysis. The theoretical concepts are illustrated through many numerical assignments from the author's book on the subject. Computer code (in Fortran)…

Statistical Mechanics · Physics 2016-08-31 Bernd A. Berg

We address the problem of approximating the posterior probability distribution of the fixed parameters of a state-space dynamical system using a sequential Monte Carlo method. The proposed approach relies on a nested structure that employs…

Computation · Statistics 2017-05-12 Dan Crisan , Joaquin Miguez

While Markov chain Monte Carlo methods (MCMC) provide a general framework to sample from a probability distribution defined up to normalization, they often suffer from slow convergence to the target distribution when the latter is highly…

Machine Learning · Computer Science 2023-07-06 Tristan Deleu , Yoshua Bengio

Markov chain Monte Carlo methods such as Gibbs sampling and simple forms of the Metropolis algorithm typically move about the distribution being sampled via a random walk. For the complex, high-dimensional distributions commonly encountered…

bayes-an · Physics 2008-02-03 R. M. Neal

We consider continuous time Markovian processes where populations of individual agents interact stochastically according to kinetic rules. Despite the increasing prominence of such models in fields ranging from biology to smart cities,…

Machine Learning · Statistics 2016-05-16 Anastasis Georgoulas , Jane Hillston , Guido Sanguinetti

Irreversible and rejection-free Monte Carlo methods, recently developed in Physics under the name Event-Chain and known in Statistics as Piecewise Deterministic Monte Carlo (PDMC), have proven to produce clear acceleration over standard…

Computation · Statistics 2020-04-28 Manon Michel , Alain Durmus , Stéphane Sénécal

The need to calibrate increasingly complex statistical models requires a persistent effort for further advances on available, computationally intensive Monte Carlo methods. We study here an advanced version of familiar Markov Chain Monte…

Methodology · Statistics 2015-03-20 Alexandros Beskos , Konstantinos Kalogeropoulos , Erik Pazos

Markov chain Monte Carlo (MCMC) is a powerful tool for sampling from complex probability distributions. Despite its versatility, MCMC often suffers from strong autocorrelation and the negative sign problem, leading to slowing down the…

Statistical Mechanics · Physics 2024-12-05 Synge Todo

Agent-based models of disease transmission involve stochastic rules that specify how a number of individuals would infect one another, recover or be removed from the population. Common yet stringent assumptions stipulate interchangeability…

Computation · Statistics 2021-01-29 Nianqiao Ju , Jeremy Heng , Pierre E. Jacob

We introduce a cellular automaton model coupled with a transport equation for flows on graphs. The direction of the flow is described by a switching process where the switching probability dynamically changes according to the value of the…

Cellular Automata and Lattice Gases · Physics 2013-07-02 Pierre Degond , Michael Herty , Jian-Guo Liu

Markov Population Models are a widespread formalism used to model the dynamics of complex systems, with applications in Systems Biology and many other fields. The associated Markov stochastic process in continuous time is often analyzed by…

Machine Learning · Computer Science 2021-06-25 Francesca Cairoli , Ginevra Carbone , Luca Bortolussi