English
Related papers

Related papers: Parallel Metropolis chains with cooperative adapta…

200 papers

Self-learning Monte Carlo (SLMC) methods are recently proposed to accelerate Markov chain Monte Carlo (MCMC) methods using a machine learning model. With latent generative models, SLMC methods realize efficient Monte Carlo updates with less…

Machine Learning · Statistics 2023-09-21 Yuma Ichikawa , Akira Nakagawa , Hiromoto Masayuki , Yuhei Umeda

There is a lack of methodological results to design efficient Markov chain Monte Carlo (MCMC) algorithms for statistical models with discrete-valued high-dimensional parameters. Motivated by this consideration, we propose a simple framework…

Computation · Statistics 2017-11-21 Giacomo Zanella

Today, cheap numerical hardware offers huge amounts of parallel computing power, much of which is used for the task of fitting neural networks to data. Adoption of this hardware to accelerate statistical Markov chain Monte Carlo (MCMC)…

Computation · Statistics 2024-11-08 Pavel Sountsov , Colin Carroll , Matthew D. Hoffman

Recently there have been exciting developments in Monte Carlo methods, with the development of new MCMC and sequential Monte Carlo (SMC) algorithms which are based on continuous-time, rather than discrete-time, Markov processes. This has…

Computation · Statistics 2020-09-29 Paul Fearnhead , Joris Bierkens , Murray Pollock , Gareth O Roberts

We present a new framework to derandomise certain Markov chain Monte Carlo (MCMC) algorithms. As in MCMC, we first reduce counting problems to sampling from a sequence of marginal distributions. For the latter task, we introduce a method…

Data Structures and Algorithms · Computer Science 2023-04-05 Weiming Feng , Heng Guo , Chunyang Wang , Jiaheng Wang , Yitong Yin

We study multiproposal Markov chain Monte Carlo algorithms, such as Multiple-try or generalised Metropolis-Hastings schemes, which have recently received renewed attention due to their amenability to parallel computing. First, we prove that…

Computation · Statistics 2024-10-31 Francesco Pozza , Giacomo Zanella

Markov chain Monte Carlo (MCMC) methods are often used in clustering since they guarantee asymptotically exact expectations in the infinite-time limit. In finite time, though, slow mixing often leads to poor performance. Modern computing…

Methodology · Statistics 2022-02-24 Tin D. Nguyen , Brian L. Trippe , Tamara Broderick

Markov chain Monte Carlo (MCMC) algorithms are generally regarded as the gold standard technique for Bayesian inference. They are theoretically well-understood and conceptually simple to apply in practice. The drawback of MCMC is that in…

Computation · Statistics 2019-07-17 Christopher Nemeth , Paul Fearnhead

I show how one can modify the random-walk Metropolis MCMC method in such a way that a sequence of modified Metropolis updates takes little computation time when the rejection rate is outside a desired interval. This allows one to…

Statistics Theory · Mathematics 2007-06-13 Radford M. Neal

Markov Chain Monte Carlo (MCMC) algorithms are widely used for stochastic optimization, sampling, and integration of mathematical objective functions, in particular, in the context of Bayesian inverse problems and parameter estimation. For…

Data Analysis, Statistics and Probability · Physics 2020-10-12 Shashank Kumbhare , Amir Shahmoradi

Multiple-try Metropolis (MTM) is a popular Markov chain Monte Carlo method with the appealing feature of being amenable to parallel computing. At each iteration, it samples several candidates for the next state of the Markov chain and…

Computation · Statistics 2023-08-25 Philippe Gagnon , Florian Maire , Giacomo Zanella

We develop a modular approach to Markov chain Monte Carlo (MCMC) sampling for unnormalized target densities. In this approach, Markov chains are constructed in parallel, each constrained to a subset of the target space. The Monte Carlo…

Computation · Statistics 2026-05-05 Joonha Park

We propose a Markov Chain Monte Carlo (MCMC) algorithm based on Gibbs sampling with parallel tempering to solve nonlinear optimal control problems. The algorithm is applicable to nonlinear systems with dynamics that can be approximately…

Optimization and Control · Mathematics 2024-07-10 João Hespanha , Kerem Camsari

Markov Chain Monte Carlo (MCMC) algorithms are often used for approximate inference inside learning, but their slow mixing can be difficult to diagnose and the approximations can seriously degrade learning. To alleviate these issues, we…

Machine Learning · Computer Science 2015-02-25 Jacob Steinhardt , Percy Liang

Particle MCMC is a class of algorithms that can be used to analyse state-space models. They use MCMC moves to update the parameters of the models, and particle filters to propose values for the path of the state-space model. Currently the…

Computation · Statistics 2014-12-25 Chris Nemeth , Paul Fearnhead

Adaptive and interacting Markov Chains Monte Carlo (MCMC) algorithms are a novel class of non-Markovian algorithms aimed at improving the simulation efficiency for complicated target distributions. In this paper, we study a general…

Statistics Theory · Mathematics 2011-07-15 Gersende Fort , Eric Moulines , Pierre Priouret , Pierre Vandekerkhove

Markov Chain Monte Carlo (MCMC) methods, such as the Metropolis-Hastings (MH) algorithm, are widely used for Bayesian inference. One of the most important issues for any MCMC method is the convergence of the Markov chain, which depends…

Computation · Statistics 2015-11-20 Luca Martino , Jesse Read , David Luengo

There has been a recent surge of interest in coupling methods for Markov chain Monte Carlo algorithms: they facilitate convergence quantification and unbiased estimation, while exploiting embarrassingly parallel computing capabilities.…

Computation · Statistics 2025-09-03 Tamás P. Papp , Chris Sherlock

Sequential Monte Carlo (SMC) methods are not only a popular tool in the analysis of state space models, but offer an alternative to MCMC in situations where Bayesian inference must proceed via simulation. This paper introduces a new SMC…

Computation · Statistics 2010-05-11 Paul Fearnhead , Benjamin M. Taylor

We develop a new Markov chain on graph partitions that makes relatively global moves yet is computationally feasible to be used as the proposal in the Metropolis-Hastings method. Our resulting algorithm can be made reversible and able to…

Data Structures and Algorithms · Computer Science 2021-05-11 Eric Autrey , Daniel Carter , Gregory Herschlag , Zach Hunter , Jonathan C. Mattingly
‹ Prev 1 4 5 6 7 8 10 Next ›