English
Related papers

Related papers: The Random Walk Metropolis: Linking Theory and Pra…

200 papers

The Metropolis algorithm is arguably the most fundamental Markov chain Monte Carlo (MCMC) method. But the algorithm is not guaranteed to converge to the desired distribution in the case of multivariate binary distributions (e.g., Ising…

Machine Learning · Statistics 2020-06-29 Kai Brügge , Asja Fischer , Christian Igel

The Metropolis-within-Gibbs (MwG) algorithm is a widely used Markov Chain Monte Carlo method for sampling from high-dimensional distributions when exact conditional sampling is intractable. We study MwG with Random Walk Metropolis (RWM)…

Machine Learning · Statistics 2025-10-01 Cecilia Secchi , Giacomo Zanella

We review various features of the statistics of random paths on graphs. The relationship between path statistics and Quantum Mechanics (QM) leads to two canonical ways of defining random walk on a graph, which have different statistics and…

Statistical Mechanics · Physics 2010-08-04 Z. Burda , J. Duda , J. M. Luck , B. Waclaw

We demonstrate the use of a variational method to determine a quantitative lower bound on the rate of convergence of Markov Chain Monte Carlo (MCMC) algorithms as a function of the target density and proposal density. The bound relies on…

Data Analysis, Statistics and Probability · Physics 2013-05-29 Fergal P. Casey , Joshua J. Waterfall , Ryan N. Gutenkunst , Christopher R. Myers , James P. Sethna

The multiple-try Metropolis (MTM) algorithm is a generalization of the Metropolis-Hastings algorithm in which the transition kernel uses a compound proposal consisting of multiple candidate draws. Since its seminal paper there have been…

Computation · Statistics 2025-03-17 Renny Doig , Liangliang Wang

In this paper we study the asymptotic behavior of the Random-Walk Metropolis algorithm on probability densities with two different `scales', where most of the probability mass is distributed along certain key directions with the…

Computation · Statistics 2015-10-12 Alexandros Beskos , Gareth Roberts , Alexandre Thiery , Natesh Pillai

We present an approach to interface branching random walks with Markov chain Monte Carlo sampling, and to switch seamlessly between the two. The approach is discussed in the context of auxiliary-field quantum Monte Carlo (AFQMC) but is…

Strongly Correlated Electrons · Physics 2023-11-01 Zhi-Yu Xiao , Hao Shi , Shiwei Zhang

Random walk in random environment (RWRE) is a fundamental model of statistical mechanics, describing the movement of a particle in a highly disordered and inhomogeneous medium as a random walk with random jump probabilities. It has been…

Probability · Mathematics 2013-09-11 Alexander Drewitz , Alejandro F. Ramírez

The Metropolis-Hastings algorithm is a cornerstone of Markov Chain Monte Carlo methods, underpinning a wide range of applications in computational physics, Bayesian inference, and machine learning. Quantum variants of Metropolis-Hastings…

Quantum Physics · Physics 2026-05-07 Miguel Carrasco-Arango , Rosa M. Badia , Artur Garcia-Saez

Very recently, Transformation based Markov Chain Monte Carlo (TMCMC) was proposed by Dutta and Bhattcharya (2013) as a much efficient alternative to the Metropolis-Hastings algorithm, Random Walk Metropolis (RWM) algorithm, especially in…

Computation · Statistics 2017-07-26 Kushal Kr Dey , Sourabh Bhattacharya

We consider the recently introduced Transformation-based Markov Chain Monte Carlo (TMCMC) (Dutta and Bhattacharya (2014)), a methodology that is designed to update all the parameters simultaneously using some simple deterministic…

Methodology · Statistics 2017-01-24 Kushal Kumar Dey , Sourabh Bhattacharya

The Metropolis Hastings algorithm and its multi-proposal extensions are aimed at the computation of the expectation $<\pi,f>$ of a function $f$ under a probability measure $\pi$ difficult to simulate. They consist in constructing by an…

Probability · Mathematics 2009-02-20 Jean-François Delmas , Benjamin Jourdain

The Monte Carlo within Metropolis (MCwM) algorithm, interpreted as a perturbed Metropolis-Hastings (MH) algorithm, provides an approach for approximate sampling when the target distribution is intractable. Assuming the unperturbed Markov…

Computation · Statistics 2019-07-31 Felipe Medina-Aguayo , Daniel Rudolf , Nikolaus Schweizer

We study decentralized learning over networks where data are distributed across nodes without a central coordinator. Random walk learning is a token-based approach in which a single model is propagated across the network and updated at each…

Machine Learning · Computer Science 2026-04-15 Zonghong Liu , Matthew Dwyer , Salim El Rouayheb

In this paper a method based on a Markov chain Monte Carlo (MCMC) algorithm is proposed to compute the probability of a rare event. The conditional distribution of the underlying process given that the rare event occurs has the probability…

Probability · Mathematics 2012-11-12 Thorbjörn Gudmundsson , Henrik Hult

In dynamic Monte Carlo simulations, using for example the Metropolis dynamic, it is often required to simulate for long times and to simulate large systems. We present an overview of advanced algorithms to simulate for larger times and to…

Statistical Mechanics · Physics 2007-05-23 M. A. Novotny , Alice K. Kolakowska , G. Korniss

Random Walk Metropolis Hastings (RWMH) algorithm, is quite inefficient in high dimensions because of its abysmally slow acceptance rate. The slow acceptance rate results from the fact that RWMH separately updates each coordinate of the…

Methodology · Statistics 2014-08-29 Kushal K. Dey , Sourabh Bhattacharya

This paper explores decentralized learning in a graph-based setting, where data is distributed across nodes. We investigate a decentralized SGD algorithm that utilizes a random walk to update a global model based on local data. Our focus is…

Machine Learning · Computer Science 2024-07-31 Zonghong Liu , Salim El Rouayheb , Matthew Dwyer

The ability to generate samples of the random effects from their conditional distributions is fundamental for inference in mixed effects models. Random walk Metropolis is widely used to conduct such sampling, but such a method can converge…

Applications · Statistics 2019-10-29 Belhal Karimi , Marc Lavielle

We study random walk on complex networks with transition probabilities which depend on the current and previously visited nodes. By using an absorbing Markov chain we derive an exact expression for the mean first passage time between pairs…

Physics and Society · Physics 2024-11-14 Lasko Basnarkov , Miroslav Mirchev , Ljupco Kocarev