English
Related papers

Related papers: The Random Walk Metropolis: Linking Theory and Pra…

200 papers

We propose a new class of learning algorithms that combines variational approximation and Markov chain Monte Carlo (MCMC) simulation. Naive algorithms that use the variational approximation as proposal distribution can perform poorly…

Machine Learning · Computer Science 2013-01-14 Nando de Freitas , Pedro Hojen-Sorensen , Michael I. Jordan , Stuart Russell

Path planning is a crucial algorithmic approach for designing robot behaviors. Sampling-based approaches, like rapidly exploring random trees (RRTs) or probabilistic roadmaps, are prominent algorithmic solutions for path planning problems.…

Robotics · Computer Science 2022-08-05 T. Dam , G. Chalvatzaki , J. Peters , J. Pajarinen

Random walk centrality is a fundamental metric in graph mining for quantifying node importance and influence, defined as the weighted average of hitting times to a node from all other nodes. Despite its ability to capture rich graph…

Artificial Intelligence · Computer Science 2025-10-24 Changan Liu , Zixuan Xie , Ahad N. Zehmakan , Zhongzhi Zhang

A random walk is a basic stochastic process on graphs and a key primitive in the design of distributed algorithms. One of the most important features of random walks is that, under mild conditions, they converge to a stationary distribution…

Probability · Mathematics 2020-06-19 Leran Cai , Thomas Sauerwald , Luca Zanetti

Convergence rate analyses of random walk Metropolis-Hastings Markov chains on general state spaces have largely focused on establishing sufficient conditions for geometric ergodicity or on analysis of mixing times. Geometric ergodicity is a…

Statistics Theory · Mathematics 2023-07-24 Riddhiman Bhattacharya , Galin L. Jones

A new class of one-dimensional, discrete time random walk model with memory, termed "Random walk with $n$ memory channels" (RW$n$MC) is proposed. In this model the information of $n$ ($n\in \mathbb{Z}$) previous steps from the walker's…

Statistical Mechanics · Physics 2025-06-19 Surajit Saha

Many random processes can be simulated as the output of a deterministic model accepting random inputs. Such a model usually describes a complex mathematical or physical stochastic system and the randomness is introduced in the input…

Machine Learning · Statistics 2012-11-21 A. Gokcen Mahmutoglu , Alper T. Erdogan , Alper Demir

Particle MCMC is a class of algorithms that can be used to analyse state-space models. They use MCMC moves to update the parameters of the models, and particle filters to propose values for the path of the state-space model. Currently the…

Computation · Statistics 2014-12-25 Chris Nemeth , Paul Fearnhead

We connect known results about diffusion limits of Markov chain Monte Carlo (MCMC) algorithms to the Computer Science notion of algorithm complexity. Our main result states that any diffusion limit of a Markov process implies a…

Probability · Mathematics 2014-11-05 Gareth O. Roberts , Jeffrey S. Rosenthal

Graph sampling via crawling has been actively considered as a generic and important tool for collecting uniform node samples so as to consistently estimate and uncover various characteristics of complex networks. The so-called simple random…

Methodology · Statistics 2012-04-19 Chul-Ho Lee , Xin Xu , Do Young Eun

The purpose of this paper is to introduce a new Markov chain Monte Carlo method and exhibit its efficiency by simulation and high-dimensional asymptotic theory. Key fact is that our algorithm has a reversible proposal transition kernel,…

Methodology · Statistics 2014-12-22 Kengo Kamatani

We generalize the Metropolis et al. random walk algorithm to the situation where the energy is noisy and can only be estimated. Two possible applications are for long range potentials and for mixed quantum-classical simulations. If the…

Computational Physics · Physics 2009-10-31 D. M. Ceperley , M. Dewing

There is increasing interest to develop Bayesian inferential algorithms for point process models with intractable likelihoods. A purpose of this paper is to illustrate the utility of using simulation based strategies, including Approximate…

Computation · Statistics 2026-02-02 Chaoyi Lu , Nial Friel

The aim of this paper is to deepen the analysis of the asymptotic behavior of the so-called minimal random walk (MRW) using a new martingale approach. The MRW is a discrete-time random walk with infinite memory that has three regimes…

Probability · Mathematics 2023-06-21 Bernard Bercu , Víctor Hugo Vázquez Guevara

Predicting links in complex networks has been one of the essential topics within the realm of data mining and science discovery over the past few years. This problem remains an attempt to identify future, deleted, and redundant links using…

Social and Information Networks · Computer Science 2021-05-21 Kamal Berahmand , Elahe Nasiri , Saman Forouzandeh , Yuefeng Li

We propose a weighting scheme for the proposals within Markov chain Monte Carlo algorithms and show how this can improve statistical efficiency at no extra computational cost. These methods are most powerful when combined with…

Computation · Statistics 2015-07-01 Espen Bernton , Shihao Yang , Yang Chen , Neil Shephard , Jun S. Liu

There have been extensive studies of a random walk among a field of immobile traps (or obstacles), where one is interested in the probability of survival as well as the law of the random walk conditioned on its survival up to time $t$. In…

Probability · Mathematics 2019-10-25 Siva Athreya , Alexander Drewitz , Rongfeng Sun

In this work, Transition Probability Matrix (TPM) is proposed as a new method for extracting the features of nodes in the graph. The proposed method uses random walks to capture the connectivity structure of a node's close neighborhood. The…

Machine Learning · Computer Science 2023-03-07 Sarmad N. Mohammed , Semra Gündüç

We aim to improve upon the exploration of the general-purpose random walk Metropolis algorithm when the target has non-convex support $A \subset \mathbb{R}^d$, by reusing proposals in $A^c$ which would otherwise be rejected. The algorithm…

Probability · Mathematics 2021-08-17 John Moriarty , Jure Vogrinc , Alessandro Zocca

This work extends Roberts et al. (1997) by considering limits of Random Walk Metropolis (RWM) applied to block IID target distributions, with corresponding block-independent proposals. The extension verifies the robustness of the optimal…

Probability · Mathematics 2019-02-19 Jeffrey Negrea