English
Related papers

Related papers: Diffusion Limit For The Random Walk Metropolis Alg…

200 papers

We study the relaxation of the Metropolis Monte Carlo algorithm corresponding to a single particle trapped in a one-dimensional confining potential, with even jump distributions that ensure that the dynamics verifies detailed balance.…

Statistical Mechanics · Physics 2025-02-03 A. Patrón , A. D. Chepelianskii , A. Prados , E. Trizac

We provide a clarification of the description of Langevin diffusions on Riemannian manifolds and of the measure underlying the invariant density. As a result we propose a new position-dependent Metropolis-adjusted Langevin algorithm (MALA)…

Methodology · Statistics 2014-08-15 Tatiana Xifara , Chris Sherlock , Samuel Livingstone , Simon Byrne , Mark Girolami

Conventional wisdom in the sampling literature, backed by a popular diffusion scaling limit, suggests that the mixing time of the Metropolis-Adjusted Langevin Algorithm (MALA) scales as $O(d^{1/3})$, where $d$ is the dimension. However, the…

Statistics Theory · Mathematics 2020-12-24 Sinho Chewi , Chen Lu , Kwangjun Ahn , Xiang Cheng , Thibaut Le Gouic , Philippe Rigollet

Random Walk Metropolis Hastings (RWMH) algorithm, is quite inefficient in high dimensions because of its abysmally slow acceptance rate. The slow acceptance rate results from the fact that RWMH separately updates each coordinate of the…

Methodology · Statistics 2014-08-29 Kushal K. Dey , Sourabh Bhattacharya

The ability to generate samples of the random effects from their conditional distributions is fundamental for inference in mixed effects models. Random walk Metropolis is widely used to perform such sampling, but this method is known to…

Methodology · Statistics 2019-10-29 Belhal Karimi , Marc Lavielle , Eric Moulines

Network representation learning (NRL) technique has been successfully adopted in various data mining and machine learning applications. Random walk based NRL is one popular paradigm, which uses a set of random walks to capture the network…

Machine Learning · Computer Science 2021-01-12 Xingyu Yao , Yingxia Shao , Bin Cui , Lei Chen

We describe particles in a potential by a special diffusion process, the maximal entropy random walk (MERW) on a lattice. Since MERW originates in a variational problem, it shares the linear algebra of Hilbert spaces with quantum mechanics.…

Quantum Physics · Physics 2023-12-29 Manfried Faber

Random walk centrality is a fundamental metric in graph mining for quantifying node importance and influence, defined as the weighted average of hitting times to a node from all other nodes. Despite its ability to capture rich graph…

Artificial Intelligence · Computer Science 2025-10-24 Changan Liu , Zixuan Xie , Ahad N. Zehmakan , Zhongzhi Zhang

Our objective is to sample the node set of a large unknown graph via crawling, to accurately estimate a given metric of interest. We design a random walk on an appropriately defined weighted graph that achieves high efficiency by…

Social and Information Networks · Computer Science 2011-03-29 M. Kurant , M. Gjoka , C. T. Butts , A. Markopoulou

Hamiltonian Monte Carlo (HMC) is a very popular and generic collection of Markov chain Monte Carlo (MCMC) algorithms. One explanation for the popularity of HMC algorithms is their excellent performance as the dimension $d$ of the target…

Probability · Mathematics 2018-09-05 Oren Mangoubi , Natesh S. Pillai , Aaron Smith

Particle swarm optimization comes under lot of changes after James Kennedy and Russell Eberhart first proposes the idea in 1995. The changes has been done mainly on Inertia parameters in velocity updating equation so that the convergence…

Artificial Intelligence · Computer Science 2018-02-27 Rajesh Misra , Kumar S. Ray

We study the class of first-order locally-balanced Metropolis--Hastings algorithms introduced in Livingstone & Zanella (2021). To choose a specific algorithm within the class the user must select a balancing function $g:\mathbb{R} \to…

Computation · Statistics 2022-01-05 Jure Vogrinc , Samuel Livingstone , Giacomo Zanella

Markov chain Monte Carlo methods such as Gibbs sampling and simple forms of the Metropolis algorithm typically move about the distribution being sampled via a random walk. For the complex, high-dimensional distributions commonly encountered…

bayes-an · Physics 2008-02-03 R. M. Neal

A Markov chain (MC) formalism is used to investigate the mean-square displacement (MSD) of a random walker on Newman-Watts (NW) networks. It leads to a precise analysis of the conditions for the emergence of anomalous sub- or…

We consider random walks on discrete state spaces, such as general undirected graphs, where the random walkers are designed to approximate a target quantity over the network topology via sampling and neighborhood exploration in the form of…

Probability · Mathematics 2024-01-30 Vishwaraj Doshi , Jie Hu , Do Young Eun

The Adaptive Metropolis (AM) algorithm is based on the symmetric random-walk Metropolis algorithm. The proposal distribution has the following time-dependent covariance matrix at step $n+1$ \[ S_n = Cov(X_1,...,X_n) + \epsilon I, \] that…

Probability · Mathematics 2011-02-09 Matti Vihola

We study decentralized learning over networks where data are distributed across nodes without a central coordinator. Random walk learning is a token-based approach in which a single model is propagated across the network and updated at each…

Machine Learning · Computer Science 2026-04-15 Zonghong Liu , Matthew Dwyer , Salim El Rouayheb

In this paper we consider a new probability sampling methods based on Langevin diffusion dynamics to resolve the problem of existing Monte Carlo algorithms when draw samples from high dimensional target densities. We extent…

Machine Learning · Computer Science 2025-03-31 Z. Zarezadeh , N. Zarezadeh

In this work, we consider a modification of the usual Branching Random Walk (BRW), where we give certain independent and identically distributed (i.i.d.) displacements to all the particles at the $n$-th generation, which may be different…

Probability · Mathematics 2025-02-18 Antar Bandyopadhyay , Partha Pratim Ghosh

Algorithms for mining very large graphs, such as those representing online social networks, to discover the relative frequency of small subgraphs within them are of high interest to sociologists, computer scientists and marketeers alike.…

Social and Information Networks · Computer Science 2017-06-16 Guyue Han , Harish Sethu