English
Related papers

Related papers: Diffusion Limit For The Random Walk Metropolis Alg…

200 papers

Probabilistic sampling-based algorithms, such as the probabilistic roadmap (PRM) and the rapidly-exploring random tree (RRT) algorithms, represent one of the most successful approaches to robotic motion planning, due to their strong…

Robotics · Computer Science 2016-05-04 Lucas Janson , Brian Ichter , Marco Pavone

This paper studies an approximation method for the log-likelihood function of a nonlinear diffusion process using the bridge of the diffusion. The main result (Theorem \refthm:approx) shows that this approximation converges uniformly to the…

Statistics Theory · Mathematics 2010-01-11 Aleksandar Mijatović , Paul Schneider

We consider a random walk model in a one-dimensional environment, formed by several zones of finite width with the fixed transition probabilities. It is also assumed that the transitions to the left and right neighboring points have unequal…

Statistical Mechanics · Physics 2017-08-18 A. V. Nazarenko , V. Blavatska

Metropolis-Hastings estimates intractable expectations - can differentiating the algorithm estimate their gradients? The challenge is that Metropolis-Hastings trajectories are not conventionally differentiable due to the discrete…

Statistics Theory · Mathematics 2024-06-21 Gaurav Arya , Moritz Schauer , Ruben Seyer

Random walks provide a simple conventional model to describe various transport processes, for example propagation of heat or diffusion of matter through a medium. However, in many practical cases the medium is highly irregular due to…

Probability · Mathematics 2019-06-10 L. V. Bogachev

Item-based models are among the most popular collaborative filtering approaches for building recommender systems. Random walks can provide a powerful tool for harvesting the rich network of interactions captured within these models. They…

Information Retrieval · Computer Science 2020-10-07 Athanasios N. Nikolakopoulos , George Karypis

We introduce a gradient-based learning method to automatically adapt Markov chain Monte Carlo (MCMC) proposal distributions to intractable targets. We define a maximum entropy regularised objective function, referred to as generalised speed…

Machine Learning · Statistics 2020-01-07 Michalis K. Titsias , Petros Dellaportas

In this paper, we consider sampling from a class of distributions with thin tails supported on $\mathbb{R}^d$ and make two primary contributions. First, we propose a new Metropolized Algorithm With Optimization Step (MAO), which is well…

Machine Learning · Statistics 2021-12-02 EL Mahdi Khribch , George Deligiannidis , Daniel Paulin

We provide a general steady-state diffusion approximation result which bounds the Wasserstein distance between the reversible measure $\mu$ of a diffusion process and the measure $\nu$ of an approximating Markov chain. Our result is…

Probability · Mathematics 2022-03-15 Thomas Bonis

We consider random walks in dynamic random environments given by Markovian dynamics on $\mathbb{Z}^d$. We assume that the environment has a stationary distribution $\mu$ and satisfies the Poincar\'e inequality w.r.t. $\mu$. The random walk…

Probability · Mathematics 2016-11-01 L. Avena , O. Blondel , A. Faggionato

Random walkers absorbing on a boundary sample the Harmonic Measure linearly and independently: we discuss how the recurrence times between impacts enable non-linear moments of the measure to be estimated. From this we derive a new technique…

Statistical Mechanics · Physics 2007-05-23 Ellak Somfai , Nicholas R. Goold , Robin C. Ball , Jason P. DeVita , Leonard M. Sander

In this paper, we investigate the diffusion least mean square (DLMS) algorithm over fading channel, where in addition to channel noise and path-loss the inter-node-interference (INI) among neighboring nodes of a host node is also taken into…

Signal Processing · Electrical Eng. & Systems 2023-03-21 Mohammadjavad Mirzazadeh Moallem , Mehdi Korki

Enhancing the stability of machine learning algorithms under distributional shifts is at the heart of the Out-of-Distribution (OOD) Generalization problem. Derived from causal learning, recent works of invariant learning pursue strict…

Machine Learning · Computer Science 2024-02-15 Jiashuo Liu , Jiayun Wu , Jie Peng , Xiaoyu Wu , Yang Zheng , Bo Li , Peng Cui

The performance of Metropolis-Hastings algorithms is highly sensitive to the choice of step size, and miss-specification can lead to severe loss of efficiency. We study algorithms with randomized step sizes, considering both…

Computation · Statistics 2026-01-28 Sebastiano Grazzi , Samuel Livingstone , Lionel Riou-Durand

We investigate experimental design for randomized controlled trials (RCTs) with both equal and unequal treatment-control assignment probabilities. Our work makes progress on the connection between the distributional discrepancy minimization…

Methodology · Statistics 2025-03-20 Anup B. Rao , Peng Zhang

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

We focus on the study of dynamics of two kinds of random walk: generic random walk (GRW) and maximal entropy random walk (MERW) on two model networks: Cayley trees and ladder graphs. The stationary probability distribution for MERW is given…

Statistical Mechanics · Physics 2012-06-01 Jeremi K. Ochab

A distributed adaptive algorithm is proposed to solve a node-specific parameter estimation problem where nodes are interested in estimating parameters of local interest, parameters of common interest to a subset of nodes and parameters of…

Computers and Society · Computer Science 2023-07-19 Jorge Plata-Chaves , Nikola Bogdanovic , Kostas Berberidis

Hamiltonian Monte Carlo (HMC) is a widely used sampler for continuous probability distributions. In many cases, the underlying Hamiltonian dynamics exhibit a phenomenon of resonance which decreases the efficiency of the algorithm and makes…

Computation · Statistics 2023-02-23 Lionel Riou-Durand , Pavel Sountsov , Jure Vogrinc , Charles C. Margossian , Sam Power

We propose a novel Bayesian approach to the problem of variable selection in multiple linear regression models. In particular, we present a hierarchical setting which allows for direct specification of a-priori beliefs about the number of…

Computation · Statistics 2019-03-14 Konstantin Posch , Maximilian Arbeiter , Jürgen Pilz