English
Related papers

Related papers: Optimal scaling of the Random Walk Metropolis algo…

200 papers

We study here a detailed conjecture regarding one of the most important cases of anomalous diffusion, i.e the behavior of the "ant in the labyrinth". It is natural to conjecture (see [16] and [8]) that the scaling limit for random walks on…

Probability · Mathematics 2016-09-16 Gérard Ben Arous , Manuel Cabezas , Alexander Fribergh

We study the detailed path-wise behavior of the discrete-time Langevin algorithm for non-convex Empirical Risk Minimization (ERM) through the lens of metastability, adopting some techniques from Berglund and Gentz (2003. For a particular…

Machine Learning · Computer Science 2020-07-27 Belinda Tzen , Tengyuan Liang , Maxim Raginsky

We consider super-diffusive L\'evy walks in $d \geqslant 2$ dimensions when the duration of a single step, i.e., a ballistic motion performed by a walker, is governed by a power-law tailed distribution of infinite variance and finite mean.…

Statistical Mechanics · Physics 2017-04-05 Itzhak Fouxon , Sergey Denisov , Vasily Zaburdaev , Eli Barkai

Sampling from score-based diffusion models incurs bias due to both time discretisation and the approximation of the score function. A common strategy for reducing this bias is to apply corrector steps based on the unadjusted Langevin…

Machine Learning · Statistics 2026-05-12 Kevin H. Lam , Tyler Farghly , Christopher Williams , Jun Yang , Yee Whye Teh , Arnaud Doucet

Restrictions to molecular motion by barriers (membranes) are ubiquitous in biological tissues, porous media and composite materials. A major challenge is to characterize the microstructure of a material or an organism nondestructively using…

Soft Condensed Matter · Physics 2011-03-11 Dmitry S. Novikov , Els Fieremans , Jens H. Jensen , Joseph A. Helpern

The Metropolis-Adjusted Langevin Algorithm (MALA), originally introduced to sample exactly the invariant measure of certain stochastic differential equations (SDE) on infinitely long time intervals, can also be used to approximate pathwise…

Probability · Mathematics 2010-08-23 Nawaf Bou-Rabee , Martin Hairer , Eric Vanden-Eijnden

We study the evolution of a random walker on a conservative dynamic random environment composed of independent particles performing simple symmetric random walks, generalizing results of [16] to higher dimensions and more general transition…

There has been considerable interest in designing Markov chain Monte Carlo algorithms by exploiting numerical methods for Langevin dynamics, which includes Hamiltonian dynamics as a deterministic case. A prominent approach is Hamiltonian…

Computation · Statistics 2021-06-08 Zexi Song , Zhiqiang Tan

The Metropolis-within-Gibbs (MwG) algorithm is a widely used Markov Chain Monte Carlo method for sampling from high-dimensional distributions when exact conditional sampling is intractable. We study MwG with Random Walk Metropolis (RWM)…

Machine Learning · Statistics 2025-10-01 Cecilia Secchi , Giacomo Zanella

Parallel tempering is a generic Markov chain Monte Carlo sampling method which allows good mixing with multimodal target distributions, where conventional Metropolis-Hastings algorithms often fail. The mixing properties of the sampler…

Computation · Statistics 2012-05-08 Blazej Miasojedow , Eric Moulines , Matti Vihola

Yang et al. (2016) proved that the symmetric random walk Metropolis--Hastings algorithm for Bayesian variable selection is rapidly mixing under mild high-dimensional assumptions. We propose a novel MCMC sampler using an informed proposal…

Methodology · Statistics 2022-04-26 Quan Zhou , Jun Yang , Dootika Vats , Gareth O. Roberts , Jeffrey S. Rosenthal

This paper addresses consensus optimization problems in a multi-agent network, where all agents collaboratively find a minimizer for the sum of their private functions. We develop a new decentralized algorithm in which each agent…

Optimization and Control · Mathematics 2019-07-03 Xianghui Mao , Kun Yuan , Yubin Hu , Yuantao Gu , Ali H. Sayed , Wotao Yin

Global search and optimization of long-duration, low-thrust spacecraft trajectories with the indirect method is challenging due to a complex solution space and the difficulty of generating good initial guesses for the costate variables.…

Earth and Planetary Astrophysics · Physics 2025-10-06 Jannik Graebner , Ryne Beeson

We recently demonstrated that standard fixed-time lattice random-walk models cannot be modified to properly represent biased diffusion processes in more than two dimensions. The origin of this fundamental limitation appears to be the fact…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Michel G. Gauthier , Gary W. Slater

We study the dynamical exponents $d_{w}$ and $d_{s}$ for a particle diffusing in a disordered medium (modeled by a percolation cluster), from the regime of extreme disorder (i.e., when the percolation cluster is a fractal at $p=p_{c}$) to…

Condensed Matter · Physics 2009-10-22 Sonali Mukherjee , Hisao Nakanishi , Norman H. Fuchs

Structure learning via MCMC sampling is known to be very challenging because of the enormous search space and the existence of Markov equivalent DAGs. Theoretical results on the mixing behavior are lacking. In this work, we prove the rapid…

Statistics Theory · Mathematics 2023-04-07 Quan Zhou , Hyunwoong Chang

The random walk Metropolis (RWM) is one of the most common Markov chain Monte Carlo algorithms in practical use today. Its theoretical properties have been extensively explored for certain classes of target, and a number of results with…

Methodology · Statistics 2010-11-30 Chris Sherlock , Paul Fearnhead , Gareth O. Roberts

Gaussian Belief Propagation (BP) algorithm is one of the most important distributed algorithms in signal processing and statistical learning involving Markov networks. It is well known that the algorithm correctly computes marginal density…

Machine Learning · Statistics 2019-03-08 Zhaorong Zhang , Minyue Fu

This paper studies particle propagation in a one-dimensional inhomogeneous medium where the laws of motion are generated by chaotic and deterministic local maps. Assuming that the particle's initial location is random and uniformly…

Probability · Mathematics 2011-10-18 Lasse Leskelä , Mikko Stenlund

We revisit the statistics of extremes and records of symmetric random walks with stochastic resetting, extending earlier studies in several directions. We put forward a diffusive scaling regime (symmetric step length distribution with…

Statistical Mechanics · Physics 2022-06-29 Claude Godrèche , Jean-Marc Luck