English
Related papers

Related papers: Optimal scaling of the Random Walk Metropolis algo…

200 papers

In this paper, we provide a multiscale perspective on the problem of maximum marginal likelihood estimation. We consider and analyse a diffusion-based maximum marginal likelihood estimation scheme using ideas from multiscale dynamics. Our…

Computation · Statistics 2024-06-11 O. Deniz Akyildiz , Michela Ottobre , Iain Souttar

The availability of data sets with large numbers of variables is rapidly increasing. The effective application of Bayesian variable selection methods for regression with these data sets has proved difficult since available Markov chain…

Computation · Statistics 2019-05-08 Jim Griffin , Krys Latuszynski , Mark Steel

In this paper, we consider sampling from a class of distributions with thin tails supported on $\mathbb{R}^d$ and make two primary contributions. First, we propose a new Metropolized Algorithm With Optimization Step (MAO), which is well…

Machine Learning · Statistics 2021-12-02 EL Mahdi Khribch , George Deligiannidis , Daniel Paulin

We study the problem of sampling from a distribution $\target$ using the Langevin Monte Carlo algorithm and provide rate of convergences for this algorithm in terms of Wasserstein distance of order $2$. Our result holds as long as the…

Computation · Statistics 2016-07-04 Thomas Bonis

Behind the nice unification provided by the notion of the level 2.5 in the field of large deviations for time-averages over a long Markov trajectory, there are nevertheless very important qualitative differences between the meaning of the…

Statistical Mechanics · Physics 2024-02-20 Cecile Monthus

Langevin algorithms are popular Markov chain Monte Carlo (MCMC) methods for large-scale sampling problems that often arise in data science. We propose Monte Carlo algorithms based on the discretizations of $P$-th order Langevin dynamics for…

Machine Learning · Statistics 2025-08-26 Thanh Dang , Mert Gurbuzbalaban , Mohammad Rafiqul Islam , Nian Yao , Lingjiong Zhu

This paper analyses a $(1,\lambda)$-Evolution Strategy, a randomised comparison-based adaptive search algorithm, on a simple constraint optimisation problem. The algorithm uses resampling to handle the constraint and optimizes a linear…

Neural and Evolutionary Computing · Computer Science 2014-12-09 Alexandre Chotard , Anne Auger , Nikolaus Hansen

We present large deviations estimates in the supremum norm for a system of independent random walks superposed with a birth-and-death dynamics evolving on the discrete torus with $N$ sites. The scaling limit considered is the so-called…

Probability · Mathematics 2021-02-26 Tertuliano Franco , Luana A. Gurgel , Bernardo N. B. de Lima

We consider a recently proposed class of MCMC methods which uses proximity maps instead of gradients to build proposal mechanisms which can be employed for both differentiable and non-differentiable targets. These methods have been shown to…

Computation · Statistics 2024-06-21 Francesca R. Crucinio , Alain Durmus , Pablo Jiménez , Gareth O. Roberts

Performing random walks in networks is a fundamental primitive that has found applications in many areas of computer science, including distributed computing. In this paper, we focus on the problem of sampling random walks efficiently in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-02-20 Atish Das Sarma , Danupon Nanongkai , Gopal Pandurangan , Prasad Tetali

Different Markov chains can be used for approximate sampling of a distribution given by an unnormalized density function with respect to the Lebesgue measure. The hit-and-run, (hybrid) slice sampler and random walk Metropolis algorithm are…

Probability · Mathematics 2019-08-15 Daniel Rudolf , Mario Ullrich

Consider a family of random ordered graph trees $(T_n)_{n\geq 1}$, where $T_n$ has $n$ vertices. It has previously been established that if the associated search-depth processes converge to the normalised Brownian excursion when rescaled…

Probability · Mathematics 2012-10-24 David A. Croydon

We consider the penetration length $l$ of random walkers diffusing in a medium of perfect or imperfect absorbers of number density $\rho$. We solve this problem on a lattice and in the continuum in all dimensions $D$, by means of a…

Statistical Mechanics · Physics 2009-11-11 David S. Dean , Clément Sire , Julien Sopik

We analyse how simple local constraints in two dimensions lead a defect to exhibit robust, non-transient, and tunable, subdiffusion. We uncover a rich dynamical phenomenology realised in ice- and dimer-type models. On the microscopic scale…

Mesoscale and Nanoscale Physics · Physics 2025-04-02 Nilotpal Chakraborty , Markus Heyl , Roderich Moessner

In \cite{SzT}, D. Sz\'asz and A. Telcs have shown that for the diffusively scaled, simple symmetric random walk, weak convergence to the Brownian motion holds even in the case of local impurities if $d \ge 2$. The extension of their result…

Probability · Mathematics 2015-05-20 Daniel Paulin , Domokos Szász

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main result is a…

Statistics Theory · Mathematics 2024-03-01 Shogo Nakakita

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann

We prove explicit, i.e. non-asymptotic, error bounds for Markov chain Monte Carlo methods. The problem is to compute the expectation of a function f with respect to a measure {\pi}. Different convergence properties of Markov chains imply…

Probability · Mathematics 2020-04-07 Daniel Rudolf

A random-walk Metropolis sampler is geometrically ergodic if its equilibrium density is super-exponentially light and satisfies a curvature condition [Stochastic Process. Appl. 85 (2000) 341-361]. Many applications, including Bayesian…

Statistics Theory · Mathematics 2013-12-12 Leif T. Johnson , Charles J. Geyer

We study Markov chains on $\mathbb Z^m$, $m\geq 2$, that behave like a standard symmetric random walk outside of the hyperplane (membrane) $H=\{0\}\times \mathbb Z^{m-1}$. The transition probabilities on the membrane $H$ are periodic and…

Probability · Mathematics 2021-08-05 V. Bogdanskii , I. Pavlyukevich , A. Pilipenko