English
Related papers

Related papers: Diffusion limits of the random walk Metropolis alg…

200 papers

One main limitation of the existing optimal scaling results for Metropolis--Hastings algorithms is that the assumptions on the target distribution are unrealistic. In this paper, we consider optimal scaling of random-walk Metropolis…

Computation · Statistics 2020-05-05 Jun Yang , Gareth O. Roberts , Jeffrey S. Rosenthal

We consider the optimal scaling problem for high-dimensional random walk Metropolis (RWM) algorithms where the target distribution has a discontinuous probability density function. Almost all previous analysis has focused upon continuous…

Probability · Mathematics 2012-10-19 Peter Neal , Gareth Roberts , Wai Kong Yuen

This paper considers the optimal scaling problem for high-dimensional random walk Metropolis algorithms for densities which are differentiable in Lp mean but which may be irregular at some points (like the Laplace density for example)…

Probability · Mathematics 2016-04-25 Alain Durmus , Sylvain Le Corff , Eric Moulines , Gareth O. Roberts

We connect known results about diffusion limits of Markov chain Monte Carlo (MCMC) algorithms to the Computer Science notion of algorithm complexity. Our main result states that any diffusion limit of a Markov process implies a…

Probability · Mathematics 2014-11-05 Gareth O. Roberts , Jeffrey S. Rosenthal

The Random Walk Metropolis (RWM) algorithm is a Metropolis- Hastings MCMC algorithm designed to sample from a given target distribution \pi with Lebesgue density on R^N. RWM constructs a Markov chain by randomly proposing a new position…

Probability · Mathematics 2016-08-31 J. Kuntz , M. Ottobre , A. M. Stuart

Scaling of proposals for Metropolis algorithms is an important practical problem in MCMC implementation. Criteria for scaling based on empirical acceptance rates of algorithms have been found to work consistently well across a broad range…

Computation · Statistics 2009-09-07 Chris Sherlock , Gareth Roberts

In this paper we study the asymptotic behavior of the Random-Walk Metropolis algorithm on probability densities with two different `scales', where most of the probability mass is distributed along certain key directions with the…

Computation · Statistics 2015-10-12 Alexandros Beskos , Gareth Roberts , Alexandre Thiery , Natesh Pillai

Metropolis algorithms are classical tools for sampling from target distributions, with broad applications in statistics and scientific computing. Their convergence speed is governed by the spectral gap of the associated Markov operator.…

Probability · Mathematics 2026-04-13 Shuigen Liu , Xin T. Tong

The Metropolis-adjusted Langevin (MALA) algorithm is a sampling algorithm which makes local moves by incorporating information about the gradient of the logarithm of the target density. In this paper we study the efficiency of MALA on a…

Probability · Mathematics 2012-11-29 Natesh S. Pillai , Andrew M. Stuart , Alexandre H. Thiéry

We describe a new MCMC method optimized for the sampling of probability measures on Hilbert space which have a density with respect to a Gaussian; such measures arise in the Bayesian approach to inverse problems, and in conditioned…

Probability · Mathematics 2014-04-04 Michela Ottobre , Natesh S. Pillai , Frank J. Pinski , Andrew M. Stuart

We consider the random walk Metropolis algorithm on $\mathbb{R}^n$ with Gaussian proposals, and when the target probability measure is the $n$-fold product of a one-dimensional law. In the limit $n\to\infty$, it is well known (see [Ann.…

Probability · Mathematics 2016-08-14 Benjamin Jourdain , Tony Lelièvre , Błażej Miasojedow

We examine the optimal scaling and the efficiency of the pseudo-marginal random walk Metropolis algorithm using a recently-derived result on the limiting efficiency as the dimension, $d\rightarrow \infty$. We prove that the optimal scaling…

Computation · Statistics 2015-04-24 Chris Sherlock

We investigate local MCMC algorithms, namely the random-walk Metropolis and the Langevin algorithms, and identify the optimal choice of the local step-size as a function of the dimension $n$ of the state space, asymptotically as…

Probability · Mathematics 2009-08-07 Alexandros Beskos , Gareth Roberts , Andrew Stuart

We examine the behaviour of the pseudo-marginal random walk Metropolis algorithm, where evaluations of the target density for the accept/reject probability are estimated rather than computed precisely. Under relatively general conditions on…

Computation · Statistics 2014-12-31 Chris Sherlock , Alexandre H. Thiery , Gareth O. Roberts , Jeffrey S. Rosenthal

For certain materials science scenarios arising in rubber technology, one-dimensional moving boundary problems (MBPs) with kinetic boundary conditions are capable of unveiling the large-time behavior of the diffusants penetration front,…

Numerical Analysis · Mathematics 2023-12-04 Surendra Nepal , Magnus Ogren , Yosief Wondmagegne , Adrian Muntean

Markov chain Monte Carlo (MCMC) algorithms have played a significant role in statistics, physics, machine learning and others, and they are the only known general and efficient approach for some high-dimensional problems. The random walk…

Statistics Theory · Mathematics 2024-11-18 Ning Ning

We consider the Random Walk Metropolis algorithm on $\mathbb{R}^n$ with Gaussian proposals, and when the target probability measure is the $n$-fold product of a one-dimensional law. It is well known (see Roberts et al. (Ann. Appl. Probab. 7…

Methodology · Statistics 2014-10-22 Benjamin Jourdain , Tony Lelièvre , Błażej Miasojedow

Consider the problem of approximating a given probability distribution on the cube $[0,1]^n$ via the use of a square lattice discretization with mesh-size $1/N$ and the Metropolis algorithm. Here the dimension $n$ is fixed and we focus for…

Probability · Mathematics 2022-02-01 Laurent Saloff-Coste , Sophie Uluatam

For a given metric measure space $(X,d,\mu)$ we consider finite samples of points, calculate the matrix of distances between them and then reconstruct the points in some finite-dimensional space using the multidimensional scaling (MDS)…

Metric Geometry · Mathematics 2022-08-02 Alexey Kroshnin , Eugene Stepanov , Dario Trevisan

High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random-walk Metropolis algorithms. The assumptions under which weak convergence results are proved are however restrictive: the…

Methodology · Statistics 2022-02-16 Sebastian M Schmon , Philippe Gagnon
‹ Prev 1 2 3 10 Next ›