English
Related papers

Related papers: Metropolis Monte Carlo sampling: convergence, loca…

200 papers

We investigate local MCMC algorithms, namely the random-walk Metropolis and the Langevin algorithms, and identify the optimal choice of the local step-size as a function of the dimension $n$ of the state space, asymptotically as…

Probability · Mathematics 2009-08-07 Alexandros Beskos , Gareth Roberts , Andrew Stuart

Markov chain Monte Carlo methods are central in computational statistics, and typically rely on detailed balance to ensure invariance with respect to a target distribution. Although straightforward to construct by Metropolization, this can…

Statistics Theory · Mathematics 2025-11-14 Erik Jansson , Moritz Schauer , Ruben Seyer , Akash Sharma

The stability and ergodicity properties of two adaptive random walk Metropolis algorithms are considered. The both algorithms adjust the scaling of the proposal distribution continuously based on the observed acceptance probability. Unlike…

Probability · Mathematics 2011-11-21 Matti Vihola

Lifted samplers form a class of Markov chain Monte Carlo methods which has drawn a lot attention in recent years due to superior performance in challenging Bayesian applications. A canonical example of lifted samplers is the one that is…

Computation · Statistics 2026-05-01 Philippe Gagnon , Florian Maire

We describe a general strategy for sampling configurations from a given distribution, NOT based on the standard Metropolis (Markov chain) strategy. It uses the fact that nontrivial problems in statistical physics are high dimensional and…

Statistical Mechanics · Physics 2009-11-07 P. Grassberger

Various Markov chain Monte Carlo (MCMC) methods are studied to improve upon random walk Metropolis sampling, for simulation from complex distributions. Examples include Metropolis-adjusted Langevin algorithms, Hamiltonian Monte Carlo, and…

Computation · Statistics 2020-05-19 Zexi Song , Zhiqiang Tan

The Metropolis algorithm is one of the Markov chain Monte Carlo (MCMC) methods that realize sampling from the target probability distribution. In this paper, we are concerned with the sampling from the distribution in non-identifiable cases…

Statistics Theory · Mathematics 2024-06-04 Kenji Nagata , Yoh-ichi Mototake

We construct a new Markov chain Monte Carlo method on finite states with optimal choices of acceptance-rejection ratio functions. We prove that the constructed continuous time Markov jumping process has a global in-time convergence rate in…

Optimization and Control · Mathematics 2023-02-06 Wuchen Li , Linyuan Lu

We demonstrate the use of a variational method to determine a quantitative lower bound on the rate of convergence of Markov Chain Monte Carlo (MCMC) algorithms as a function of the target density and proposal density. The bound relies on…

Data Analysis, Statistics and Probability · Physics 2013-05-29 Fergal P. Casey , Joshua J. Waterfall , Ryan N. Gutenkunst , Christopher R. Myers , James P. Sethna

We propose a new Monte Carlo method for sampling from multimodal distributions. The idea of this technique is based on splitting the task into two: finding the modes of a target distribution $\pi$ and sampling, given the knowledge of the…

Computation · Statistics 2019-01-14 Emilia Pompe , Chris Holmes , Krzysztof Łatuszyński

High-quality random samples of quantum states are needed for a variety of tasks in quantum information and quantum computation. Searching the high-dimensional quantum state space for a global maximum of an objective function with many local…

Quantum Physics · Physics 2015-04-28 Yi-Lin Seah , Jiangwei Shang , Hui Khoon Ng , David John Nott , Berthold-Georg Englert

We study decentralized learning over networks where data are distributed across nodes without a central coordinator. Random walk learning is a token-based approach in which a single model is propagated across the network and updated at each…

Machine Learning · Computer Science 2026-04-15 Zonghong Liu , Matthew Dwyer , Salim El Rouayheb

This paper describes a new Monte Carlo method based on a novel stochastic potential switching algorithm. This algorithm enables the equilibrium properties of a system with potential $V$ to be computed using a Monte Carlo simulation for a…

Statistical Mechanics · Physics 2007-05-23 C. H. Mak

There has been a recent surge of interest in coupling methods for Markov chain Monte Carlo algorithms: they facilitate convergence quantification and unbiased estimation, while exploiting embarrassingly parallel computing capabilities.…

Computation · Statistics 2025-09-03 Tamás P. Papp , Chris Sherlock

We study the rate of convergence to equilibrium of the self-repellent random walk and its local time process on the discrete circle $\mathbb{Z}_n$. While the self-repellent random walk alone is non-Markovian since the jump rates depend on…

Probability · Mathematics 2025-12-01 Andreas Eberle , Francis Lörler

We introduce a gradient-based learning method to automatically adapt Markov chain Monte Carlo (MCMC) proposal distributions to intractable targets. We define a maximum entropy regularised objective function, referred to as generalised speed…

Machine Learning · Statistics 2020-01-07 Michalis K. Titsias , Petros Dellaportas

In most sampling algorithms, including Hamiltonian Monte Carlo, transition rates between states correspond to the probability of making a transition in a single time step, and are constrained to be less than or equal to 1. We derive a…

Machine Learning · Statistics 2015-10-13 Andrew B. Berger , Mayur Mudigonda , Michael R. DeWeese , Jascha Sohl-Dickstein

One main limitation of the existing optimal scaling results for Metropolis--Hastings algorithms is that the assumptions on the target distribution are unrealistic. In this paper, we consider optimal scaling of random-walk Metropolis…

Computation · Statistics 2020-05-05 Jun Yang , Gareth O. Roberts , Jeffrey S. Rosenthal

Many random processes can be simulated as the output of a deterministic model accepting random inputs. Such a model usually describes a complex mathematical or physical stochastic system and the randomness is introduced in the input…

Machine Learning · Statistics 2012-11-21 A. Gokcen Mahmutoglu , Alper T. Erdogan , Alper Demir

The basic problem in equilibrium statistical mechanics is to compute phase space average, in which Monte Carlo method plays a very important role. We begin with a review of nonlocal algorithms for Markov chain Monte Carlo simulation in…

Statistical Mechanics · Physics 2007-05-23 Jian-Sheng Wang