English
Related papers

Related papers: Scalable couplings for the random walk Metropolis …

200 papers

We present here two irreversible Markov chain Monte Carlo algorithms for general discrete state systems, one of the algorithms is based on the random-scan Gibbs sampler for discrete states and the other on its improved version, the…

Statistical Mechanics · Physics 2020-05-08 Fahim Faizi , George Deligiannidis , Edina Rosta

Adaptive Markov chain Monte Carlo (MCMC) algorithms, which automatically tune their parameters based on past samples, have proved extremely useful in practice. The self-tuning mechanism makes them `non-Markovian', which means that their…

Probability · Mathematics 2024-08-28 Pietari Laitinen , Matti Vihola

The matching problem is a notorious combinatorial optimization problem that has attracted for many years the attention of the statistical physics community. Here we analyze the Euclidean version of the problem, i.e. the optimal matching…

Disordered Systems and Neural Networks · Physics 2017-01-11 Carlo Lucibello , Giorgio Parisi , Gabriele Sicuro

The aim of this paper is to check feasibility of using the maximal-entropy random walk in algorithms finding communities in complex networks. A number of such algorithms exploit an ordinary or a biased random walk for this purpose. Their…

Physics and Society · Physics 2013-02-05 Jeremi K. Ochab , Zdzisław Burda

This Letter proposes a rescaled adaptive coupling scheme for the synchronization of spatially extended systems. Coupling and synchronization are analyzed from the point view of image filter construction. A length rescaling technique is…

Chaotic Dynamics · Physics 2007-05-23 Wei G. W

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) algorithm for estimating expectations with respect to continuous un-normalized probability distributions. MCMC estimators typically have higher variance than…

Computation · Statistics 2020-03-04 Dan Piponi , Matthew D. Hoffman , Pavel Sountsov

For random-walk Metropolis (RWM) and parallel tempering (PT) algorithms, an asymptotic acceptance rate of around 0.234 is known to be optimal in certain high-dimensional limits. However, its practical relevance is uncertain due to…

Computation · Statistics 2025-08-05 Aidan Li , Liyan Wang , Tianye Dou , Jeffrey S. Rosenthal

Markov chain Monte Carlo (MCMC) algorithms have played a significant role in statistics, physics, machine learning and others, and they are the only known general and efficient approach for some high-dimensional problems. The random walk…

Statistics Theory · Mathematics 2024-11-18 Ning Ning

Markov Chain Monte Carlo methods are algorithms used to sample probability distributions, commonly used to sample the Boltzmann distribution of physical/chemical models (e.g., protein folding, Ising model, etc.). This allows us to study…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-04 Aingeru Ramos , Jose A Pascual , Javier Navaridas , Ivan Coluzza

While one-dimensional Markov processes are well understood, going to higher dimensions there are only a few analytically solved Ising-like models, in practice requiring to use relatively costly, uncontrollable and inaccurate Monte-Carlo…

Information Theory · Computer Science 2021-04-20 Jarek Duda

The pseudo-marginal algorithm is a variant of the Metropolis--Hastings algorithm which samples asymptotically from a probability distribution when it is only possible to estimate unbiasedly an unnormalized version of its density.…

Computation · Statistics 2019-12-04 Sebastian M. Schmon , George Deligiannidis , Arnaud Doucet , Michael K. Pitt

Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poorly between posterior…

Machine Learning · Statistics 2019-08-27 Edwin Fong , Simon Lyddon , Chris Holmes

Hamiltonian Monte Carlo (HMC) is a widely used sampler for continuous probability distributions. In many cases, the underlying Hamiltonian dynamics exhibit a phenomenon of resonance which decreases the efficiency of the algorithm and makes…

Computation · Statistics 2023-02-23 Lionel Riou-Durand , Pavel Sountsov , Jure Vogrinc , Charles C. Margossian , Sam Power

Distributed maximization of a submodular function in the MapReduce (MR) model has received much attention, culminating in two frameworks that allow a centralized algorithm to be run in the MR setting without loss of approximation, as long…

Data Structures and Algorithms · Computer Science 2024-09-17 Yixin Chen , Tonmoy Dey , Alan Kuhnle

The Metropolis algorithm is arguably the most fundamental Markov chain Monte Carlo (MCMC) method. But the algorithm is not guaranteed to converge to the desired distribution in the case of multivariate binary distributions (e.g., Ising…

Machine Learning · Statistics 2020-06-29 Kai Brügge , Asja Fischer , Christian Igel

Motivated by the physics of strings and branes, we develop a class of Markov chain Monte Carlo (MCMC) algorithms involving extended objects. Starting from a collection of parallel Metropolis-Hastings (MH) samplers, we place them on an…

Computational Physics · Physics 2017-09-13 Jonathan J. Heckman , Jeffrey G. Bernstein , Ben Vigoda

In this study, we investigate the performance of the Metropolis-adjusted Langevin algorithm in a setting with constraints on the support of the target distribution. We provide a rigorous analysis of the resulting Markov chain, establishing…

Computation · Statistics 2023-05-16 Jinyuan Chang , Cheng Yong Tang , Yuanzheng Zhu

We introduce a model of self-repelling random walks where the short-range interaction between two elements of the chain decreases as a power of the difference in proper time. Analytic results on the exponent $\nu$ are obtained. They are in…

High Energy Physics - Lattice · Physics 2015-06-25 S. Caracciolo , G. Parisi , A. Pelissetto

We develop parallel algorithms for simulating zeroth-order (aka gradient-free) Metropolis Markov chains based on the Picard map. For Random Walk Metropolis Markov chains targeting log-concave distributions $\pi$ on $\mathbb{R}^d$, our…

Computation · Statistics 2026-04-10 Sebastiano Grazzi , Giacomo Zanella

Markov chain Monte Carlo (MCMC) methods are often used in clustering since they guarantee asymptotically exact expectations in the infinite-time limit. In finite time, though, slow mixing often leads to poor performance. Modern computing…

Methodology · Statistics 2022-02-24 Tin D. Nguyen , Brian L. Trippe , Tamara Broderick