English
Related papers

Related papers: Sampling from Rough Energy Landscapes

200 papers

In this work, we propose a first-order sampling method called the Metropolis-adjusted Preconditioned Langevin Algorithm for approximate sampling from a target distribution whose support is a proper convex subset of $\mathbb{R}^{d}$. Our…

Computation · Statistics 2025-02-27 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson

Both resources in the natural environment and concepts in a semantic space are distributed "patchily", with large gaps in between the patches. To describe people's internal and external foraging behavior, various random walk models have…

Machine Learning · Computer Science 2017-10-17 Jian-Qiao Zhu , Adam N. Sanborn , Nick Chater

Metropolis algorithm has been extensively employed for simulating a canonical ensemble and estimating macroscopic properties of a closed system at any desired temperature. A mechanical property, like energy can be calculated by averaging…

Statistical Mechanics · Physics 2017-09-28 K. P. N. Murthy

In this paper, we prove large deviation principles for the empirical measures associated with the Independent Metropolis Hastings (IMH) sampler and the Metropolis-adjusted Langevin Algorithm (MALA). These are the first large deviation…

Probability · Mathematics 2026-02-23 Federica Milinanni , Pierre Nyquist

Restricted Boltzmann Machines (RBM) are bi-layer neural networks used for the unsupervised learning of model distributions from data. The bipartite architecture of RBM naturally defines an elegant sampling procedure, called Alternating…

Disordered Systems and Neural Networks · Physics 2021-10-27 Clément Roussel , Simona Cocco , Rémi Monasson

We demonstrate the use of a variational method to determine a quantitative lower bound on the rate of convergence of Markov Chain Monte Carlo (MCMC) algorithms as a function of the target density and proposal density. The bound relies on…

Data Analysis, Statistics and Probability · Physics 2013-05-29 Fergal P. Casey , Joshua J. Waterfall , Ryan N. Gutenkunst , Christopher R. Myers , James P. Sethna

One of the most widely used samplers in practice is the component-wise Metropolis-Hastings (CMH) sampler that updates in turn the components of a vector valued Markov chain using accept-reject moves generated from a proposal distribution.…

Computation · Statistics 2017-03-22 Jinyoung Yang , Evgeny Levi , Radu V. Craiu , Jeffrey S. Rosenthal

Motion planning is a fundamental problem and focuses on finding control inputs that enable a robot to reach a goal region while safely avoiding obstacles. However, in many situations, the state of the system may not be known but only…

Robotics · Computer Science 2021-08-30 Lars Lindemann , Matthew Cleaveland , Yiannis Kantaros , George J. Pappas

We examine the use of different randomisation policies for stochastic gradient algorithms used in sampling, based on first-order (or overdamped) Langevin dynamics, the most popular of which is known as Stochastic Gradient Langevin Dynamics.…

Numerical Analysis · Mathematics 2025-12-16 Luke Shaw , Peter A. Whalley

We examine the optimal scaling and the efficiency of the pseudo-marginal random walk Metropolis algorithm using a recently-derived result on the limiting efficiency as the dimension, $d\rightarrow \infty$. We prove that the optimal scaling…

Computation · Statistics 2015-04-24 Chris Sherlock

The structural dynamics of a biopolymer is governed by a process of diffusion through its conformational energy landscape. In pulling experiments using optical tweezers, features of the energy landscape can be extracted from the probability…

Biological Physics · Physics 2020-07-01 Sudeep Adhikari , K. S. D. Beach

Boltzmann sampling based on Metropolis algorithm has been extensively used for simulating a canonical ensemble. An estimate of a mechanical property, like energy, of an equilibrium system, can be made by averaging over a large number…

Statistical Mechanics · Physics 2017-10-04 K P N Murthy

Sampling the Boltzmann distribution using forces that violate detailed balance can be faster than with the equilibrium evolution, but the acceleration depends on the nature of the nonequilibrium drive and the physical situation. Here, we…

Soft Condensed Matter · Physics 2023-12-20 Federico Ghimenti , Ludovic Berthier , Grzegorz Szamel , Frédéric van Wijland

This paper develops a Bayesian computational platform at the interface between posterior sampling and optimization in models whose marginal likelihoods are difficult to evaluate. Inspired by adversarial optimization, namely Generative…

Statistics Theory · Mathematics 2021-12-01 Tetsuya Kaji , Veronika Rockova

Theories with a sign problem due to a complex action or Boltzmann weight can sometimes be numerically solved using a stochastic process in the complexified configuration space. However, the probability distribution effectively sampled by…

High Energy Physics - Lattice · Physics 2025-10-06 Gert Aarts , Diaa E. Habibi , Lingxiao Wang , Kai Zhou

We introduce an adaptive output-sensitive Metropolis-Hastings algorithm for probabilistic models expressed as programs, Adaptive Lightweight Metropolis-Hastings (AdLMH). The algorithm extends Lightweight Metropolis-Hastings (LMH) by…

Artificial Intelligence · Computer Science 2015-05-07 David Tolpin , Jan Willem van de Meent , Brooks Paige , Frank Wood

The Random Walks (RW) algorithm is one of the most e - cient and easy-to-use probabilistic segmentation methods. By combining contrast terms with prior terms, it provides accurate segmentations of medical images in a fully automated manner.…

Computer Vision and Pattern Recognition · Computer Science 2013-06-06 Pierre-Yves Baudin , Danny Goodman , Puneet Kumar , Noura Azzabou , Pierre G. Carlier , Nikos Paragios , M. Pawan Kumar

We consider the random walk Metropolis algorithm on $\mathbb{R}^n$ with Gaussian proposals, and when the target probability measure is the $n$-fold product of a one-dimensional law. In the limit $n\to\infty$, it is well known (see [Ann.…

Probability · Mathematics 2016-08-14 Benjamin Jourdain , Tony Lelièvre , Błażej Miasojedow

Sampling the parameter space of artificial neural networks according to a Boltzmann distribution provides insight into the geometry of low-loss solutions and offers an alternative to conventional loss minimization for training. However,…

Disordered Systems and Neural Networks · Physics 2026-03-17 Alessandro Zambon , Francesca Caruso , Riccardo Zecchina , Guido Tiana

The rigorous quantification of uncertainty in geophysical inversions is a challenging problem. Inversions are often ill-posed and the likelihood surface may be multi-modal; properties of any single mode become inadequate uncertainty…