English
Related papers

Related papers: Diffusion at Absolute Zero: Langevin Sampling Usin…

200 papers

We recently introduced a novel replica-exchange scheme in which an individual replica can sample from states encountered by other replicas at any previous time by way of a global configuration database, enabling the fast propagation of…

Computational Physics · Physics 2015-12-15 Thomas Vogel , Danny Perez

While continuous diffusion models have achieved remarkable success, discrete diffusion offers a unified framework for jointly modeling text and images. Beyond unification, discrete diffusion provides faster inference, finer control, and…

Score-based diffusion methods provide a powerful strategy to solve image restoration tasks by flexibly combining a pre-trained foundational prior model with a likelihood function specified during test time. Such methods are predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Charlesquin Kemajou Mbakam , Jean-Francois Giovannelli , Marcelo Pereyra

Langevin Monte Carlo (LMC) and its stochastic gradient versions are powerful algorithms for sampling from complex high-dimensional distributions. To sample from a distribution with density $\pi(\theta)\propto \exp(-U(\theta)) $, LMC…

Computation · Statistics 2023-09-25 Sifan Liu

The Gibbs ensemble of the truncated KdV (TKdV) equation has been shown to accurately describe the anomalous wave statistics observed in laboratory experiments, in particular the emergence of extreme events. Here, we introduce a novel…

Numerical Analysis · Mathematics 2025-02-19 Nicholas J. Moore , Brendan Foerster

A new acceptance-rejection method is proposed and investigated for the Bingham distribution on the sphere using the angular central Gaussian distribution as an envelope. It is shown to have high efficiency and to be straightfoward to use.…

Statistics Theory · Mathematics 2013-10-31 John T. Kent , Asaad M. Ganeiber , Kanti V. Mardia

This paper introduces a Bayesian framework for image inversion by deriving a probabilistic counterpart to the regularization-by-denoising (RED) paradigm. It additionally implements a Monte Carlo algorithm specifically tailored for sampling…

Machine Learning · Statistics 2024-02-20 Elhadji C. Faye , Mame Diarra Fall , Nicolas Dobigeon

Diffusion models are a remarkably effective way of learning and sampling from a distribution $p(x)$. In posterior sampling, one is also given a measurement model $p(y \mid x)$ and a measurement $y$, and would like to sample from $p(x \mid…

Machine Learning · Computer Science 2025-11-11 Shivam Gupta , Ajil Jalal , Aditya Parulekar , Eric Price , Zhiyang Xun

We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density $\nu$ with respect to the natural measure on a manifold with metric $g$. We assume that the target density satisfies a log-Sobolev…

Machine Learning · Computer Science 2022-04-25 Khashayar Gatmiry , Santosh S. Vempala

Markov chain sampling methods that automatically adapt to characteristics of the distribution being sampled can be constructed by exploiting the principle that one can sample from a distribution by sampling uniformly from the region under…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Radford M. Neal

Recovering a signal from its degraded measurements is a long standing challenge in science and engineering. Recently, zero-shot diffusion based methods have been proposed for such inverse problems, offering a posterior sampling based…

Machine Learning · Computer Science 2026-05-19 Roi Benita , Michael Elad , Joseph Keshet

Gibbs sampling is a Markov chain Monte Carlo method that is often used for learning and inference on graphical models. Minibatching, in which a small random subset of the graph is used at each iteration, can help make Gibbs sampling scale…

Machine Learning · Computer Science 2019-11-25 Ruqi Zhang , Christopher De Sa

We revisit the work of Mitter and Newton on an information-theoretic interpretation of Bayes' formula through the Gibbs variational principle. This formulation allowed them to pose nonlinear estimation for diffusion processes as a problem…

Optimization and Control · Mathematics 2024-05-02 Maxim Raginsky

Diffusion Probabilistic Methods are employed for state-of-the-art image generation. In this work, we present a method for extending such models for performing image segmentation. The method learns end-to-end, without relying on a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Tomer Amit , Tal Shaharbany , Eliya Nachmani , Lior Wolf

This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set…

Computation · Statistics 2016-04-20 Olivier Féron , François Orieux , Jean-François Giovannelli

This paper addresses the mapping problem. Using a conjugate prior form, we derive the exact theoretical batch multi-object posterior density of the map given a set of measurements. The landmarks in the map are modeled as extended objects,…

Machine Learning · Statistics 2018-11-09 Maryam Fatemi , Karl Granström , Lennart Svensson , Francisco J. R. Ruiz , Lars Hammarstrand

Error bounds are derived for sampling and estimation using a discretization of an intrinsically defined Langevin diffusion with invariant measure $\text{d}\mu_\phi \propto e^{-\phi} \mathrm{dvol}_g $ on a compact Riemannian manifold. Two…

Statistics Theory · Mathematics 2025-12-10 Karthik Bharath , Alexander Lewis , Akash Sharma , Michael V Tretyakov

In this article, we focus on the sampling of the configurational Gibbs-Boltzmann distribution, that is, the calculation of averages of functions of the position coordinates of a molecular $N$-body system modelled at constant temperature. We…

Numerical Analysis · Mathematics 2025-04-30 Benedict Leimkuhler , Charles Matthews

In this paper, we investigate a continuous time version of the Stochastic Langevin Monte Carlo method, introduced in [WT11], that incorporates a stochastic sampling step inside the traditional over-damped Langevin diffusion. This method is…

Machine Learning · Statistics 2023-01-10 Marelys Crespo Navas , Sébastien Gadat , Xavier Gendre

This paper proposes and compares two new sampling schemes for sparse deconvolution using a Bernoulli-Gaussian model. To tackle such a deconvolution problem in a blind and unsupervised context, the Markov Chain Monte Carlo (MCMC) framework…

Numerical Analysis · Computer Science 2009-09-18 D. Ge , J. Idier , E. Le Carpentier