English
Related papers

Related papers: The Poisson Midpoint Method for Langevin Dynamics:…

200 papers

Diffusion models are state-of-the-art methods in generative modeling when samples from a target probability distribution are available, and can be efficiently sampled, using score matching to estimate score vectors guiding a Langevin…

Machine Learning · Statistics 2024-06-21 Omar Chehab , Anna Korba

In this paper, we study the problem of sampling from log-concave distributions supported on convex, compact sets, with a particular focus on the randomized midpoint discretization of both vanilla and kinetic Langevin diffusions in this…

Machine Learning · Statistics 2025-05-27 Yifeng Yu , Lu Yu

We study the underdamped Langevin diffusion when the log of the target distribution is smooth and strongly concave. We present a MCMC algorithm based on its discretization and show that it achieves $\varepsilon$ error (in 2-Wasserstein…

Machine Learning · Statistics 2018-01-30 Xiang Cheng , Niladri S. Chatterji , Peter L. Bartlett , Michael I. Jordan

Understanding the dimension dependency of computational complexity in high-dimensional sampling problem is a fundamental problem, both from a practical and theoretical perspective. Compared with samplers with unbiased stationary…

Machine Learning · Computer Science 2024-03-12 Xunpeng Huang , Hanze Dong , Difan Zou , Tong Zhang

In this paper, we provide non-asymptotic upper bounds on the error of sampling from a target density using three schemes of discretized Langevin diffusions. The first scheme is the Langevin Monte Carlo (LMC) algorithm, the Euler…

Statistics Theory · Mathematics 2021-12-07 Arnak S. Dalalyan , Avetik Karagulyan , Lionel Riou-Durand

We extend the L\'evy Langevin Monte Carlo method studied by Oechsler in 2024 to the setting of a target distribution with heavy tails: Choosing a target distribution from the class of subexponential distributions we prove convergence of a…

Probability · Mathematics 2025-07-15 Anita Behme , Claudius Lütke Schwienhorst

Langevin algorithms are popular Markov chain Monte Carlo (MCMC) methods for large-scale sampling problems that often arise in data science. We propose Monte Carlo algorithms based on the discretizations of $P$-th order Langevin dynamics for…

Machine Learning · Statistics 2025-08-26 Thanh Dang , Mert Gurbuzbalaban , Mohammad Rafiqul Islam , Nian Yao , Lingjiong Zhu

Sampling from a high-dimensional distribution is a fundamental task in statistics, engineering, and the sciences. A canonical approach is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. This is the…

Statistics Theory · Mathematics 2022-11-01 Jason M. Altschuler , Kunal Talwar

Sampling from distributions play a crucial role in aiding practitioners with statistical inference. However, in numerous situations, obtaining exact samples from complex distributions is infeasible. Consequently, researchers often turn to…

Computation · Statistics 2024-04-01 Riddhiman Bhattacharya , Tiefeng Jiang

The diffusion models (DMs) have demonstrated the remarkable capability of generating images via learning the noised score function of data distribution. Current DM sampling techniques typically rely on first-order Langevin dynamics at each…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Fangyikang Wang , Hubery Yin , Lei Qian , Yinan Li , Shaobin Zhuang , Huminhao Zhu , Yilin Zhang , Yanlong Tang , Chao Zhang , Hanbin Zhao , Hui Qian , Chen Li

Langevin Monte Carlo (LMC) and its stochastic gradient versions are powerful algorithms for sampling from complex high-dimensional distributions. To sample from a distribution with density $\pi(\theta)\propto \exp(-U(\theta)) $, LMC…

Computation · Statistics 2023-09-25 Sifan Liu

In this paper, we provide a multiscale perspective on the problem of maximum marginal likelihood estimation. We consider and analyse a diffusion-based maximum marginal likelihood estimation scheme using ideas from multiscale dynamics. Our…

Computation · Statistics 2024-06-11 O. Deniz Akyildiz , Michela Ottobre , Iain Souttar

We introduce a new method for analyzing midpoint discretizations of stochastic differential equations (SDEs), which are frequently used in Markov chain Monte Carlo (MCMC) methods for sampling from a target measure $\pi \propto \exp(-V)$.…

Numerical Analysis · Mathematics 2025-07-18 Matthew S. Zhang

The Stochastic Gradient Langevin Dynamics (SGLD) are popularly used to approximate Bayesian posterior distributions in statistical learning procedures with large-scale data. As opposed to many usual Markov chain Monte Carlo (MCMC)…

Machine Learning · Statistics 2024-04-30 Kexin Jin , Chenguang Liu , Jonas Latz

In diverse microscopy modalities, sensors measure only real-valued intensities. Additionally, the sensor readouts are affected by Poissonian-distributed photon noise. Traditional restoration algorithms typically aim to minimize the mean…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Nadav Torem , Roi Ronen , Yoav Y. Schechner , Michael Elad

Microscopic processes on surfaces such as adsorption, desorption, diffusion and reaction of interacting particles can be simulated using kinetic Monte Carlo (kMC) algorithms. Even though kMC methods are accurate, they are computationally…

Mathematical Physics · Physics 2013-12-24 Yannis Pantazis , Markos Katsoulakis

This paper introduces and analyses interacting underdamped Langevin algorithms, termed Kinetic Interacting Particle Langevin Monte Carlo (KIPLMC) methods, for statistical inference in latent variable models. We propose a diffusion process…

Computation · Statistics 2026-04-17 Paul Felix Valsecchi Oliva , O. Deniz Akyildiz

A fundamental problem in Bayesian inference and statistical machine learning is to efficiently sample from multimodal distributions. Due to metastability, multimodal distributions are difficult to sample using standard Markov chain Monte…

Machine Learning · Statistics 2019-05-27 Yulong Lu , Jianfeng Lu , James Nolen

Sampling the parameter space of artificial neural networks according to a Boltzmann distribution provides insight into the geometry of low-loss solutions and offers an alternative to conventional loss minimization for training. However,…

Disordered Systems and Neural Networks · Physics 2026-03-17 Alessandro Zambon , Francesca Caruso , Riccardo Zecchina , Guido Tiana

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi