English
Related papers

Related papers: Poisson Midpoint Method for Log Concave Sampling: …

200 papers

Simulating the kinetic Langevin dynamics is a popular approach for sampling from distributions, where only their unnormalized densities are available. Various discretizations of the kinetic Langevin dynamics have been considered, where the…

Computation · Statistics 2026-05-08 Kyurae Kim , Samuel Gruffaz , Ji Won Park , Alain Oliviero Durmus

This paper proposes a novel diffusion-based posterior sampling method within a plug-and-play (PnP) framework. Our approach constructs a probability transport from an easy-to-sample terminal distribution to the target posterior, using a…

Machine Learning · Statistics 2025-12-10 Jinyuan Chang , Chenguang Duan , Yuling Jiao , Ruoxuan Li , Jerry Zhijian Yang , Cheng Yuan

We establish concentration inequalities in the class of ultra log-concave distributions. In particular, we show that ultra log-concave distributions satisfy Poisson concentration bounds. As an application, we derive concentration bounds for…

Probability · Mathematics 2021-10-04 Heshan Aravinda , Arnaud Marsiglietti , James Melbourne

In this paper, we provide new insights on the Unadjusted Langevin Algorithm. We show that this method can be formulated as a first order optimization algorithm of an objective functional defined on the Wasserstein space of order $2$. Using…

Computation · Statistics 2018-03-30 Alain Durmus , Szymon Majewski , Błażej Miasojedow

We propose discrete Langevin proposal (DLP), a simple and scalable gradient-based proposal for sampling complex high-dimensional discrete distributions. In contrast to Gibbs sampling-based methods, DLP is able to update all coordinates in…

Machine Learning · Computer Science 2022-06-22 Ruqi Zhang , Xingchao Liu , Qiang Liu

Several approaches are discussed how to understand the solution of the Dirichlet problem for the Poisson equation when the Dirichlet data are non-smooth such as if they are in $L^2$ only. For the method of transposition (sometimes called…

Numerical Analysis · Mathematics 2015-05-07 Thomas Apel , Serge Nicaise , Johannes Pfefferer

Approximate Thompson sampling with Langevin Monte Carlo broadens its reach from Gaussian posterior sampling to encompass more general smooth posteriors. However, it still encounters scalability issues in high-dimensional problems when…

Machine Learning · Statistics 2024-06-24 Haoyang Zheng , Wei Deng , Christian Moya , Guang Lin

Species distribution modeling (SDM) plays a crucial role in investigating habitat suitability and addressing various ecological issues. While likelihood analysis is commonly used to draw ecological conclusions, it has been observed that its…

Methodology · Statistics 2023-07-03 Yusuke Saigusa , Shinto Eguchi , Osamu Komori

We provide a refined explicit estimate of exponential decay rate of underdamped Langevin dynamics in $L^2$ distance, based on a framework developed in [1]. To achieve this, we first prove a Poincar\'{e}-type inequality with Gibbs measure in…

Analysis of PDEs · Mathematics 2023-08-25 Yu Cao , Jianfeng Lu , Lihan Wang

We extend the hypocoercivity framework for piecewise-deterministic Markov process (PDMP) Monte Carlo established in [Andrieu et. al. (2018)] to heavy-tailed target distributions, which exhibit subgeometric rates of convergence to…

Probability · Mathematics 2021-06-03 Christophe Andrieu , Paul Dobson , Andi Q. Wang

In previous work, we introduced a method for determining convergence rates for integration methods for the kinetic Langevin equation for $M$-$\nabla$Lipschitz $m$-log-concave densities [arXiv:2302.10684, 2023]. In this article, we exploit…

Numerical Analysis · Mathematics 2023-06-16 Benedict Leimkuhler , Daniel Paulin , Peter A. Whalley

We analyze the posterior contraction rates of parameters in Bayesian models via the Langevin diffusion process, in particular by controlling moments of the stochastic process and taking limits. Analogous to the non-asymptotic analysis of…

Statistics Theory · Mathematics 2022-08-18 Wenlong Mou , Nhat Ho , Martin J. Wainwright , Peter Bartlett , Michael I. Jordan

The estimation of a log-concave density on $\mathbb{R}$ is a canonical problem in the area of shape-constrained nonparametric inference. We present a Bayesian nonparametric approach to this problem based on an exponentiated Dirichlet…

Statistics Theory · Mathematics 2020-07-14 Ester Mariucci , Kolyan Ray , Botond Szabo

In this paper, we investigate a class of multiscale McKean-Vlasov stochastic systems, where the entire system depends on the distributions of both fast and slow components. First of all, by applying the Poisson equation method, we prove…

Probability · Mathematics 2025-09-30 Jie Xiang , Huijie Qiao

This paper is concerned with sampling from probability distributions $\pi$ on $\mathbb{R}^d$ admitting a density of the form $\pi(x) \propto e^{-U(x)}$, where $U(x)=F(x)+G(Kx)$ with $K$ being a linear operator and $G$ being…

Optimization and Control · Mathematics 2024-05-28 Andreas Habring , Martin Holler , Thomas Pock

We propose a sampling method based on an ensemble approximation of second order Langevin dynamics. The log target density is appended with a quadratic term in an auxiliary momentum variable and damped-driven Hamiltonian dynamics introduced;…

Dynamical Systems · Mathematics 2025-06-06 Ziming Liu , Andrew M. Stuart , Yixuan Wang

SDE-based methods such as denoising diffusion probabilistic models (DDPMs) have shown remarkable success in real-world sample generation tasks. Prior analyses of DDPMs have been focused on the exponential Euler discretization, showing…

Machine Learning · Computer Science 2025-11-10 Matthew S. Zhang , Stephen Huan , Jerry Huang , Nicholas M. Boffi , Sitan Chen , Sinho Chewi

Motivated by a theorem of Barbour, we revisit some of the classical limit theorems in probability from the viewpoint of the Stein method. We setup the framework to bound Wasserstein distances between some distributions on infinite…

Probability · Mathematics 2018-07-30 Laure Coutin , Laurent Decreusefond

The convex hull generated by the restriction to the unit ball of a stationary Poisson point process in the $d$-dimensional Euclidean space is considered. By establishing sharp bounds on cumulants, exponential estimates for large deviation…

Probability · Mathematics 2015-12-15 Julian Grote , Christoph Thaele

In this paper we consider a new probability sampling methods based on Langevin diffusion dynamics to resolve the problem of existing Monte Carlo algorithms when draw samples from high dimensional target densities. We extent…

Machine Learning · Computer Science 2025-03-31 Z. Zarezadeh , N. Zarezadeh