English
Related papers

Related papers: Poisson Midpoint Method for Log Concave Sampling: …

200 papers

Langevin diffusion is a commonly used tool for sampling from a given distribution. In this work, we establish that when the target density $p^*$ is such that $\log p^*$ is $L$ smooth and $m$ strongly convex, discrete Langevin diffusion…

Machine Learning · Statistics 2017-11-02 Xiang Cheng , Peter Bartlett

This paper derives non-asymptotic error bounds for nonlinear stochastic approximation algorithms in the Wasserstein-$p$ distance. To obtain explicit finite-sample guarantees for the last iterate, we develop a coupling argument that compares…

Machine Learning · Computer Science 2026-02-03 Seo Taek Kong , R. Srikant

Analogue to the well-known Langevin Monte Carlo method, in this article we provide a method to sample from a target distribution \(\pi\) by simulating a solution of a stochastic differential equation. Hereby, the stochastic differential…

Probability · Mathematics 2023-03-15 David Oechsler

We introduce numerical methods for simulating the diffusive motion of rigid bodies of arbitrary shape immersed in a viscous fluid. We parameterize the orientation of the bodies using normalized quaternions, which are numerically robust,…

Soft Condensed Matter · Physics 2015-10-28 Steven Delong , Florencio Balboa Usabiaga , Aleksandar Donev

We provide new convergence guarantees in Wasserstein distance for diffusion-based generative models, covering both stochastic (DDPM-like) and deterministic (DDIM-like) sampling methods. We introduce a simple framework to analyze…

Machine Learning · Computer Science 2025-11-14 Eliot Beyler , Francis Bach

Standard first-order Langevin algorithms such as the unadjusted Langevin algorithm (ULA) are obtained by discretizing the Langevin diffusion and are widely used for sampling in machine learning because they scale to high dimensions and…

Machine Learning · Statistics 2025-09-25 Mert Gurbuzbalaban , Hoang M. Nguyen , Xicheng Zhang , Lingjiong Zhu

Based on Stein's method, we derive upper bounds for Poisson process approximation in the $L_1$-Wasserstein metric $d_2^{(p)}$, which is based on a slightly adapted $L_p$-Wasserstein metric between point measures. For the case $p=1$, this…

Probability · Mathematics 2009-06-12 Dominic Schuhmacher

We characterize the measurement complexity of compressed sensing of signals drawn from a known prior distribution, even when the support of the prior is the entire space (rather than, say, sparse vectors). We show for Gaussian measurements…

Machine Learning · Computer Science 2021-06-23 Ajil Jalal , Sushrut Karmalkar , Alexandros G. Dimakis , Eric Price

In this paper, we derive error estimates of the backward Euler-Maruyama method applied to multi-valued stochastic differential equations. An important example of such an equation is a stochastic gradient flow whose associated potential is…

Numerical Analysis · Mathematics 2022-05-10 Monika Eisenmann , Mihály Kovács , Raphael Kruse , Stig Larsson

We consider the problem of sampling from the posterior distribution of a $d$-dimensional coefficient vector $\boldsymbol{\theta}$, given linear observations $\boldsymbol{y} = \boldsymbol{X}\boldsymbol{\theta}+\boldsymbol{\varepsilon}$. In…

Methodology · Statistics 2024-07-01 Andrea Montanari , Yuchen Wu

We study the decentralized distributed computation of discrete approximations for the regularized Wasserstein barycenter of a finite set of continuous probability measures distributedly stored over a network. We assume there is a network of…

Optimization and Control · Mathematics 2020-02-21 Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov , César A. Uribe , Angelia Nedić

We present a highly efficient proximal Markov chain Monte Carlo methodology to perform Bayesian computation in imaging problems. Similarly to previous proximal Monte Carlo approaches, the proposed method is derived from an approximation of…

Computation · Statistics 2020-03-20 Luis Vargas , Marcelo Pereyra , Konstantinos C. Zygalakis

We investigate a weighted Multilevel Richardson-Romberg extrapolation for the ergodic approximation of invariant distributions of diffusions adapted from the one introduced in~[Lemaire-Pag\`es, 2013] for regular Monte Carlo simulation. In a…

Probability · Mathematics 2016-07-05 Gilles Pagès , Fabien Panloup

We propose a novel method for sampling from unnormalized Boltzmann densities based on a probability flow ordinary differential equation (ODE) derived from linear stochastic interpolants. The key innovation of our approach is the use of a…

Numerical Analysis · Mathematics 2026-03-12 Chenguang Duan , Yuling Jiao , Gabriele Steidl , Christian Wald , Jerry Zhijian Yang , Ruizhe Zhang

We develop a Bayesian inference method for diffusions observed discretely and with noise, which is free of discretisation bias. Unlike existing unbiased inference methods, our method does not rely on exact simulation techniques. Instead,…

Methodology · Statistics 2021-03-10 Neil K. Chada , Jordan Franks , Ajay Jasra , Kody J. H. Law , Matti Vihola

We study the problem of sampling from a $d$-dimensional distribution with density $p(x)\propto e^{-f(x)}$, which does not necessarily satisfy good isoperimetric conditions. Specifically, we show that for any $L,M$ satisfying $LM\ge d\ge 5$,…

Data Structures and Algorithms · Computer Science 2025-06-04 Yuchen He , Chihao Zhang

We study the proximal sampler of Lee, Shen, and Tian (2021) and obtain new convergence guarantees under weaker assumptions than strong log-concavity: namely, our results hold for (1) weakly log-concave targets, and (2) targets satisfying…

Statistics Theory · Mathematics 2022-02-15 Yongxin Chen , Sinho Chewi , Adil Salim , Andre Wibisono

In a variety of research areas, the weighted bag of vectors and the histogram are widely used descriptors for complex objects. Both can be expressed as discrete distributions. D2-clustering pursues the minimum total within-cluster variation…

Computation · Statistics 2017-01-10 Jianbo Ye , Panruo Wu , James Z. Wang , Jia Li

We study the local convergence of diffusive mean-field systems, including Wasserstein gradient flows, min-max dynamics, and multi-species games. We establish exponential local convergence in $\chi^2$-divergence with sharp rates, under two…

Optimization and Control · Mathematics 2026-02-13 Guillaume Wang , Lénaïc Chizat

Markov chains and diffusion processes are indispensable tools in machine learning and statistics that are used for inference, sampling, and modeling. With the growth of large-scale datasets, the computational cost associated with simulating…

Statistics Theory · Mathematics 2017-08-31 Jonathan H. Huggins , James Zou