English
Related papers

Related papers: The Forward-Backward Envelope for Sampling with th…

200 papers

This paper focuses on studying the convergence rate of the density function of the Euler--Maruyama (EM) method, when applied to the overdamped generalized Langevin equation with fractional noise which serves as an important model in many…

Numerical Analysis · Mathematics 2024-05-21 Xinjie Dai , Diancong Jin

We propose a new discretization of the mirror-Langevin diffusion and give a crisp proof of its convergence. Our analysis uses relative convexity/smoothness and self-concordance, ideas which originated in convex optimization, together with a…

Statistics Theory · Mathematics 2021-10-26 Kwangjun Ahn , Sinho Chewi

In this article we propose a novel method for sampling from Gibbs distributions of the form $\pi(x)\propto\exp(-U(x))$ with a potential $U(x)$. In particular, inspired by diffusion models we propose to consider a sequence $(\pi^{t_k})_k$ of…

Optimization and Control · Mathematics 2025-04-04 Andreas Habring , Alexander Falk , Thomas Pock

Non-differentiable priors are standard in modern parsimonious Bayesian models. Lack of differentiability, however, precludes gradient-based Markov chain Monte Carlo (MCMC) for posterior sampling. Recently proposed proximal MCMC approaches…

Computation · Statistics 2025-07-24 Apratim Shukla , Dootika Vats , Eric C. Chi

This paper proposes a novel diffusion-based posterior sampling method within a plug-and-play (PnP) framework. Our approach constructs a probability transport from an easy-to-sample terminal distribution to the target posterior, using a…

Machine Learning · Statistics 2025-12-10 Jinyuan Chang , Chenguang Duan , Yuling Jiao , Ruoxuan Li , Jerry Zhijian Yang , Cheng Yuan

Langevin Dynamics has been extensively employed in global non-convex optimization due to the concentration of its stationary distribution around the global minimum of the potential function at low temperatures. In this paper, we propose to…

Optimization and Control · Mathematics 2023-05-22 Ryo Fujino

We study the problem of sampling from a distribution $p^*(x) \propto \exp\left(-U(x)\right)$, where the function $U$ is $L$-smooth everywhere and $m$-strongly convex outside a ball of radius $R$, but potentially nonconvex inside this ball.…

In this paper, we study a method to sample from a target distribution $\pi$ over $\mathbb{R}^d$ having a positive density with respect to the Lebesgue measure, known up to a normalisation factor. This method is based on the Euler…

Statistics Theory · Mathematics 2016-12-20 Alain Durmus , Eric Moulines

We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density $\nu$ with respect to the natural measure on a manifold with metric $g$. We assume that the target density satisfies a log-Sobolev…

Machine Learning · Computer Science 2022-04-25 Khashayar Gatmiry , Santosh S. Vempala

Purpose: The Unadjusted Langevin Algorithm (ULA) in combination with diffusion models can generate high quality MRI reconstructions with uncertainty estimation from highly undersampled k-space data. However, sampling methods such as…

Medical Physics · Physics 2026-05-26 Moritz Blumenthal , Tina Holliber , Jonathan I. Tamir , Martin Uecker

We study the problem of sampling from strongly log-concave distributions over $\mathbb{R}^d$ using the Poisson midpoint discretization (a variant of the randomized midpoint method) for overdamped/underdamped Langevin dynamics. We prove its…

Probability · Mathematics 2025-10-02 Rishikesh Srinivasan , Dheeraj Nagaraj

We present a novel method for drawing samples from Gibbs distributions with densities of the form $\pi(x) \propto \exp(-U(x))$. The method accelerates the unadjusted Langevin algorithm by introducing an inertia term similar to Polyak's…

Numerical Analysis · Mathematics 2025-10-09 Alexander Falk , Andreas Habring , Christoph Griesbacher , Thomas Pock

For sampling from a log-concave density, we study implicit integrators resulting from $\theta$-method discretization of the overdamped Langevin diffusion stochastic differential equation. Theoretical and algorithmic properties of the…

Machine Learning · Statistics 2021-07-13 Liam Hodgkinson , Robert Salomone , Fred Roosta

Understanding the dimension dependency of computational complexity in high-dimensional sampling problem is a fundamental problem, both from a practical and theoretical perspective. Compared with samplers with unbiased stationary…

Machine Learning · Computer Science 2024-03-12 Xunpeng Huang , Hanze Dong , Difan Zou , Tong Zhang

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

In this paper, we study the problem of sampling from log-concave distributions supported on convex, compact sets, with a particular focus on the randomized midpoint discretization of both vanilla and kinetic Langevin diffusions in this…

Machine Learning · Statistics 2025-05-27 Yifeng Yu , Lu Yu

This paper focuses on a challenging class of inverse problems that is often encountered in applications. The forward model is a complex non-linear black-box, potentially non-injective, whose outputs cover multiple decades in amplitude.…

We study the problem of approximate sampling from non-log-concave distributions, e.g., Gaussian mixtures, which is often challenging even in low dimensions due to their multimodality. We focus on performing this task via Markov chain Monte…

Machine Learning · Statistics 2024-05-30 Tim Tsz-Kit Lau , Han Liu , Thomas Pock

Posterior sampling in high-dimensional spaces using generative models holds significant promise for various applications, including but not limited to inverse problems and guided generation tasks. Despite many recent developments,…

Machine Learning · Statistics 2024-10-04 Vishal Purohit , Matthew Repasky , Jianfeng Lu , Qiang Qiu , Yao Xie , Xiuyuan Cheng

In this paper, we derive error estimates of the backward Euler-Maruyama method applied to multi-valued stochastic differential equations. An important example of such an equation is a stochastic gradient flow whose associated potential is…

Numerical Analysis · Mathematics 2022-05-10 Monika Eisenmann , Mihály Kovács , Raphael Kruse , Stig Larsson