English
Related papers

Related papers: Convergence of Reflected Langevin Diffusion for Co…

200 papers

Score-based generative models based on stochastic differential equations (SDEs) achieve impressive performance in sampling from unknown distributions, but often fail to satisfy underlying constraints. We propose a constrained generative…

Machine Learning · Statistics 2025-10-29 Adam Nordenhög , Akash Sharma

Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian…

Numerical Analysis · Mathematics 2025-02-10 Tony Lelièvre , Grigorios A. Pavliotis , Geneviève Robin , Régis Santet , Gabriel Stoltz

Take a multidimensional normally or obliquely reflected diffusion in a smooth domain. Approximate it by solutions of stochastic differential equations without reflection using the penalty method. That is, we approximate the reflection term…

Probability · Mathematics 2021-08-09 Andrey Sarantsev

Non-convex sampling is a key challenge in machine learning, central to non-convex optimization in deep learning as well as to approximate probabilistic inference. Despite its significance, theoretically there remain many important…

Machine Learning · Computer Science 2024-09-18 Mohammad Reza Karimi , Ya-Ping Hsieh , Andreas Krause

Convergence rate to the stationary distribution for continuous-time Markov processes can be studied using Lyapunov functions. Recent work by the author provided explicit rates of convergence in special case of a reflected jump-diffusion on…

Probability · Mathematics 2020-03-25 Andrey Sarantsev

We study a class of reflected McKean-Vlasov diffusions over a convex domain with self-stabilizing coefficients. This includes coefficients that do not satisfy the classical Wasserstein Lipschitz condition. Further, the process is…

Probability · Mathematics 2022-01-19 Daniel Adams , Gonçalo dos Reis , Romain Ravaille , William Salkeld , Julian Tugaut

We provide new convergence guarantees in Wasserstein distance for diffusion-based generative models, covering both stochastic (DDPM-like) and deterministic (DDIM-like) sampling methods. We introduce a simple framework to analyze…

Machine Learning · Computer Science 2025-11-14 Eliot Beyler , Francis Bach

We study three kinetic Langevin samplers including the Euler discretization, the BU and the UBU splitting scheme. We provide contraction results in $L^1$-Wasserstein distance for non-convex potentials. These results are based on a carefully…

Probability · Mathematics 2025-08-20 Katharina Schuh , Peter A. Whalley

We develop a novel class of MCMC algorithms based on a stochastized Nesterov scheme. With an appropriate addition of noise, the result is a time-inhomogeneous underdamped Langevin equation, which we prove emits a specified target…

Computational Engineering, Finance, and Science · Computer Science 2023-11-29 Duy H. Thai , Alexander L. Young , David B. Dunson

Many practical samplers rely on time-dependent drifts -- often induced by annealing or tempering schedules -- to improve exploration and stability. This motivates a unified non-asymptotic analysis of the corresponding Langevin diffusions…

Numerical Analysis · Mathematics 2026-05-12 Andreas Habring , Martin Zach

This work considers the problem of sampling from a probability distribution known up to a normalization constant while satisfying a set of statistical constraints specified by the expected values of general nonlinear functions. This problem…

Machine Learning · Statistics 2025-01-08 Luiz F. O. Chamon , Mohammad Reza Karimi , Anna Korba

In this paper we first study the penalization approximation of stochastic differential equations reflected in a domain which satisfies conditions (A) and (B) and prove that the sequence of solutions of the penalizing equations converges in…

Probability · Mathematics 2016-04-08 Jiagang Ren , Jing Wu

This paper presents existence and uniqueness results for reflected backward doubly stochastic differential equations (in short RBDDSEs) in a convex domain D. Moreover, using a stochastic flow approach a probabilistic interpretation for a…

Probability · Mathematics 2016-10-11 Matoussi Anis , Sabbagh Wissal , Tusheng Zhang

The efficiency of a Markov sampler based on the underdamped Langevin diffusion is studied for high dimensional targets with convex and smooth potentials. We consider a classical second-order integrator which requires only one gradient…

Probability · Mathematics 2021-06-21 Pierre Monmarché

Two frameworks that have been used to characterize reflected diffusions include stochastic differential equations with reflection and the so-called submartingale problem. We introduce a general formulation of the submartingale problem for…

Probability · Mathematics 2014-12-03 Weining Kang , Kavita Ramanan

We present a novel method for drawing samples from Gibbs distributions with densities of the form $\pi(x) \propto \exp(-U(x))$. The method accelerates the unadjusted Langevin algorithm by introducing an inertia term similar to Polyak's…

Numerical Analysis · Mathematics 2025-10-09 Alexander Falk , Andreas Habring , Christoph Griesbacher , Thomas Pock

Let $M$ be a connected compact Riemannian manifold possibly with a boundary, let $V\in C^2(M)$ such that $\mu(\d x):=\e^{V(x)}\d x$ is a probability measure, where $\d x$ is the volume measure, and let $L=\Delta+\nabla V$. The exact…

Probability · Mathematics 2021-07-27 Feng-Yu Wang , Bingyao Wu

We are interested in the Euler-Maruyama discretization of a stochastic differential equation in dimension $d$ with constant diffusion coefficient and bounded measurable drift coefficient. In the scheme, a randomization of the time variable…

Probability · Mathematics 2020-11-13 Oumaima Bencheikh , Benjamin Jourdain

In this paper, we are concerned with long-time behavior of Euler-Maruyama schemes associated with a range of regime-switching diffusion processes. The key contributions of this paper lie in that existence and uniqueness of numerical…

Probability · Mathematics 2014-09-24 Jianhai Bao , Jinghai Shao , Chenggui Yuan

Langevin diffusion processes and their discretizations are often used for sampling from a target density. The most convenient framework for assessing the quality of such a sampling scheme corresponds to smooth and strongly log-concave…

Probability · Mathematics 2018-12-27 Arnak S. Dalalyan , Lionel Riou-Durand