English
Related papers

Related papers: Convergence of Reflected Langevin Diffusion for Co…

200 papers

A key task in Bayesian machine learning is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). One prevalent example of this is sampling posteriors in parametric distributions,…

Machine Learning · Computer Science 2020-09-10 Rong Ge , Holden Lee , Andrej Risteski

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

We study a nonlinear, pseudomonotone, stochastic diffusion-convection evolution problem on a bounded spatial domain, in any space dimension, with homogeneous boundary conditions and reflection. The additive noise term is given by a…

Analysis of PDEs · Mathematics 2024-12-24 Niklas Sapountzoglou , Yassine Tahraoui , Guy Vallet , Aleksandra Zimmermann

In this manuscript, we consider the Langevin dynamics on $\mathbb{R}^d$ with an overdamped vector field and driven by multiplicative Brownian noise of small amplitude $\sqrt{\epsilon}$, $\epsilon>0$. Under suitable assumptions on the vector…

Probability · Mathematics 2023-05-05 Gerardo Barrera

We study and develop multilevel methods for the numerical approximation of a log-concave probability $\pi$ on $\mathbb{R}^d$, based on (over-damped) Langevin diffusion. In the continuity of \cite{art:egeapanloup2021multilevel} concentrated…

Numerical Analysis · Mathematics 2023-01-24 Maxime Egéa

We investigate a weighted Multilevel Richardson-Romberg extrapolation for the ergodic approximation of invariant distributions of diffusions adapted from the one introduced in~[Lemaire-Pag\`es, 2013] for regular Monte Carlo simulation. In a…

Probability · Mathematics 2016-07-05 Gilles Pagès , Fabien Panloup

Let $(X_t)$ be a reflected diffusion process in a bounded convex domain in $\mathbb R^d$, solving the stochastic differential equation $$dX_t = \nabla f(X_t) dt + \sqrt{2f (X_t)} dW_t, ~t \ge 0,$$ with $W_t$ a $d$-dimensional Brownian…

Statistics Theory · Mathematics 2024-01-30 Richard Nickl

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

Underdamped Langevin Monte Carlo (ULMC) is an algorithm used to sample from unnormalized densities by leveraging the momentum of a particle moving in a potential well. We provide a novel analysis of ULMC, motivated by two central questions:…

Statistics Theory · Mathematics 2023-02-17 Matthew Zhang , Sinho Chewi , Mufan Bill Li , Krishnakumar Balasubramanian , Murat A. Erdogdu

We consider the problem of sampling from a target distribution, which is \emph {not necessarily logconcave}, in the context of empirical risk minimization and stochastic optimization as presented in Raginsky et al. (2017). Non-asymptotic…

Statistics Theory · Mathematics 2021-02-03 Ngoc Huy Chau , Éric Moulines , Miklos Rásonyi , Sotirios Sabanis , Ying Zhang

We consider a two-dimensional model of double-diffusive convection and its time discretisation using a second-order scheme which treat the nonlinear term explicitly (backward differentiation formula with a one-leg method). Uniform bounds on…

Numerical Analysis · Mathematics 2014-02-28 Florentina Tone , Xiaoming Wang , Djoko Wirosoetisno

In this paper, we derive error estimates of the backward Euler-Maruyama method applied to multi-valued stochastic differential equations. An important example of such an equation is a stochastic gradient flow whose associated potential is…

Numerical Analysis · Mathematics 2022-05-10 Monika Eisenmann , Mihály Kovács , Raphael Kruse , Stig Larsson

We propose a method for efficiently incorporating constraints into a stochastic gradient Langevin framework for the training of deep neural networks. Constraints allow direct control of the parameter space of the model. Appropriately…

Machine Learning · Computer Science 2021-06-22 Benedict Leimkuhler , Timothée Pouchon , Tiffany Vlaar , Amos Storkey

The mean-field Langevin dynamics (MFLD) minimizes an entropy-regularized nonlinear convex functional on the Wasserstein space over $\mathbb{R}^d$, and has gained attention recently as a model for the gradient descent dynamics of interacting…

Machine Learning · Computer Science 2026-05-19 Anming Gu , Juno Kim

Error bounds are derived for sampling and estimation using a discretization of an intrinsically defined Langevin diffusion with invariant measure $\text{d}\mu_\phi \propto e^{-\phi} \mathrm{dvol}_g $ on a compact Riemannian manifold. Two…

Statistics Theory · Mathematics 2025-12-10 Karthik Bharath , Alexander Lewis , Akash Sharma , Michael V Tretyakov

This paper establishes the well-posedness of stochastic partial differential equations with reflection in an infinite-dimensional ball, within the fully local monotone framework. Our result is very general, including many important models…

Probability · Mathematics 2026-05-12 Qi Li , Yue Li , Tusheng Zhang

We show how Langevin diffusions can be interpreted in the context of stochastic Hamiltonian systems with structure-preserving noise and dissipation on reductive Lie groups. Reductive Lie groups provide the setting in which the Lie group…

Probability · Mathematics 2025-09-15 Erwin Luesink , Oliver D. Street

In this article, we consider the problem of sampling from a probability measure $\pi$ having a density on $\mathbb{R}^d$ known up to a normalizing constant, $x\mapsto \mathrm{e}^{-U(x)} / \int_{\mathbb{R}^d} \mathrm{e}^{-U(y)} \mathrm{d}…

Methodology · Statistics 2018-11-27 Nicolas Brosse , Alain Durmus , Éric Moulines , Sotirios Sabanis

We present a new random walk for uniformly sampling high-dimensional convex bodies. It achieves state-of-the-art runtime complexity with stronger guarantees on the output than previously known, namely in R\'enyi divergence (which implies…

Data Structures and Algorithms · Computer Science 2026-03-23 Yunbum Kook , Santosh S. Vempala , Matthew S. Zhang

We introduce a stochastic equation for the microscopic motion of a tagged particle in the single file model. This equation provides a compact representation of several of the system's properties such as Fluctuation-Dissipation and Linear…

Statistical Mechanics · Physics 2009-11-13 Alessandro Taloni , Michael A. Lomholt