English
Related papers

Related papers: Variance reduction for irreversible Langevin sampl…

200 papers

We analyze the posterior contraction rates of parameters in Bayesian models via the Langevin diffusion process, in particular by controlling moments of the stochastic process and taking limits. Analogous to the non-asymptotic analysis of…

Statistics Theory · Mathematics 2022-08-18 Wenlong Mou , Nhat Ho , Martin J. Wainwright , Peter Bartlett , Michael I. Jordan

Adaptive Langevin dynamics is a method for sampling the Boltzmann-Gibbs distribution at prescribed temperature in cases where the potential gradient is subject to stochastic perturbation of unknown magnitude. The method replaces the…

Probability · Mathematics 2023-11-14 Benedict Leimkuhler , Matthias Sachs , Gabriel Stoltz

Motivated by an application to empirical Bayes learning in high-dimensional regression, we study a class of Langevin diffusions in a system with random disorder, where the drift coefficient is driven by a parameter that continuously adapts…

Statistics Theory · Mathematics 2025-11-04 Zhou Fan , Justin Ko , Bruno Loureiro , Yue M. Lu , Yandi Shen

For an arbitrary diffusion process $X$ with time-homogeneous drift and variance parameters $\mu(x)$ and $\sigma^2(x)$, let $V_\varepsilon$ be $1/\varepsilon$ times the total time $X(t)$ spends in the strip…

Probability · Mathematics 2026-03-03 Nils Lid Hjort , Rafail Zalmonovich Khasminskii

We proposed a new technique to accelerate sampling methods for solving difficult optimization problems. Our method investigates the intrinsic connection between posterior distribution sampling and optimization with Langevin dynamics, and…

Machine Learning · Computer Science 2023-01-31 Junlong Lyu , Zhitang Chen , Wenlong Lyu , Jianye Hao

We study two problems. First, we consider the large deviation behavior of empirical measures of certain diffusion processes as, simultaneously, the time horizon becomes large and noise becomes vanishingly small. The law of large numbers…

Probability · Mathematics 2023-09-14 Amarjit Budhiraja , Pavlos Zoubouloglou

We consider large deviations of empirical measures of diffusion processes. In a first part, we present conditions to obtain a large deviations principle (LDP) for a precise class of unbounded functions. This provides an analogue to the…

Probability · Mathematics 2020-09-23 Grégoire Ferré , Gabriel Stoltz

This article is concerned with sampling from Gibbs distributions $\pi(x)\propto e^{-U(x)}$ using Markov chain Monte Carlo methods. In particular, we investigate Langevin dynamics in the continuous- and the discrete-time setting for such…

Numerical Analysis · Mathematics 2026-05-25 Lorenz Fruehwirth , Andreas Habring

Consider a discrete time Markov process $X^\epsilon$ on $\mathbf R^d$ that makes a deterministic jump based on its current location, and then takes a small Gaussian step of variance $\epsilon^2$. We study the behavior of the asymptotic…

Probability · Mathematics 2025-12-19 William Cooperman , Gautam Iyer , James Nolen

Motivated by the task of computing normalizing constants and importance sampling in high dimensions, we study the dimension dependence of fluctuations for additive functionals of time-inhomogeneous Langevin-type diffusions on…

Statistics Theory · Mathematics 2018-09-07 Christophe Andrieu , James Ridgway , Nick Whiteley

This paper addresses the issue of inversion in cases where (1) the observation system is modeled by a linear transformation and additive noise, (2) the problem is ill-posed and regularization is introduced in a Bayesian framework by an a…

Machine Learning · Statistics 2026-02-12 Jean-François Giovannelli

Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian…

Numerical Analysis · Mathematics 2025-02-10 Tony Lelièvre , Grigorios A. Pavliotis , Geneviève Robin , Régis Santet , Gabriel Stoltz

Adaptive or dynamic signal sampling in sensing systems can adapt subsequent sampling strategies based on acquired signals, thereby potentially improving image quality and speed. This paper proposes a Bayesian method for adaptive sampling…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Guanhua Wang , Douglas C. Noll , Jeffrey A. Fessler

We study the long-time dynamics of the nonlinear processes modeled by diffusion-transport partial differential equations in non-divergence form with drifts. The solutions are subject to some inhomogeneous Dirichlet boundary condition.…

Analysis of PDEs · Mathematics 2026-02-11 Luan Hoang , Akif Ibragimov

The randomized midpoint method, proposed by [SL19], has emerged as an optimal discretization procedure for simulating the continuous time Langevin diffusions. Focusing on the case of strong-convex and smooth potentials, in this paper, we…

Machine Learning · Statistics 2021-09-14 Ye He , Krishnakumar Balasubramanian , Murat A. Erdogdu

We consider the problem of nonparametric estimation of the drift of a continuously observed one-dimensional diffusion with periodic drift. Motivated by computational considerations, van der Meulen e.a. (2014) defined a prior on the drift as…

Statistics Theory · Mathematics 2019-02-04 Frank van der Meulen , Moritz Schauer , Jan van Waaij

Importance sampling is a widely used technique to reduce the variance of a Monte Carlo estimator by an appropriate change of measure. In this work, we study importance sam- pling in the framework of diffusion process and consider the change…

Probability · Mathematics 2018-03-28 Carsten Hartmann , Christof Schütte , Marcus Weber , Wei Zhang

Limit distributions for the greatest convex minorant and its derivative are considered for a general class of stochastic processes including partial sum processes and empirical processes, for independent, weakly dependent and long range…

Statistics Theory · Mathematics 2016-08-16 D. Anevski , O. Hössjer

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

Statistics Theory · Mathematics 2018-11-05 Avetik Karagulyan

In many applications of statistical estimation via sampling, one may wish to sample from a high-dimensional target distribution that is adaptively evolving to the samples already seen. We study an example of such dynamics, given by a…

Statistics Theory · Mathematics 2025-11-04 Zhou Fan , Justin Ko , Bruno Loureiro , Yue M. Lu , Yandi Shen