English
Related papers

Related papers: The Tamed Unadjusted Langevin Algorithm

200 papers

A new (unadjusted) Langevin Monte Carlo (LMC) algorithm with improved rates in total variation and in Wasserstein distance is presented. All these are obtained in the context of sampling from a target distribution $\pi$ that has a density…

Statistics Theory · Mathematics 2019-10-18 Sotirios Sabanis , Ying Zhang

We analyse a Monte Carlo particle method for the simulation of the calibrated Heston-type local stochastic volatility (H-LSV) model. The common application of a kernel estimator for a conditional expectation in the calibration condition…

Computational Finance · Quantitative Finance 2025-04-22 Christoph Reisinger , Maria Olympia Tsianni

Distribution shift between train (source) and test (target) datasets is a common problem encountered in machine learning applications. One approach to resolve this issue is to use the Unsupervised Domain Adaptation (UDA) technique that…

The randomized midpoint method, proposed by [SL19], has emerged as an optimal discretization procedure for simulating the continuous time Langevin diffusions. Focusing on the case of strong-convex and smooth potentials, in this paper, we…

Machine Learning · Statistics 2021-09-14 Ye He , Krishnakumar Balasubramanian , Murat A. Erdogdu

Langevin algorithms are gradient descent methods augmented with additive noise, and are widely used in Markov Chain Monte Carlo (MCMC) sampling, optimization, and machine learning. In recent years, the non-asymptotic analysis of Langevin…

Machine Learning · Computer Science 2023-01-10 Yuping Zheng , Andrew Lamperski

We analyze the oracle complexity of sampling from polynomially decaying heavy-tailed target densities based on running the Unadjusted Langevin Algorithm on certain transformed versions of the target density. The specific class of…

Statistics Theory · Mathematics 2022-01-21 Ye He , Krishnakumar Balasubramanian , Murat A. Erdogdu

We utilise a sampler originating from nonequilibrium statistical mechanics, termed here Jarzynski-adjusted Langevin algorithm (JALA), to build statistical estimation methods in latent variable models. We achieve this by leveraging…

Computation · Statistics 2025-10-27 James Cuin , Davide Carbone , O. Deniz Akyildiz

A canonical algorithm for log-concave sampling is the Langevin Algorithm, aka the Langevin Diffusion run with some discretization stepsize $\eta > 0$. This discretization leads the Langevin Algorithm to have a stationary distribution…

Machine Learning · Statistics 2024-10-22 Jason M. Altschuler , Kunal Talwar

We consider the constrained sampling problem where the goal is to sample from a target distribution $\pi(x)\propto e^{-f(x)}$ when $x$ is constrained to lie on a convex body $\mathcal{C}$. Motivated by penalty methods from continuous…

Machine Learning · Statistics 2025-05-16 Mert Gürbüzbalaban , Yuanhan Hu , Lingjiong Zhu

In this article we show that for SDEs with a drift coefficient that is non-locally integrable, one may define a tamed Euler scheme that converges in $L^p$ at rate $1/2$ to the true solution. The taming is required in this case since one…

Probability · Mathematics 2024-08-16 Tim Johnston , Sotirios Sabanis

In this paper, we study the stability of various difference approximations of the Euler-Korteweg equations. This system of evolution PDEs is a classical isentropic Euler system perturbed by a dispersive (third order) term. The Euler…

Numerical Analysis · Mathematics 2014-01-30 Pascal Noble , Jean-Paul Vila

We propose an algorithm for approximating the solution of a strongly oscillating SDE, that is, a system in which some ergodic state variables evolve quickly with respect to the other variables. The algorithm profits from homogenization…

Probability · Mathematics 2015-03-19 Camilo Andrés García Trillos

We obtain non asymptotic bounds for the Monte Carlo algorithm associated to the Euler discretization of some diffusion processes. The key tool is the Gaussian concentration satisfied by the density of the discretization scheme. This…

Probability · Mathematics 2018-02-20 Vincent Lemaire , Stephane Menozzi

We consider the long-time behavior of an explicit tamed Euler scheme applied to a class of stochastic differential equations driven by additive noise, under a one-sided Lipschitz continuity condition. The setting encompasses drift…

Numerical Analysis · Mathematics 2020-10-02 Charles-Edouard Bréhier

Leveraging algorithmic stability to derive sharp generalization bounds is a classic and powerful approach in learning theory. Since Vapnik and Chervonenkis [1974] first formalized the idea for analyzing SVMs, it has been utilized to study…

Machine Learning · Computer Science 2021-01-26 Qinghua Liu , Zhou Lu

The present work introduces and investigates an explicit time discretization scheme, called the projected Euler method,to numerically approximate random periodic solutions of semi-linear SDEs under non-globally Lipschitz conditions. The…

Numerical Analysis · Mathematics 2024-11-26 Yujia Guo , Xiaojie Wang , Yue Wu

We apply the sample average approximation (SAA) method to risk-neutral optimization problems governed by nonlinear partial differential equations (PDEs) with random inputs. We analyze the consistency of the SAA optimal values and SAA…

Optimization and Control · Mathematics 2023-08-03 Johannes Milz

Unsupervised domain adaptation (UDA) aims to improve the prediction performance in the target domain under distribution shifts from the source domain. The key principle of UDA is to minimize the divergence between the source and the target…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 JoonHo Lee , Gyemin Lee

The Metropolis-adjusted Langevin (MALA) algorithm is a sampling algorithm that incorporates the gradient of the logarithm of the target density in its proposal distribution. In an earlier joint work \citet{pill:stu:12}, the author had…

Computation · Statistics 2025-01-15 Natesh S. Pillai

Algorithms based on discretizing Langevin diffusion are popular tools for sampling from high-dimensional distributions. We develop novel connections between such Monte Carlo algorithms, the theory of Wasserstein gradient flow, and the…

Computation · Statistics 2019-05-13 Espen Bernton