中文
相关论文

相关论文: Sharp convergence rates for Langevin dynamics in t…

200 篇论文

We provide a refined explicit estimate of exponential decay rate of underdamped Langevin dynamics in $L^2$ distance, based on a framework developed in [1]. To achieve this, we first prove a Poincar\'{e}-type inequality with Gibbs measure in…

偏微分方程分析 · 数学 2023-08-25 Yu Cao , Jianfeng Lu , Lihan Wang

We present a framework that allows for the non-asymptotic study of the $2$-Wasserstein distance between the invariant distribution of an ergodic stochastic differential equation and the distribution of its numerical approximation in the…

机器学习 · 统计学 2021-09-27 J. M. Sanz-Serna , Konstantinos C. Zygalakis

Langevin Monte Carlo (LMC) is a popular Markov chain Monte Carlo sampling method. One drawback is that it requires the computation of the full gradient at each iteration, an expensive operation if the dimension of the problem is high. We…

机器学习 · 统计学 2020-10-06 Zhiyan Ding , Qin Li , Jianfeng Lu , Stephen J. Wright

The problem of sampling a target probability distribution on a constrained domain arises in many applications including machine learning. For constrained sampling, various Langevin algorithms such as projected Langevin Monte Carlo (PLMC),…

机器学习 · 统计学 2026-04-07 Yingli Wang , Changwei Tu , Xiaoyu Wang , Lingjiong Zhu

In this paper, we examine the problem of sampling from log-concave distributions with (possibly) superlinear gradient growth under kinetic (underdamped) Langevin algorithms. Using a carefully tailored taming scheme, we propose two novel…

概率论 · 数学 2025-12-10 Iosif Lytras , Panayotis Mertikopoulos

Efficient sampling from complex and high dimensional target distributions turns out to be a fundamental task in diverse disciplines such as scientific computing, statistics and machine learning. In this paper, we propose a new kind of…

机器学习 · 统计学 2026-04-24 Xiaojie Wang , Bin Yang

In large-data applications, such as the inference process of diffusion models, it is desirable to design sampling algorithms with a high degree of parallelization. In this work, we study the adaptive complexity of sampling, which is the…

数据结构与算法 · 计算机科学 2025-05-21 Huanjian Zhou , Baoxiang Wang , Masashi Sugiyama

We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density $\nu$ with respect to the natural measure on a manifold with metric $g$. We assume that the target density satisfies a log-Sobolev…

机器学习 · 计算机科学 2022-04-25 Khashayar Gatmiry , Santosh S. Vempala

In this paper, we analyse a proximal method based on the idea of forward-backward splitting for sampling from distributions with densities that are not necessarily smooth. In particular, we study the non-asymptotic properties of the…

数值分析 · 数学 2022-01-25 Armin Eftekhari , Luis Vargas , Konstantinos Zygalakis

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main result is a…

统计理论 · 数学 2024-03-01 Shogo Nakakita

The Langevin Dynamics (LD), which aims to sample from a probability distribution using its score function, has been widely used for analyzing and developing score-based generative modeling algorithms. While the convergence behavior of LD in…

机器学习 · 计算机科学 2025-06-11 Xiwei Cheng , Kexin Fu , Farzan Farnia

This paper provides a convergence analysis for generalized Hamiltonian Monte Carlo samplers, a family of Markov Chain Monte Carlo methods based on leapfrog integration of Hamiltonian dynamics and kinetic Langevin diffusion, that encompasses…

概率论 · 数学 2024-05-14 Evan Camrud , Alain Durmus , Pierre Monmarché , Gabriel Stoltz

We examine the Langevin diffusion confined to a closed, convex domain $D\subset\mathbb{R}^d$, represented as a reflected stochastic differential equation. We introduce a sequence of penalized stochastic differential equations and prove that…

概率论 · 数学 2026-01-22 Tarika Mane , Amine Boukardagha

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

统计计算 · 统计学 2016-12-06 Arnak S. Dalalyan

We propose a novel discrete Poisson equation approach to estimate the statistical error of a broad class of numerical integrators for the underdamped Langevin dynamics. The statistical error refers to the mean square error of the estimator…

数值分析 · 数学 2024-05-14 Xuda Ye , Zhennan Zhou

We study a sequential Monte Carlo algorithm to sample from the Gibbs measure with a non-convex energy function at a low temperature. We use the practical and popular geometric annealing schedule, and use a Langevin diffusion at each…

统计理论 · 数学 2026-01-13 Ruiyu Han , Gautam Iyer , Dejan Slepčev

We formulate gradient-based Markov chain Monte Carlo (MCMC) sampling as optimization on the space of probability measures, with Kullback-Leibler (KL) divergence as the objective functional. We show that an underdamped form of the Langevin…

Approximate Thompson sampling with Langevin Monte Carlo broadens its reach from Gaussian posterior sampling to encompass more general smooth posteriors. However, it still encounters scalability issues in high-dimensional problems when…

机器学习 · 统计学 2024-06-24 Haoyang Zheng , Wei Deng , Christian Moya , Guang Lin

We propose efficient Langevin Monte Carlo algorithms for sampling distributions with nonsmooth convex composite potentials, which is the sum of a continuously differentiable function and a possibly nonsmooth function. We devise such…

机器学习 · 统计学 2022-07-12 Tim Tsz-Kit Lau , Han Liu

In this paper, we study a method to sample from a target distribution $\pi$ over $\mathbb{R}^d$ having a positive density with respect to the Lebesgue measure, known up to a normalisation factor. This method is based on the Euler…

统计理论 · 数学 2016-12-20 Alain Durmus , Eric Moulines