English

Projected Langevin Monte Carlo algorithms in non-convex and super-linear setting

Numerical Analysis 2025-01-30 v4 Numerical Analysis Probability

Abstract

It is of significant interest in many applications to sample from a high-dimensional target distribution π\pi with the density π(dx)eU(x)(dx)\pi(\text{d} x) \propto e^{-U(x)} (\text{d} x) , based on the temporal discretization of the Langevin stochastic differential equations (SDEs). In this paper, we propose an explicit projected Langevin Monte Carlo (PLMC) algorithm with non-convex potential UU and super-linear gradient of UU and investigate the non-asymptotic analysis of its sampling error in total variation distance. Equipped with time-independent regularity estimates for the associated Kolmogorov equation, we derive the non-asymptotic bounds on the total variation distance between the target distribution of the Langevin SDEs and the law induced by the PLMC scheme with order O(dmax{3γ/2,2γ1}hlnh)\mathcal{O}(d^{\max\{3\gamma/2 , 2\gamma-1 \}} h |\ln h|), where dd is the dimension of the target distribution and γ1\gamma \geq 1 characterizes the growth of the gradient of UU. In addition, if the gradient of UU is globally Lipschitz continuous, an improved convergence order of O(d3/2h)\mathcal{O}(d^{3/2} h) for the classical Langevin Monte Carlo (LMC) scheme is derived with a refinement of the proof based on Malliavin calculus techniques. To achieve a given precision ϵ\epsilon, the smallest number of iterations of the PLMC algorithm is proved to be of order O(dmax{3γ/2,2γ1}ϵ ln(dϵ)ln(1ϵ)){\mathcal{O}}\big(\tfrac{d^{\max\{3\gamma/2 , 2\gamma-1 \}}}{\epsilon} \ \cdot \ln (\tfrac{d}{\epsilon}) \cdot \ln (\tfrac{1}{\epsilon}) \big). In particular, the classical Langevin Monte Carlo (LMC) scheme with the non-convex potential UU and the globally Lipschitz gradient of UU can be guaranteed by order O(d3/2ϵln(1ϵ)){\mathcal{O}}\big(\tfrac{d^{3/2}}{\epsilon} \cdot \ln (\tfrac{1}{\epsilon}) \big). Numerical experiments are provided to confirm the theoretical findings.

Keywords

Cite

@article{arxiv.2312.17077,
  title  = {Projected Langevin Monte Carlo algorithms in non-convex and super-linear setting},
  author = {Chenxu Pang and Xiaojie Wang and Yue Wu},
  journal= {arXiv preprint arXiv:2312.17077},
  year   = {2025}
}

Comments

45 pages, 7 figures, 5 tables

R2 v1 2026-06-28T14:03:47.961Z