Proximal Langevin Algorithm: Rapid Convergence Under Isoperimetry
Machine Learning
2019-11-06 v1 Data Structures and Algorithms
Information Theory
Machine Learning
math.IT
Abstract
We study the Proximal Langevin Algorithm (PLA) for sampling from a probability distribution on under isoperimetry. We prove a convergence guarantee for PLA in Kullback-Leibler (KL) divergence when satisfies log-Sobolev inequality (LSI) and has bounded second and third derivatives. This improves on the result for the Unadjusted Langevin Algorithm (ULA), and matches the fastest known rate for sampling under LSI (without Metropolis filter) with a better dependence on the LSI constant. We also prove convergence guarantees for PLA in R\'enyi divergence of order when the biased limit satisfies either LSI or Poincar\'e inequality.
Keywords
Cite
@article{arxiv.1911.01469,
title = {Proximal Langevin Algorithm: Rapid Convergence Under Isoperimetry},
author = {Andre Wibisono},
journal= {arXiv preprint arXiv:1911.01469},
year = {2019}
}