Improved Bounds for Discretization of Langevin Diffusions: Near-Optimal Rates without Convexity
Probability
2019-11-05 v2 Statistics Theory
Computation
Machine Learning
Statistics Theory
Abstract
We present an improved analysis of the Euler-Maruyama discretization of the Langevin diffusion. Our analysis does not require global contractivity, and yields polynomial dependence on the time horizon. Compared to existing approaches, we make an additional smoothness assumption, and improve the existing rate from to in terms of the KL divergence. This result matches the correct order for numerical SDEs, without suffering from exponential time dependence. When applied to algorithms for sampling and learning, this result simultaneously improves all those methods based on Dalayan's approach.
Keywords
Cite
@article{arxiv.1907.11331,
title = {Improved Bounds for Discretization of Langevin Diffusions: Near-Optimal Rates without Convexity},
author = {Wenlong Mou and Nicolas Flammarion and Martin J. Wainwright and Peter L. Bartlett},
journal= {arXiv preprint arXiv:1907.11331},
year = {2019}
}
Comments
Changes from v1: corrections in the proof of Lemma 6 and Lemma 10; fixed some minor typos