English

Improved Bounds for Discretization of Langevin Diffusions: Near-Optimal Rates without Convexity

Probability 2019-11-05 v2 Statistics Theory Computation Machine Learning Statistics Theory

Abstract

We present an improved analysis of the Euler-Maruyama discretization of the Langevin diffusion. Our analysis does not require global contractivity, and yields polynomial dependence on the time horizon. Compared to existing approaches, we make an additional smoothness assumption, and improve the existing rate from O(η)O(\eta) to O(η2)O(\eta^2) in terms of the KL divergence. This result matches the correct order for numerical SDEs, without suffering from exponential time dependence. When applied to algorithms for sampling and learning, this result simultaneously improves all those methods based on Dalayan's approach.

Keywords

Cite

@article{arxiv.1907.11331,
  title  = {Improved Bounds for Discretization of Langevin Diffusions: Near-Optimal Rates without Convexity},
  author = {Wenlong Mou and Nicolas Flammarion and Martin J. Wainwright and Peter L. Bartlett},
  journal= {arXiv preprint arXiv:1907.11331},
  year   = {2019}
}

Comments

Changes from v1: corrections in the proof of Lemma 6 and Lemma 10; fixed some minor typos