English

Sampling from a log-concave distribution with Projected Langevin Monte Carlo

Probability 2016-08-08 v1 Data Structures and Algorithms Machine Learning

Abstract

We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected Stochastic Gradient Descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a log-concave distribution with smooth potential. This gives a new Markov chain to sample from a log-concave distribution. Our main result shows in particular that when the target distribution is uniform, LMC mixes in O~(n7)\tilde{O}(n^7) steps (where nn is the dimension). We also provide preliminary experimental evidence that LMC performs at least as well as hit-and-run, for which a better mixing time of O~(n4)\tilde{O}(n^4) was proved by Lov{\'a}sz and Vempala.

Keywords

Cite

@article{arxiv.1507.02564,
  title  = {Sampling from a log-concave distribution with Projected Langevin Monte Carlo},
  author = {Sébastien Bubeck and Ronen Eldan and Joseph Lehec},
  journal= {arXiv preprint arXiv:1507.02564},
  year   = {2016}
}

Comments

Preliminary version; 23 pages

R2 v1 2026-06-22T10:08:52.237Z