English

Complexity of zigzag sampling algorithm for strongly log-concave distributions

Machine Learning 2022-06-07 v2 Machine Learning Numerical Analysis Numerical Analysis Computation

Abstract

We study the computational complexity of zigzag sampling algorithm for strongly log-concave distributions. The zigzag process has the advantage of not requiring time discretization for implementation, and that each proposed bouncing event requires only one evaluation of partial derivative of the potential, while its convergence rate is dimension independent. Using these properties, we prove that the zigzag sampling algorithm achieves ε\varepsilon error in chi-square divergence with a computational cost equivalent to O(κ2d12(log1ε)32)O\bigl(\kappa^2 d^\frac{1}{2}(\log\frac{1}{\varepsilon})^{\frac{3}{2}}\bigr) gradient evaluations in the regime κdlogd\kappa \ll \frac{d}{\log d} under a warm start assumption, where κ\kappa is the condition number and dd is the dimension.

Keywords

Cite

@article{arxiv.2012.11094,
  title  = {Complexity of zigzag sampling algorithm for strongly log-concave distributions},
  author = {Jianfeng Lu and Lihan Wang},
  journal= {arXiv preprint arXiv:2012.11094},
  year   = {2022}
}

Comments

We added a new discussion that the warmness assumption of our main theorem can be achieved using LMC

R2 v1 2026-06-23T21:06:56.213Z