English

R\'enyi-infinity constrained sampling with $d^3$ membership queries

Data Structures and Algorithms 2024-07-19 v1 Machine Learning Statistics Theory Machine Learning Statistics Theory

Abstract

Uniform sampling over a convex body is a fundamental algorithmic problem, yet the convergence in KL or R\'enyi divergence of most samplers remains poorly understood. In this work, we propose a constrained proximal sampler, a principled and simple algorithm that possesses elegant convergence guarantees. Leveraging the uniform ergodicity of this sampler, we show that it converges in the R\'enyi-infinity divergence (R\mathcal R_\infty) with no query complexity overhead when starting from a warm start. This is the strongest of commonly considered performance metrics, implying rates in {Rq,KL}\{\mathcal R_q, \mathsf{KL}\} convergence as special cases. By applying this sampler within an annealing scheme, we propose an algorithm which can approximately sample ε\varepsilon-close to the uniform distribution on convex bodies in R\mathcal R_\infty-divergence with O~(d3polylog1ε)\widetilde{\mathcal{O}}(d^3\, \text{polylog} \frac{1}{\varepsilon}) query complexity. This improves on all prior results in {Rq,KL}\{\mathcal R_q, \mathsf{KL}\}-divergences, without resorting to any algorithmic modifications or post-processing of the sample. It also matches the prior best known complexity in total variation distance.

Keywords

Cite

@article{arxiv.2407.12967,
  title  = {R\'enyi-infinity constrained sampling with $d^3$ membership queries},
  author = {Yunbum Kook and Matthew S. Zhang},
  journal= {arXiv preprint arXiv:2407.12967},
  year   = {2024}
}

Comments

30 pages

R2 v1 2026-06-28T17:45:08.236Z