English

Stronger Coreset Bounds for Kernel Density Estimators via Chaining

Machine Learning 2023-10-13 v1 Computational Geometry Data Structures and Algorithms

Abstract

We apply the discrepancy method and a chaining approach to give improved bounds on the coreset complexity of a wide class of kernel functions. Our results give randomized polynomial time algorithms to produce coresets of size O(dεloglog1ε)O\big(\frac{\sqrt{d}}{\varepsilon}\sqrt{\log\log \frac{1}{\varepsilon}}\big) for the Gaussian and Laplacian kernels in the case that the data set is uniformly bounded, an improvement that was not possible with previous techniques. We also obtain coresets of size O(1εloglog1ε)O\big(\frac{1}{\varepsilon}\sqrt{\log\log \frac{1}{\varepsilon}}\big) for the Laplacian kernel for dd constant. Finally, we give the best known bounds of O(dεlog(2max{1,α}))O\big(\frac{\sqrt{d}}{\varepsilon}\sqrt{\log(2\max\{1,\alpha\})}\big) on the coreset complexity of the exponential, Hellinger, and JS Kernels, where 1/α1/\alpha is the bandwidth parameter of the kernel.

Keywords

Cite

@article{arxiv.2310.08548,
  title  = {Stronger Coreset Bounds for Kernel Density Estimators via Chaining},
  author = {Rainie Bozzai and Thomas Rothvoss},
  journal= {arXiv preprint arXiv:2310.08548},
  year   = {2023}
}

Comments

23 pages

R2 v1 2026-06-28T12:49:02.317Z