English

A Concentration Result of Estimating Phi-Divergence using Data Dependent Partition

Probability 2018-01-04 v1 Statistics Theory Statistics Theory

Abstract

Estimation of the ϕ\phi-divergence between two unknown probability distributions using empirical data is a fundamental problem in information theory and statistical learning. We consider a multi-variate generalization of the data dependent partitioning method for estimating divergence between the two unknown distributions. Under the assumption that the distribution satisfies a power law of decay, we provide a convergence rate result for this method on the number of samples and hyper-rectangles required to ensure the estimation error is bounded by a given level with a given probability.

Keywords

Cite

@article{arxiv.1801.00852,
  title  = {A Concentration Result of Estimating Phi-Divergence using Data Dependent Partition},
  author = {Fengqiao Luo and Sanjay Mehrotra},
  journal= {arXiv preprint arXiv:1801.00852},
  year   = {2018}
}

Comments

15 pages

R2 v1 2026-06-22T23:34:59.724Z