A Concentration Result of Estimating Phi-Divergence using Data Dependent Partition
Probability
2018-01-04 v1 Statistics Theory
Statistics Theory
Abstract
Estimation of the -divergence between two unknown probability distributions using empirical data is a fundamental problem in information theory and statistical learning. We consider a multi-variate generalization of the data dependent partitioning method for estimating divergence between the two unknown distributions. Under the assumption that the distribution satisfies a power law of decay, we provide a convergence rate result for this method on the number of samples and hyper-rectangles required to ensure the estimation error is bounded by a given level with a given probability.
Cite
@article{arxiv.1801.00852,
title = {A Concentration Result of Estimating Phi-Divergence using Data Dependent Partition},
author = {Fengqiao Luo and Sanjay Mehrotra},
journal= {arXiv preprint arXiv:1801.00852},
year = {2018}
}
Comments
15 pages