Bias Analysis in Entropy Estimation
统计力学
2009-11-10 v3 数学物理
math.MP
数据分析、统计与概率
摘要
We consider the problem of finite sample corrections for entropy estimation. New estimates of the Shannon entropy are proposed and their systematic error (the bias) is computed analytically. We find that our results cover correction formulas of current entropy estimates recently discussed in literature. The trade-off between bias reduction and the increase of the corresponding statistical error is analyzed.
引用
@article{arxiv.cond-mat/0403192,
title = {Bias Analysis in Entropy Estimation},
author = {Thomas Schürmann},
journal= {arXiv preprint arXiv:cond-mat/0403192},
year = {2009}
}
备注
5 pages, 3 figures