Distance-based and continuum Fano inequalities with applications to statistical estimation
Information Theory
2014-01-03 v2 math.IT
Statistics Theory
Statistics Theory
Abstract
In this technical note, we give two extensions of the classical Fano inequality in information theory. The first extends Fano's inequality to the setting of estimation, providing lower bounds on the probability that an estimator of a discrete quantity is within some distance of the quantity. The second inequality extends our bound to a continuum setting and provides a volume-based bound. We illustrate how these inequalities lead to direct and simple proofs of several statistical minimax lower bounds.
Keywords
Cite
@article{arxiv.1311.2669,
title = {Distance-based and continuum Fano inequalities with applications to statistical estimation},
author = {John C. Duchi and Martin J. Wainwright},
journal= {arXiv preprint arXiv:1311.2669},
year = {2014}
}
Comments
16 pages, 1 figure