English

Distance-based and continuum Fano inequalities with applications to statistical estimation

Information Theory 2014-01-03 v2 math.IT Statistics Theory Statistics Theory

Abstract

In this technical note, we give two extensions of the classical Fano inequality in information theory. The first extends Fano's inequality to the setting of estimation, providing lower bounds on the probability that an estimator of a discrete quantity is within some distance tt of the quantity. The second inequality extends our bound to a continuum setting and provides a volume-based bound. We illustrate how these inequalities lead to direct and simple proofs of several statistical minimax lower bounds.

Keywords

Cite

@article{arxiv.1311.2669,
  title  = {Distance-based and continuum Fano inequalities with applications to statistical estimation},
  author = {John C. Duchi and Martin J. Wainwright},
  journal= {arXiv preprint arXiv:1311.2669},
  year   = {2014}
}

Comments

16 pages, 1 figure

R2 v1 2026-06-22T02:05:31.480Z