English

Testing Against Independence and a R\'enyi Information Measure

Information Theory 2018-09-19 v3 math.IT

Abstract

The achievable error-exponent pairs for the type I and type II errors are characterized in a hypothesis testing setup where the observation consists of independent and identically distributed samples from either a known joint probability distribution or an unknown product distribution. The empirical mutual information test, the Hoeffding test, and the generalized likelihood-ratio test are all shown to be asymptotically optimal. An expression based on a Renyi measure of dependence is shown to be the Fenchel biconjugate of the error-exponent function obtained by fixing one error exponent and optimizing the other. An example is provided where the error-exponent function is not convex and thus not equal to its Fenchel biconjugate.

Keywords

Cite

@article{arxiv.1805.11059,
  title  = {Testing Against Independence and a R\'enyi Information Measure},
  author = {Amos Lapidoth and Christoph Pfister},
  journal= {arXiv preprint arXiv:1805.11059},
  year   = {2018}
}

Comments

7 pages; accepted at ITW 2018; with additional proofs