English

Equivocations, Exponents and Second-Order Coding Rates under Various R\'enyi Information Measures

Information Theory 2016-07-06 v3 Cryptography and Security math.IT

Abstract

We evaluate the asymptotics of equivocations, their exponents as well as their second-order coding rates under various R\'{e}nyi information measures. Specifically, we consider the effect of applying a hash function on a source and we quantify the level of non-uniformity and dependence of the compressed source from another correlated source when the number of copies of the sources is large. Unlike previous works that use Shannon information measures to quantify randomness, information or uniformity, we define our security measures in terms of a more general class of information measures--the R\'{e}nyi information measures and their Gallager-type counterparts. A special case of these R\'{e}nyi information measure is the class of Shannon information measures. We prove tight asymptotic results for the security measures and their exponential rates of decay. We also prove bounds on the second-order asymptotics and show that these bounds match when the magnitudes of the second-order coding rates are large. We do so by establishing new classes non-asymptotic bounds on the equivocation and evaluating these bounds using various probabilistic limit theorems asymptotically.

Keywords

Cite

@article{arxiv.1504.02536,
  title  = {Equivocations, Exponents and Second-Order Coding Rates under Various R\'enyi Information Measures},
  author = {Masahito Hayashi and Vincent Y. F. Tan},
  journal= {arXiv preprint arXiv:1504.02536},
  year   = {2016}
}

Comments

47 pages, 9 figures; Presented at the 2015 International Symposium on Information Theory (Hong Kong); Submitted to the IEEE Transactions on Information Theory; v3: fixed typos and added some clarifications to the proofs

R2 v1 2026-06-22T09:13:55.244Z