A Variational Formula for Infinity-R\'{e}nyi Divergence with Applications to Information Leakage
Information Theory
2022-05-03 v2 math.IT
Abstract
We present a variational characterization for the R\'{e}nyi divergence of order infinity. Our characterization is related to guessing: the objective functional is a ratio of maximal expected values of a gain function applied to the probability of correctly guessing an unknown random variable. An important aspect of our variational characterization is that it remains agnostic to the particular gain function considered, as long as it satisfies some regularity conditions. Also, we define two variants of a tunable measure of information leakage, the maximal -leakage, and obtain closed-form expressions for these information measures by leveraging our variational characterization.
Keywords
Cite
@article{arxiv.2202.06040,
title = {A Variational Formula for Infinity-R\'{e}nyi Divergence with Applications to Information Leakage},
author = {Gowtham R. Kurri and Oliver Kosut and Lalitha Sankar},
journal= {arXiv preprint arXiv:2202.06040},
year = {2022}
}
Comments
Accepted to ISIT 2022, 6 pages