An information theorist's tour of differential privacy
Abstract
Since being proposed in 2006, differential privacy has become a standard method for quantifying certain risks in publishing or sharing analyses of sensitive data. At its heart, differential privacy measures risk in terms of the differences between probability distributions, which is a central topic in information theory. A differentially private algorithm is a channel between the underlying data and the output of the analysis. Seen in this way, the guarantees made by differential privacy can be understood in terms of properties of this channel. In this article we examine a few of the key connections between information theory and the formulation/application of differential privacy, giving an ``operational significance'' for relevant information measures.
Keywords
Cite
@article{arxiv.2510.10316,
title = {An information theorist's tour of differential privacy},
author = {Anand D. Sarwate and Flavio P. Calmon and Oliver Kosut and Lalitha Sankar},
journal= {arXiv preprint arXiv:2510.10316},
year = {2025}
}
Comments
16 pages, 8 figures, under review at BITS, the Information Theory Magazine