English

Free Gap Information from the Differentially Private Sparse Vector and Noisy Max Mechanisms

Machine Learning 2019-09-17 v3 Cryptography and Security Databases Machine Learning

Abstract

Noisy Max and Sparse Vector are selection algorithms for differential privacy and serve as building blocks for more complex algorithms. In this paper we show that both algorithms can release additional information for free (i.e., at no additional privacy cost). Noisy Max is used to return the approximate maximizer among a set of queries. We show that it can also release for free the noisy gap between the approximate maximizer and runner-up. This free information can improve the accuracy of certain subsequent counting queries by up to 50%. Sparse Vector is used to return a set of queries that are approximately larger than a fixed threshold. We show that it can adaptively control its privacy budget (use less budget for queries that are likely to be much larger than the threshold) in order to increase the amount of queries it can process. These results follow from a careful privacy analysis.

Keywords

Cite

@article{arxiv.1904.12773,
  title  = {Free Gap Information from the Differentially Private Sparse Vector and Noisy Max Mechanisms},
  author = {Zeyu Ding and Yuxin Wang and Danfeng Zhang and Daniel Kifer},
  journal= {arXiv preprint arXiv:1904.12773},
  year   = {2019}
}

Comments

16 pages

R2 v1 2026-06-23T08:52:27.350Z