English
Related papers

Related papers: Differentially Private Top-k Selection via Canonic…

200 papers

$f$-DP has recently been proposed as a generalization of differential privacy allowing a lossless analysis of composition, post-processing, and privacy amplification via subsampling. In the setting of $f$-DP, we propose the concept of a…

Cryptography and Security · Computer Science 2023-01-16 Jordan Awan , Salil Vadhan

Differential privacy (DP) is a widely-accepted and widely-applied notion of privacy based on worst-case analysis. Often, DP classifies most mechanisms without additive noise as non-private (Dwork et al., 2014). Thus, additive noises are…

Cryptography and Security · Computer Science 2023-12-14 Ao Liu , Yu-Xiang Wang , Lirong Xia

In the task of differentially private (DP) continual counting, we receive a stream of increments and our goal is to output an approximate running total of these increments, without revealing too much about any specific increment. Despite…

Data Structures and Algorithms · Computer Science 2024-05-07 Krishnamurthy Dvijotham , H. Brendan McMahan , Krishna Pillutla , Thomas Steinke , Abhradeep Thakurta

We present a differentially private algorithm for releasing the sequence of $k$ elements with the highest counts from a data domain of $d$ elements. The algorithm is a "joint" instance of the exponential mechanism, and its output space…

Cryptography and Security · Computer Science 2022-09-01 Jennifer Gillenwater , Matthew Joseph , Andrés Muñoz Medina , Mónica Ribero

We study Stochastic Convex Optimization in the Differential Privacy model (DP-SCO). Unlike previous studies, here we assume the population risk function satisfies the Tsybakov Noise Condition (TNC) with some parameter $\theta>1$, where the…

Machine Learning · Computer Science 2025-09-08 Difei Xu , Meng Ding , Zihang Xiang , Jinhui Xu , Di Wang

We study the differentially private top-$k$ selection problem, aiming to identify a sequence of $k$ items with approximately the highest scores from $d$ items. Recent work by Gillenwater et al. (ICML '22) employs a direct sampling approach…

Cryptography and Security · Computer Science 2026-01-09 Hao WU , Hanwen Zhang

A canonical noise distribution (CND) is an additive mechanism designed to satisfy $f$-differential privacy ($f$-DP), without any wasted privacy budget. $f$-DP is a hypothesis testing-based formulation of privacy phrased in terms of tradeoff…

Cryptography and Security · Computer Science 2022-10-07 Jordan Awan , Jinshuo Dong

We provide an end-to-end Renyi DP based-framework for differentially private top-$k$ selection. Unlike previous approaches, which require a data-independent choice on $k$, we propose to privately release a data-dependent choice of $k$ such…

Machine Learning · Computer Science 2022-03-31 Yuqing Zhu , Yu-Xiang Wang

Concern about how to aggregate sensitive user data without compromising individual privacy is a major barrier to greater availability of data. The model of differential privacy has emerged as an accepted model to release sensitive…

Databases · Computer Science 2017-10-03 Graham Cormode , Tejas Kulkarni , Divesh Srivastava

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

Differential privacy (DP) offers a robust framework for safeguarding individual data privacy. To utilize DP in training modern machine learning models, differentially private optimizers have been widely used in recent years. A popular…

Machine Learning · Computer Science 2025-04-30 Xinwei Zhang , Zhiqi Bu , Borja Balle , Mingyi Hong , Meisam Razaviyayn , Vahab Mirrokni

Differential privacy is widely used in data analysis. State-of-the-art $k$-means clustering algorithms with differential privacy typically add an equal amount of noise to centroids for each iterative computation. In this paper, we propose a…

Cryptography and Security · Computer Science 2020-10-06 Tianjiao Ni , Minghao Qiao , Zhili Chen , Shun Zhang , Hong Zhong

We characterize the minimum noise amplitude and power for noise-adding mechanisms in $(\epsilon, \delta)$-differential privacy for single real-valued query function. We derive new lower bounds using the duality of linear programming, and…

Cryptography and Security · Computer Science 2019-02-06 Quan Geng , Wei Ding , Ruiqi Guo , Sanjiv Kumar

Differential Privacy (DP) provides a rigorous framework for privacy, ensuring the outputs of data-driven algorithms remain statistically indistinguishable across datasets that differ in a single entry. While guaranteeing DP generally…

Machine Learning · Computer Science 2025-10-17 Yizhou Zhang , Kishan Panaganti , Laixi Shi , Juba Ziani , Adam Wierman

In this paper, we design Top-DP, a novel solution to optimize the differential privacy protection of decentralized image classification systems. The key insight of our solution is to leverage the unique features of decentralized…

Cryptography and Security · Computer Science 2021-09-03 Shangwei Guo , Tianwei Zhang , Guowen Xu , Han Yu , Tao Xiang , Yang Liu

Differentially private synthetic data enables the sharing and analysis of sensitive datasets while providing rigorous privacy guarantees for individual contributors. A central challenge is to achieve strong utility guarantees for meaningful…

Statistics Theory · Mathematics 2026-02-06 Rundong Ding , Yiyun He , Yizhe Zhu

Differential privacy (DP) is a class of mathematical standards for assessing the privacy provided by a data-release mechanism. This work concerns two important flavors of DP that are related yet conceptually distinct: pure…

Statistics Theory · Mathematics 2024-08-22 James Bailie , Ruobin Gong

Privacy amplification exploits randomness in data selection to provide tighter differential privacy (DP) guarantees. This analysis is key to DP-SGD's success in machine learning, but, is not readily applicable to the newer state-of-the-art…

Machine Learning · Computer Science 2024-05-07 Christopher A. Choquette-Choo , Arun Ganesh , Thomas Steinke , Abhradeep Thakurta

We propose a new framework for differentially private optimization of convex functions which are Lipschitz in an arbitrary norm $\|\cdot\|$. Our algorithms are based on a regularized exponential mechanism which samples from the density…

Machine Learning · Computer Science 2022-11-14 Sivakanth Gopi , Yin Tat Lee , Daogao Liu , Ruoqi Shen , Kevin Tian

Differential privacy provides the first theoretical foundation with provable privacy guarantee against adversaries with arbitrary prior knowledge. The main idea to achieve differential privacy is to inject random noise into statistical…

Data Structures and Algorithms · Computer Science 2011-11-01 Yang D. Li , Zhenjie Zhang , Marianne Winslett , Yin Yang