English
Related papers

Related papers: Decomposition-Based Optimal Bounds for Privacy Amp…

200 papers

Amplification by subsampling is one of the main primitives in machine learning with differential privacy (DP): Training a model on random batches instead of complete datasets results in stronger privacy. This is traditionally formalized via…

Cryptography and Security · Computer Science 2024-11-04 Jan Schuchardt , Mihail Stoian , Arthur Kosmala , Stephan Günnemann

The shuffle model of DP (Differential Privacy) provides high utility by introducing a shuffler that randomly shuffles noisy data sent from users. However, recent studies show that existing shuffle protocols suffer from the following two…

Cryptography and Security · Computer Science 2025-04-11 Takao Murakami , Yuichi Sei , Reo Eriguchi

Uniformity testing, or testing whether independent observations are uniformly distributed, is the prototypical question in distribution testing. Over the past years, a line of work has been focusing on uniformity testing under privacy…

Data Structures and Algorithms · Computer Science 2021-10-19 Clément L. Canonne , Hongyi Lyu

Differential privacy comes equipped with multiple analytical tools for the design of private data analyses. One important tool is the so-called "privacy amplification by subsampling" principle, which ensures that a differentially private…

Machine Learning · Computer Science 2018-11-26 Borja Balle , Gilles Barthe , Marco Gaboardi

Differential privacy (DP) provides rigorous privacy guarantees on individual's data while also allowing for accurate statistics to be conducted on the overall, sensitive dataset. To design a private system, first private algorithms must be…

Cryptography and Security · Computer Science 2020-11-19 Mark Cesar , Ryan Rogers

Privacy amplification is an indispensable step in the post-processing of quantum key distribution, which can be used to compress the redundancy of shared key and improve the security level of the key. The commonly used privacy amplification…

Quantum Physics · Physics 2021-09-16 Wei Li , Shengmei Zhao

We study privacy amplification for differentially private model training with matrix factorization under random allocation (also known as the balls-in-bins model). Recent work by Choquette-Choo et al. (2025) proposes a sampling-based Monte…

Machine Learning · Computer Science 2026-05-18 Jan Schuchardt , Nikita Kalinin

Federated learning promises to make machine learning feasible on distributed, private datasets by implementing gradient descent using secure aggregation methods. The idea is to compute a global weight update without revealing the…

Machine Learning · Computer Science 2019-12-03 Badih Ghazi , Rasmus Pagh , Ameya Velingker

In this paper, we consider the framework of privacy amplification via iteration, which is originally proposed by Feldman et al. and subsequently simplified by Asoodeh et al. in their analysis via the contraction coefficient. This line of…

Cryptography and Security · Computer Science 2021-06-23 Matteo Sordello , Zhiqi Bu , Jinshuo Dong

Privacy amplification exploits randomness in data selection to provide tighter differential privacy (DP) guarantees. This analysis is key to DP-SGD's success in machine learning, but, is not readily applicable to the newer state-of-the-art…

Machine Learning · Computer Science 2024-05-07 Christopher A. Choquette-Choo , Arun Ganesh , Thomas Steinke , Abhradeep Thakurta

We study a protocol for distributed computation called shuffled check-in, which achieves strong privacy guarantees without requiring any further trust assumptions beyond a trusted shuffler. Unlike most existing work, shuffled check-in…

Machine Learning · Computer Science 2023-07-06 Seng Pei Liew , Satoshi Hasegawa , Tsubasa Takahashi

Differentially Private Stochastic Gradient Descent (DP-SGD) forms a fundamental building block in many applications for learning over sensitive data. Two standard approaches, privacy amplification by subsampling, and privacy amplification…

Machine Learning · Computer Science 2020-07-31 Borja Balle , Peter Kairouz , H. Brendan McMahan , Om Thakkar , Abhradeep Thakurta

Differentially private (DP) machine learning algorithms incur many sources of randomness, such as random initialization, random batch subsampling, and shuffling. However, such randomness is difficult to take into account when proving…

Machine Learning · Statistics 2023-11-02 Chendi Wang , Buxin Su , Jiayuan Ye , Reza Shokri , Weijie J. Su

In the \emph{shuffle model} of differential privacy, data-holding users send randomized messages to a secure shuffler, the shuffler permutes the messages, and the resulting collection of messages must be differentially private with regard…

Cryptography and Security · Computer Science 2020-08-13 Victor Balcer , Albert Cheu , Matthew Joseph , Jieming Mao

Noisy gradient descent and its variants are the predominant algorithms for differentially private machine learning. It is a fundamental question to quantify their privacy leakage, yet tight characterizations remain open even in the…

Machine Learning · Computer Science 2024-06-13 Jinho Bok , Weijie Su , Jason M. Altschuler

Local differential privacy (LDP) is a variant of differential privacy (DP) that avoids the need for a trusted central curator, at the cost of a worse trade-off between privacy and utility. The shuffle model is a way to provide greater…

Cryptography and Security · Computer Science 2023-05-23 Mireya Jurado , Ramon G. Gonze , Mário S. Alvim , Catuscia Palamidessi

We study the problem of computing the privacy parameters for DP machine learning when using privacy amplification via random batching and noise correlated across rounds via a correlation matrix $\textbf{C}$ (i.e., the matrix mechanism).…

Cryptography and Security · Computer Science 2025-03-24 Christopher A. Choquette-Choo , Arun Ganesh , Saminul Haque , Thomas Steinke , Abhradeep Thakurta

Differential privacy (DP) is a formal notion for quantifying the privacy loss of algorithms. Algorithms in the central model of DP achieve high accuracy but make the strongest trust assumptions whereas those in the local DP model make the…

Cryptography and Security · Computer Science 2021-06-09 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Rasmus Pagh

Data engineering often requires accuracy (utility) constraints on results, posing significant challenges in designing differentially private (DP) mechanisms, particularly under stringent privacy parameter $\epsilon$. In this paper, we…

Cryptography and Security · Computer Science 2024-12-17 Bo Jiang , Wanrong Zhang , Donghang Lu , Jian Du , Sagar Sharma , Qiang Yan

Shuffler-based differential privacy (shuffle-DP) is a privacy paradigm providing high utility by involving a shuffler to permute noisy report from users. Existing shuffle-DP protocols mainly focus on the design of shuffler-based categorical…

Cryptography and Security · Computer Science 2026-03-06 Xiaoguang Li , Hanyi Wang , Yaowei Huang , Jungang Yang , Qingqing Ye , Haonan Yan , Ke Pan , Zhe Sun , Hui Li