English
Related papers

Related papers: Almost Tight Error Bounds on Differentially Privat…

200 papers

We lay theoretical foundations for new database release mechanisms that allow third-parties to construct consistent estimators of population statistics, while ensuring that the privacy of each individual contributing to the database is…

Machine Learning · Statistics 2018-06-01 Matej Balog , Ilya Tolstikhin , Bernhard Schölkopf

We study privacy amplification for differentially private model training with matrix factorization under random allocation (also known as the balls-in-bins model). Recent work by Choquette-Choo et al. (2025) proposes a sampling-based Monte…

Machine Learning · Computer Science 2026-05-18 Jan Schuchardt , Nikita Kalinin

We present new mechanisms for \emph{label differential privacy}, a relaxation of differentially private machine learning that only protects the privacy of the labels in the training set. Our mechanisms cluster the examples in the training…

Machine Learning · Computer Science 2021-10-06 Hossein Esfandiari , Vahab Mirrokni , Umar Syed , Sergei Vassilvitskii

Privacy-preserving machine learning algorithms are crucial for the increasingly common setting in which personal data, such as medical or financial records, are analyzed. We provide general techniques to produce privacy-preserving…

Machine Learning · Computer Science 2011-02-18 Kamalika Chaudhuri , Claire Monteleoni , Anand D. Sarwate

Cross-attention has emerged as a cornerstone module in modern artificial intelligence, underpinning critical applications such as retrieval-augmented generation (RAG), system prompting, and guided stable diffusion. However, this is a rising…

Machine Learning · Computer Science 2026-01-26 Yekun Ke , Yingyu Liang , Zhenmei Shi , Zhao Song , Jiahao Zhang

A Private Repetition algorithm takes as input a differentially private algorithm with constant success probability and boosts it to one that succeeds with high probability. These algorithms are closely related to private metaselection…

Cryptography and Security · Computer Science 2024-10-28 Kunal Talwar

Machine learning is increasingly becoming a powerful tool to make decisions in a wide variety of applications, such as medical diagnosis and autonomous driving. Privacy concerns related to the training data and unfair behaviors of some…

Cryptography and Security · Computer Science 2020-03-16 Jiahao Ding , Xinyue Zhang , Xiaohuan Li , Junyi Wang , Rong Yu , Miao Pan

Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspired by recent advances in auditing which have been used for…

Machine Learning · Computer Science 2022-03-29 Florian Tramer , Andreas Terzis , Thomas Steinke , Shuang Song , Matthew Jagielski , Nicholas Carlini

An exciting new development in differential privacy is the shuffled model, in which an anonymous channel enables non-interactive, differentially private protocols with error much smaller than what is possible in the local model, while…

Cryptography and Security · Computer Science 2020-05-20 Badih Ghazi , Noah Golowich , Ravi Kumar , Rasmus Pagh , Ameya Velingker

We study the classical problem of community recovery in stochastic block models with a fixed number of communities, with a twist: We seek algorithms that are stable with respect to node-wise changes in the graph structure, formally defined…

Statistics Theory · Mathematics 2026-05-18 Laurentiu Marchis , Ethan D'souza , Tomáš Flídr , Po-Ling Loh

Hierarchical clustering is a fundamental unsupervised machine learning task with the aim of organizing data into a hierarchy of clusters. Many applications of hierarchical clustering involve sensitive user information, therefore motivating…

Data Structures and Algorithms · Computer Science 2025-04-23 Chengyuan Deng , Jie Gao , Jalaj Upadhyay , Chen Wang , Samson Zhou

Federated learning (FL) is a privacy-preserving collaborative learning framework, and differential privacy can be applied to further enhance its privacy protection. Existing FL systems typically adopt Federated Average (FedAvg) as the…

Machine Learning · Computer Science 2023-08-08 Lumin Liu , Jun Zhang , Shenghui Song , Khaled B. Letaief

We introduce the concurrent shuffle model of differential privacy. In this model we have multiple concurrent shufflers permuting messages from different, possibly overlapping, batches of users. Similarly to the standard (single) shuffle…

Machine Learning · Computer Science 2023-01-31 Jay Tenenbaum , Haim Kaplan , Yishay Mansour , Uri Stemmer

Differential privacy is a notion of privacy that has become very popular in the database community. Roughly, the idea is that a randomized query mechanism provides sufficient privacy protection if the ratio between the probabilities that…

Cryptography and Security · Computer Science 2014-06-18 Mário S. Alvim , Miguel E. Andrés , Konstantinos Chatzikokolakis , Pierpaolo Degano , Catuscia Palamidessi

Although federated learning improves privacy of training data by exchanging local gradients or parameters rather than raw data, the adversary still can leverage local gradients and parameters to obtain local training data by launching…

Machine Learning · Computer Science 2021-08-17 Xue Yang , Yan Feng , Weijun Fang , Jun Shao , Xiaohu Tang , Shu-Tao Xia , Rongxing Lu

The Differential Privacy (DP) literature often centers on meeting privacy constraints by introducing noise to the query, typically using a pre-specified parametric distribution model with one or two degrees of freedom. However, this…

Cryptography and Security · Computer Science 2024-09-30 Sachin Kadam , Anna Scaglione , Nikhil Ravi , Sean Peisert , Brent Lunghino , Aram Shumavon

As in traditional machine learning models, models trained with federated learning may exhibit disparate performance across demographic groups. Model holders must identify these disparities to mitigate undue harm to the groups. However,…

Machine Learning · Computer Science 2023-01-12 Marc Juarez , Aleksandra Korolova

Differential privacy (DP) techniques can be applied to the federated learning model to statistically guarantee data privacy against inference attacks to communication among the learning agents. While ensuring strong data privacy, however,…

Machine Learning · Computer Science 2022-02-22 Minseok Ryu , Kibaek Kim

In this paper, we study what price one has to pay to release {\em differentially private low-rank factorization} of a matrix. We consider various settings that are close to the real world applications of low-rank factorization: (i) the…

Data Structures and Algorithms · Computer Science 2018-04-19 Jalaj Upadhyay

Federated learning (FL) enables participating parties to collaboratively build a global model with boosted utility without disclosing private data information. Appropriate protection mechanisms have to be adopted to fulfill the requirements…

Machine Learning · Computer Science 2024-03-08 Xiaojin Zhang , Kai Chen , Qiang Yang