English
Related papers

Related papers: Balance is key: Private median splits yield high-u…

200 papers

We present new mechanisms for \emph{label differential privacy}, a relaxation of differentially private machine learning that only protects the privacy of the labels in the training set. Our mechanisms cluster the examples in the training…

Machine Learning · Computer Science 2021-10-06 Hossein Esfandiari , Vahab Mirrokni , Umar Syed , Sergei Vassilvitskii

Data mining information about people is becoming increasingly important in the data-driven society of the 21st century. Unfortunately, sometimes there are real-world considerations that conflict with the goals of data mining; sometimes the…

Databases · Computer Science 2019-05-27 Sam Fletcher , Md Zahidul Islam

We demonstrate that it is possible to train large recurrent language models with user-level differential privacy guarantees with only a negligible cost in predictive accuracy. Our work builds on recent advances in the training of deep…

Machine Learning · Computer Science 2018-02-27 H. Brendan McMahan , Daniel Ramage , Kunal Talwar , Li Zhang

A decision tree is an easy-to-understand tool that has been widely used for classification tasks. On the one hand, due to privacy concerns, there has been an urgent need to create privacy-preserving classifiers that conceal the user's input…

Cryptography and Security · Computer Science 2025-05-06 Andrew Quijano , Spyros T. Halkidis , Kevin Gallagher , Kemal Akkaya , Nikolaos Samaras

The process of data mining with differential privacy produces results that are affected by two types of noise: sampling noise due to data collection and privacy noise that is designed to prevent the reconstruction of sensitive information.…

Machine Learning · Computer Science 2018-04-12 Yue Wang , Daniel Kifer , Jaewoo Lee

Analyzing structural properties of social networks, such as identifying their clusters or finding their most central nodes, has many applications. However, these applications are not supported by federated social networks that allow users…

Cryptography and Security · Computer Science 2021-05-20 Aashish Kolluri , Teodora Baluta , Prateek Saxena

Most existing Secure Multi-Party Computation (MPC) protocols for privacy-preserving training of decision trees over distributed data assume that the features are categorical. In real-life applications, features are often numerical. The…

There has been increasing demand for establishing privacy-preserving methodologies for modern statistics and machine learning. Differential privacy, a mathematical notion from computer science, is a rising tool offering robust privacy…

Methodology · Statistics 2024-05-09 Shurong Lin , Elliot Paquette , Eric D. Kolaczyk

Differentially private (DP) mechanisms have been deployed in a variety of high-impact social settings (perhaps most notably by the U.S. Census). Since all DP mechanisms involve adding noise to results of statistical queries, they are…

Cryptography and Security · Computer Science 2023-12-20 Lucas Rosenblatt , Julia Stoyanovich , Christopher Musco

Differentially private stochastic gradient descent privatizes model training by injecting noise into each iteration, where the noise magnitude increases with the number of model parameters. Recent works suggest that we can reduce the noise…

Machine Learning · Statistics 2025-07-25 Xin Gu , Gautam Kamath , Zhiwei Steven Wu

Differentially private data generation techniques have become a promising solution to the data privacy challenge -- it enables sharing of data while complying with rigorous privacy guarantees, which is essential for scientific progress in…

Cryptography and Security · Computer Science 2022-11-09 Dingfan Chen , Raouf Kerkouche , Mario Fritz

The simplest and most widely applied method for guaranteeing differential privacy is to add instance-independent noise to a statistic of interest that is scaled to its global sensitivity. However, global sensitivity is a worst-case notion…

Statistics Theory · Mathematics 2019-06-10 Mark Bun , Thomas Steinke

We study the problem of privacy-preserving machine learning (PPML) for ensemble methods, focusing our effort on random forests. In collaborative analysis, PPML attempts to solve the conflict between the need for data sharing and privacy.…

Machine Learning · Computer Science 2018-11-22 Irene Giacomelli , Somesh Jha , Ross Kleiman , David Page , Kyonghwan Yoon

Linear regression is an important tool across many fields that work with sensitive human-sourced data. Significant prior work has focused on producing differentially private point estimates, which provide a privacy guarantee to individuals…

Machine Learning · Computer Science 2019-10-30 Garrett Bernstein , Daniel Sheldon

To meet the standard of differential privacy, noise is usually added into the original data, which inevitably deteriorates the predicting performance of subsequent learning algorithms. In this paper, motivated by the success of improving…

Machine Learning · Computer Science 2019-06-04 Quanming Yao , Xiawei Guo , James T. Kwok , WeiWei Tu , Yuqiang Chen , Wenyuan Dai , Qiang Yang

Machine learning is increasingly becoming a powerful tool to make decisions in a wide variety of applications, such as medical diagnosis and autonomous driving. Privacy concerns related to the training data and unfair behaviors of some…

Cryptography and Security · Computer Science 2020-03-16 Jiahao Ding , Xinyue Zhang , Xiaohuan Li , Junyi Wang , Rong Yu , Miao Pan

Federated Learning has emerged as a privacy-oriented alternative to centralized Machine Learning, enabling collaborative model training without direct data sharing. While extensively studied for neural networks, the security and privacy…

Cryptography and Security · Computer Science 2025-07-15 Marco Di Gennaro , Giovanni De Lucia , Stefano Longari , Stefano Zanero , Michele Carminati

Federated clustering aims to group similar clients into clusters and produce one model for each cluster. Such a personalization approach typically improves model performance compared with training a single model to serve all clients, but…

Machine Learning · Computer Science 2025-08-11 Xiyuan Yang , Shengyuan Hu , Soyeon Kim , Tian Li

We investigate the problem of nodes clustering under privacy constraints when representing a dataset as a graph. Our contribution is threefold. First we formally define the concept of differential privacy for structured databases such as…

Cryptography and Security · Computer Science 2018-01-22 Rafael Pinot

Differential privacy is widely used in data analysis. State-of-the-art $k$-means clustering algorithms with differential privacy typically add an equal amount of noise to centroids for each iterative computation. In this paper, we propose a…

Cryptography and Security · Computer Science 2020-10-06 Tianjiao Ni , Minghao Qiao , Zhili Chen , Shun Zhang , Hong Zhong