English
Related papers

Related papers: Differentially Private Decentralized Dataset Synth…

200 papers

As data-driven and AI-based decision making gains widespread adoption across disciplines, it is crucial that both data privacy and decision fairness are appropriately addressed. Although differential privacy (DP) provides a robust framework…

Machine Learning · Computer Science 2025-10-21 Spencer Giddens , Xiaon Lang , Fang Liu

Federated data sharing promises utility without centralizing raw data, yet existing embedding-level generators struggle under non-IID client heterogeneity and provide limited formal protection against gradient leakage. We propose…

Machine Learning · Computer Science 2026-01-05 Sunny Gupta , Amit Sethi

Differential privacy is widely employed in decentralized learning to safeguard sensitive data by introducing noise into model updates. However, existing approaches that use fixed-variance noise often degrade model performance and reduce…

Machine Learning · Computer Science 2025-10-24 Xiaoming Wu , Teng Liu , Xin Wang , Ming Yang , Jiguo Yu

Privacy concerns have attracted increasing attention in data-driven products due to the tendency of machine learning models to memorize sensitive training data. Generating synthetic versions of such data with a formal privacy guarantee,…

Computation and Language · Computer Science 2023-07-19 Xiang Yue , Huseyin A. Inan , Xuechen Li , Girish Kumar , Julia McAnallen , Hoda Shajari , Huan Sun , David Levitan , Robert Sim

Differentially private synthetic data provide a powerful mechanism to enable data analysis while protecting sensitive information about individuals. However, when the data lie in a high-dimensional space, the accuracy of the synthetic data…

Machine Learning · Computer Science 2024-12-12 Yiyun He , Thomas Strohmer , Roman Vershynin , Yizhe Zhu

Differentially private stochastic gradient descent (DP-SGD) enables private deep learning through per-example clipping and calibrated Gaussian noise, but its high-variance updates can reduce utility on challenging datasets. We propose…

Machine Learning · Computer Science 2026-05-21 Mohammad Partohaghighi , Roummel Marcia

When synthetic data is released, some individuals are harder to protect than others. A patient with a rare disease combination or a transaction with unusual characteristics stands out from the crowd. Differential privacy provides worst-case…

Machine Learning · Computer Science 2026-02-12 Amir Asiaee , Chao Yan , Zachary B. Abrams , Bradley A. Malin

Federated learning (FL) as one of the novel branches of distributed machine learning (ML), develops global models through a private procedure without direct access to local datasets. However, access to model updates (e.g. gradient updates…

Cryptography and Security · Computer Science 2024-01-08 Mahtab Talaei , Iman Izadi

Differentially private learning algorithms inject noise into the learning process. While the most common private learning algorithm, DP-SGD, adds independent Gaussian noise in each iteration, recent work on matrix factorization mechanisms…

Federated learning enables collaborative model training across distributed clients while preserving data privacy. However, in practical deployments, device heterogeneity, non-independent, and identically distributed (Non-IID) data often…

Artificial Intelligence · Computer Science 2026-02-20 Jin Wang , Hui Ma , Fei Xing , Ming Yan

Differential privacy (DP) is crucial for safeguarding sensitive client information in federated learning (FL), yet traditional DP-FL methods rely predominantly on fixed gradient clipping thresholds. Such static clipping neglects significant…

Cryptography and Security · Computer Science 2026-03-26 Hao Zhou , Siqi Cai , Hua Dai , Geng Yang , Jing Luo , Hui Cai

Deep learning-based language models have achieved state-of-the-art results in a number of applications including sentiment analysis, topic labelling, intent classification and others. Obtaining text representations or embeddings using these…

Computation and Language · Computer Science 2021-08-30 Richard Plant , Dimitra Gkatzia , Valerio Giuffrida

We consider a federated data analytics problem in which a server coordinates the collaborative data analysis of multiple users with privacy concerns and limited communication capability. The commonly adopted compression schemes introduce…

Cryptography and Security · Computer Science 2024-02-02 Richeng Jin , Zhonggen Su , Caijun Zhong , Zhaoyang Zhang , Tony Quek , Huaiyu Dai

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade

When it comes to preserving privacy in medical machine learning, two important considerations are (1) keeping data local to the institution and (2) avoiding inference of sensitive information from the trained model. These are often…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Dominik Fay , Jens Sjölund , Tobias J. Oechtering

Financial institutions face tension between maximizing data utility and mitigating the re-identification risks inherent in traditional anonymization methods. This paper explores Differentially Private (DP) synthetic data as a robust…

Computational Engineering, Finance, and Science · Computer Science 2026-04-17 Ifayoyinsola Ibikunle , Tyler Farnan , Senthil Kumar , Mayana Pereira

Differential Privacy (DP) provides a formal privacy guarantee preventing adversaries with access to a machine learning model from extracting information about individual training points. Differentially Private Stochastic Gradient Descent…

Machine Learning · Computer Science 2022-06-17 Soham De , Leonard Berrada , Jamie Hayes , Samuel L. Smith , Borja Balle

Privacy and communication efficiency are important challenges in federated training of neural networks, and combining them is still an open problem. In this work, we develop a method that unifies highly compressed communication and…

Machine Learning · Computer Science 2021-12-09 Aleksei Triastcyn , Matthias Reisser , Christos Louizos

Dataset condensation (DC) learns a compact synthetic dataset that enables models to match the performance of full-data training, prioritising utility over distributional fidelity. While typically explored for computational efficiency, DC…

Differentially private federated learning (DP-FL) is a promising technique for collaborative model training while ensuring provable privacy for clients. However, optimizing the tradeoff between privacy and accuracy remains a critical…

Machine Learning · Computer Science 2024-07-25 Shuya Feng , Meisam Mohammady , Hanbin Hong , Shenao Yan , Ashish Kundu , Binghui Wang , Yuan Hong