English
Related papers

Related papers: Differentially Private Learning Needs Better Model…

200 papers

Self-distillation bootstraps large language models (LLMs) by training on their own generations. However, existing methods either rely on external signals to curate self-generated outputs (e.g., correctness filtering, execution feedback, and…

Computation and Language · Computer Science 2026-05-22 Guangya Hao , Yitong Shang , Yunbo Long , Zhuokai Zhao , Hanxue Liang

Protecting large language models from privacy leakage is becoming increasingly crucial with their wide adoption in real-world products. Yet applying differential privacy (DP), a canonical notion with provable privacy guarantees for machine…

Computation and Language · Computer Science 2022-10-28 Weiyan Shi , Ryan Shea , Si Chen , Chiyuan Zhang , Ruoxi Jia , Zhou Yu

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

Traditional data masking techniques such as anonymization cannot achieve the expected privacy protection while ensuring data utility for privacy-preserving machine learning. Synthetic data plays an increasingly important role as it…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Qiwei Ma , Jun Zhang

Deep neural networks often use large, high-quality datasets to achieve high performance on many machine learning tasks. When training involves potentially sensitive data, this process can raise privacy concerns, as large models have been…

Machine Learning · Computer Science 2025-06-23 Felix Zhou , Samson Zhou , Vahab Mirrokni , Alessandro Epasto , Vincent Cohen-Addad

Differentially private stochastic gradient descent (DPSGD) is a variation of stochastic gradient descent based on the Differential Privacy (DP) paradigm, which can mitigate privacy threats that arise from the presence of sensitive…

Machine Learning · Computer Science 2021-12-09 Ali Davody , David Ifeoluwa Adelani , Thomas Kleinbauer , Dietrich Klakow

Traditionally, the random noise is equally injected when training with different data instances in the field of differential privacy (DP). In this paper, we first give sharper excess risk bounds of DP stochastic gradient descent (SGD)…

Machine Learning · Computer Science 2023-01-31 Yilin Kang , Jian Li , Yong Liu , Weiping Wang

We consider training models with differential privacy (DP) using mini-batch gradients. The existing state-of-the-art, Differentially Private Stochastic Gradient Descent (DP-SGD), requires privacy amplification by sampling or shuffling to…

Cryptography and Security · Computer Science 2021-12-13 Peter Kairouz , Brendan McMahan , Shuang Song , Om Thakkar , Abhradeep Thakurta , Zheng Xu

In the social sciences, small- to medium-scale datasets are common, and linear regression is canonical. In privacy-aware settings, much work has focused on differentially private (DP) linear regression, but mostly on point estimation with…

Machine Learning · Computer Science 2026-03-31 Shurong Lin , Aleksandra Slavković , Deekshith Reddy Bhoomireddy

To protect sensitive data in training a Generative Adversarial Network (GAN), the standard approach is to use differentially private (DP) stochastic gradient descent method in which controlled noise is added to the gradients. The quality of…

Machine Learning · Computer Science 2022-10-28 Dongjie Chen , Sen-ching Samson Cheung , Chen-Nee Chuah , Sally Ozonoff

Differential privacy (DP) provides a provable framework for protecting individuals by customizing a random mechanism over a privacy-sensitive dataset. Deep learning models have demonstrated privacy risks in model exposure as an established…

Cryptography and Security · Computer Science 2025-08-06 Yu Zheng , Wenchao Zhang , Yonggang Zhang , Yuxiang Peng , Wei Song , Kai Zhou , Xiaojiang Du , Bo Han

We consider three different variants of differential privacy (DP), namely approximate DP, R\'enyi DP (RDP), and hypothesis test DP. In the first part, we develop a machinery for optimally relating approximate DP to RDP based on the joint…

Information Theory · Computer Science 2021-01-26 Shahab Asoodeh , Jiachun Liao , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

Federated learning (FL) enables the collaborative training of large-scale language models (LLMs) across edge devices while keeping user data on-device. However, FL still exposes sensitive information through client-provided gradients.…

Machine Learning · Computer Science 2026-05-12 Haaris Mehmood , Jie Xu , Karthikeyan Saravanan , Rogier Van Dalen , Mete Ozay

Deep learning models for speech rely on large datasets, presenting computational challenges. Yet, performance hinges on training data size. Dataset Distillation (DD) aims to learn a smaller dataset without much performance degradation when…

Differentially Private Federated Learning (DPFL) strengthens privacy protection by perturbing model gradients with noise, though at the cost of reduced accuracy. Although prior empirical studies indicate that initializing from pre-trained…

Machine Learning · Computer Science 2025-10-10 Huitong Jin , Yipeng Zhou , Quan Z. Sheng , Shiting Wen , Laizhong Cui

Differentially private stochastic gradient descent (DP-SGD) is the gold standard for training machine learning models with formal differential privacy guarantees. Several recent extensions improve its accuracy by introducing correlated…

Machine Learning · Computer Science 2026-05-13 Nikita P. Kalinin , Ryan McKenna , Rasmus Pagh , Christoph H. Lampert

Large language models (LLMs) frequently memorize sensitive or personal information, raising significant privacy concerns. Existing variants of differential privacy stochastic gradient descent (DPSGD) inject uniform noise into every gradient…

Machine Learning · Computer Science 2025-09-30 Manjiang Yu , Priyanka Singh , Xue Li , Yang Cao

Generative models trained on sensitive image datasets risk memorizing and reproducing individual training examples, making strong privacy guarantees essential. While differential privacy (DP) provides a principled framework for such…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Jasmine Bayrooti , Weiwei Kong , Natalia Ponomareva , Carlos Esteves , Ameesh Makadia , Amanda Prorok

Prompt privacy is crucial, especially when using online large language models (LLMs), due to the sensitive information often contained within prompts. While LLMs can enhance prompt privacy through text rewriting, existing methods primarily…

Computation and Language · Computer Science 2025-11-18 Mingchen Li , Heng Fan , Song Fu , Junhua Ding , Yunhe Feng

Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used to protect training data in machine learning. Its privacy guarantee is commonly analyzed through a security game in which an adversary infers whether a target record…

Cryptography and Security · Computer Science 2026-05-18 Wenhao Wang , Shujie Cui , Hui Cui , Xingliang Yuan