English
Related papers

Related papers: Cocoon: A System Architecture for Differentially P…

200 papers

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

Broad adoption of machine learning techniques has increased privacy concerns for models trained on sensitive data such as medical records. Existing techniques for training differentially private (DP) models give rigorous privacy guarantees,…

Machine Learning · Statistics 2019-10-04 Zhengli Zhao , Nicolas Papernot , Sameer Singh , Neoklis Polyzotis , Augustus Odena

We introduce a locally differentially private (LDP) algorithm for online federated learning that employs temporally correlated noise to improve utility while preserving privacy. To address challenges posed by the correlated noise and local…

Machine Learning · Computer Science 2025-03-13 Jiaojiao Zhang , Linglingzhi Zhu , Dominik Fay , Mikael Johansson

Differential Privacy (DP) is a widely adopted technique, valued for its effectiveness in protecting the privacy of task-specific datasets, making it a critical tool for large language models. However, its effectiveness in Multimodal Large…

Cryptography and Security · Computer Science 2025-06-10 Qianshan Wei , Jiaqi Li , Zihan You , Yi Zhan , Kecen Li , Jialin Wu , Xinfeng Li Hengjun Liu , Yi Yu , Bin Cao , Yiwen Xu , Yang Liu , Guilin Qi

We study gradient descent under linearly correlated noise. Our work is motivated by recent practical methods for optimization with differential privacy (DP), such as DP-FTRL, which achieve strong performance in settings where privacy…

Machine Learning · Computer Science 2024-01-17 Anastasia Koloskova , Ryan McKenna , Zachary Charles , Keith Rush , Brendan McMahan

While preserving the privacy of federated learning (FL), differential privacy (DP) inevitably degrades the utility (i.e., accuracy) of FL due to model perturbations caused by DP noise added to model updates. Existing studies have considered…

Machine Learning · Computer Science 2023-03-09 Xin Yuan , Wei Ni , Ming Ding , Kang Wei , Jun Li , H. Vincent Poor

Machine learning (ML) models trained by differentially private stochastic gradient descent (DP-SGD) have much lower utility than the non-private ones. To mitigate this degradation, we propose a DP Laplacian smoothing SGD (DP-LSSGD) to train…

Machine Learning · Computer Science 2019-12-10 Bao Wang , Quanquan Gu , March Boedihardjo , Farzin Barekat , Stanley J. Osher

We present new mechanisms for \emph{label differential privacy}, a relaxation of differentially private machine learning that only protects the privacy of the labels in the training set. Our mechanisms cluster the examples in the training…

Machine Learning · Computer Science 2021-10-06 Hossein Esfandiari , Vahab Mirrokni , Umar Syed , Sergei Vassilvitskii

Quantum federated learning (QFL) enables collaborative training of quantum machine learning (QML) models across distributed quantum devices without raw data exchange. However, QFL remains vulnerable to adversarial attacks, where shared QML…

Quantum Physics · Physics 2025-08-29 Atit Pokharel , Ratun Rahman , Shaba Shaon , Thomas Morris , Dinh C. Nguyen

Differential privacy (DP) provides a provable framework for protecting individuals by customizing a random mechanism over a privacy-sensitive dataset. Deep learning models have demonstrated privacy risks in model exposure as an established…

Cryptography and Security · Computer Science 2025-08-06 Yu Zheng , Wenchao Zhang , Yonggang Zhang , Yuxiang Peng , Wei Song , Kai Zhou , Xiaojiang Du , Bo Han

Federated learning (FL) is increasingly deployed among multiple clients to train a shared model over decentralized data. To address privacy concerns, FL systems need to safeguard the clients' data from disclosure during training and control…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-13 Zhifeng Jiang , Wei Wang , Ruichuan Chen

Deep neural networks have strong capabilities of memorizing the underlying training data, which can be a serious privacy concern. An effective solution to this problem is to train models with differential privacy, which provides rigorous…

Machine Learning · Computer Science 2024-07-04 Ergute Bao , Yizheng Zhu , Xiaokui Xiao , Yin Yang , Beng Chin Ooi , Benjamin Hong Meng Tan , Khin Mi Mi Aung

Large language models (LLMs) frequently memorize sensitive or personal information, raising significant privacy concerns. Existing variants of differential privacy stochastic gradient descent (DPSGD) inject uniform noise into every gradient…

Machine Learning · Computer Science 2025-09-30 Manjiang Yu , Priyanka Singh , Xue Li , Yang Cao

Differential privacy (DP) is a gold-standard concept of measuring and guaranteeing privacy in data analysis. It is well-known that the cost of adding DP to deep learning model is its accuracy. However, it remains unclear how it affects…

Machine Learning · Computer Science 2021-08-26 Nurislam Tursynbek , Aleksandr Petiushko , Ivan Oseledets

Recent research shows that modern deep learning models achieve high predictive accuracy partly by memorizing individual training samples. Such memorization raises serious privacy concerns, motivating the widespread adoption of…

Machine Learning · Computer Science 2026-02-05 Jiaming Zhang , Huanyi Xie , Meng Ding , Shaopeng Fu , Jinyan Liu , Di Wang

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

To train sophisticated machine learning models one usually needs many training samples. Especially in healthcare settings these samples can be very expensive, meaning that one institution alone usually does not have enough on its own.…

Machine Learning · Computer Science 2020-12-07 Ali Burak Ünal , Mete Akgün , Nico Pfeifer

Secure multi-party computation-based machine learning, referred to as MPL, has become an important technology to utilize data from multiple parties with privacy preservation. While MPL provides rigorous security guarantees for the…

Cryptography and Security · Computer Science 2022-08-19 Wenqiang Ruan , Mingxin Xu , Wenjing Fang , Li Wang , Lei Wang , Weili Han

Differentially Private methods for training Deep Neural Networks (DNNs) have progressed recently, in particular with the use of massive batches and aggregated data augmentations for a large number of training steps. These techniques require…

Machine Learning · Computer Science 2023-05-25 Tom Sander , Pierre Stock , Alexandre Sablayrolles

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta