English
Related papers

Related papers: DP-DCAN: Differentially Private Deep Contrastive A…

200 papers

Epidemic analyses increasingly rely on heterogeneous datasets, many of which are sensitive and require strong privacy protection. Although differential privacy (DP) has become a standard in machine learning and data sharing, its adoption in…

Deep learning with medical data often requires larger samples sizes than are available at single providers. While data sharing among institutions is desirable to train more accurate and sophisticated models, it can lead to severe privacy…

Machine Learning · Computer Science 2018-12-05 Brett K. Beaulieu-Jones , William Yuan , Samuel G. Finlayson , Zhiwei Steven Wu

Differential privacy (DP) is the de facto standard for training machine learning (ML) models, including neural networks, while ensuring the privacy of individual examples in the training set. Despite a rich literature on how to train ML…

Machine Learning · Computer Science 2022-02-10 Alexey Kurakin , Shuang Song , Steve Chien , Roxana Geambasu , Andreas Terzis , Abhradeep Thakurta

Training large neural networks with meaningful/usable differential privacy security guarantees is a demanding challenge. In this paper, we tackle this problem by revisiting the two key operations in Differentially Private Stochastic…

Machine Learning · Computer Science 2022-10-11 Hanshen Xiao , Jun Wan , Srinivas Devadas

Differentially private (DP) language model inference is an approach for generating private synthetic text. A sensitive input example is used to prompt an off-the-shelf large language model (LLM) to produce a similar example. Multiple…

Machine Learning · Computer Science 2025-06-06 Kareem Amin , Salman Avestimehr , Sara Babakniya , Alex Bie , Weiwei Kong , Natalia Ponomareva , Umar Syed

In this paper, we present a notion of differential privacy (DP) for data that comes from different classes. Here, the class-membership is private information that needs to be protected. The proposed method is an output perturbation…

Signal Processing · Electrical Eng. & Systems 2023-06-12 Raksha Ramakrishna , Anna Scaglione , Tong Wu , Nikhil Ravi , Sean Peisert

Training deep neural networks (DNNs) for meaningful differential privacy (DP) guarantees severely degrades model utility. In this paper, we demonstrate that the architecture of DNNs has a significant impact on model utility in the context…

Machine Learning · Computer Science 2021-10-20 Anda Cheng , Jiaxing Wang , Xi Sheryl Zhang , Qiang Chen , Peisong Wang , Jian Cheng

Differentially Private Stochastic Gradient Descent (DP-SGD) limits the amount of private information deep learning models can memorize during training. This is achieved by clipping and adding noise to the model's gradients, and thus…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Florian A. Hölzl , Daniel Rueckert , Georgios Kaissis

This paper introduces the first provably accurate algorithms for differentially private, top-down decision tree learning in the distributed setting (Balcan et al., 2012). We propose DP-TopDown, a general privacy preserving decision tree…

Machine Learning · Computer Science 2021-02-24 Kaiwen Wang , Travis Dick , Maria-Florina Balcan

Differentially private (DP) optimization is the standard paradigm to learn large neural networks that are accurate and privacy-preserving. The computational cost for DP deep learning, however, is notoriously heavy due to the per-sample…

Machine Learning · Computer Science 2023-09-20 Zhiqi Bu , Yu-Xiang Wang , Sheng Zha , George Karypis

Differential privacy (DP) is becoming increasingly important for deployed machine learning applications because it provides strong guarantees for protecting the privacy of individuals whose data is used to train models. However, DP…

Graph convolutional networks (GCNs) are a powerful architecture for representation learning on documents that naturally occur as graphs, e.g., citation or social networks. However, sensitive personal information, such as documents with…

Social and Information Networks · Computer Science 2022-05-03 Timour Igamberdiev , Ivan Habernal

In privacy-preserving machine learning, individual parties are reluctant to share their sensitive training data due to privacy concerns. Even the trained model parameters or prediction can pose serious privacy leakage. To address these…

Cryptography and Security · Computer Science 2020-09-04 Lingjuan Lyu , Yee Wei Law , Kee Siong Ng , Shibei Xue , Jun Zhao , Mengmeng Yang , Lei Liu

The surge in multimodal AI's success has sparked concerns over data privacy in vision-and-language tasks. While CLIP has revolutionized multimodal learning through joint training on images and text, its potential to unintentionally disclose…

Machine Learning · Computer Science 2024-03-04 Alyssa Huang , Peihan Liu , Ryumei Nakada , Linjun Zhang , Wanrong Zhang

Since its selection as the method of the year in 2013, single-cell technologies have become mature enough to provide answers to complex research questions. With the growth of single-cell profiling technologies, there has also been a…

Differential privacy (DP) techniques can be applied to the federated learning model to protect data privacy against inference attacks to communication among the learning agents. The DP techniques, however, hinder achieving a greater…

Machine Learning · Computer Science 2021-10-08 Minseok Ryu , Kibaek Kim

Differential privacy (DP) provides robust privacy guarantees for statistical inference, but this can lead to unreliable results and biases in downstream applications. While several noise-aware approaches have been proposed which integrate…

Machine Learning · Statistics 2026-05-29 Talal Alrawajfeh , Joonas Jälkö , Antti Honkela

Deep Learning has recently become hugely popular in machine learning, providing significant improvements in classification accuracy in the presence of highly-structured and large databases. Researchers have also considered privacy…

Cryptography and Security · Computer Science 2017-09-15 Briland Hitaj , Giuseppe Ateniese , Fernando Perez-Cruz

While the success of deep learning relies on large amounts of training datasets, data is often limited in privacy-sensitive domains. To address this challenge, generative model learning with differential privacy has emerged as a solution to…

Machine Learning · Computer Science 2024-08-28 Bochao Liu , Pengju Wang , Shiming Ge

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai