English
Related papers

Related papers: Robustness Threats of Differential Privacy

200 papers

We consider the problem of secret protection, in which a business or organization wishes to train a model on their own data, while attempting to not leak secrets potentially contained in that data via the model. The standard method for…

Cryptography and Security · Computer Science 2025-06-03 Arun Ganesh , Brendan McMahan , Milad Nasr , Thomas Steinke , Abhradeep Thakurta

Differentially private (DP) machine learning allows us to train models on private data while limiting data leakage. DP formalizes this data leakage through a cryptographic game, where an adversary must predict if a model was trained on a…

Machine Learning · Computer Science 2021-01-13 Milad Nasr , Shuang Song , Abhradeep Thakurta , Nicolas Papernot , Nicholas Carlini

Differential privacy (DP) provides a provable framework for protecting individuals by customizing a random mechanism over a privacy-sensitive dataset. Deep learning models have demonstrated privacy risks in model exposure as an established…

Cryptography and Security · Computer Science 2025-08-06 Yu Zheng , Wenchao Zhang , Yonggang Zhang , Yuxiang Peng , Wei Song , Kai Zhou , Xiaojiang Du , Bo Han

Machine learning (ML) models trained on personal data have been shown to leak information about users. Differential privacy (DP) enables model training with a guaranteed bound on this leakage. Each new model trained with DP increases the…

Cryptography and Security · Computer Science 2021-06-30 Tao Luo , Mingen Pan , Pierre Tholoniat , Asaf Cidon , Roxana Geambasu , Mathias Lécuyer

Modern deep learning techniques focus on extracting intricate information from data to achieve accurate predictions. However, the training datasets may be crowdsourced and include sensitive information, such as personal contact details,…

Machine Learning · Statistics 2026-02-10 Zhongjie Shi , Puyu Wang , Chenyang Zhang , Yuan Cao

Machine learning (ML) algorithms rely primarily on the availability of training data, and, depending on the domain, these data may include sensitive information about the data providers, thus leading to significant privacy issues.…

Machine Learning · Computer Science 2024-05-24 Karima Makhlouf , Tamara Stefanovic , Heber H. Arcolezi , Catuscia Palamidessi

Differential privacy (DP) is the prevailing technique for protecting user data in machine learning models. However, deficits to this framework include a lack of clarity for selecting the privacy budget $\epsilon$ and a lack of…

Machine Learning · Computer Science 2023-06-29 Tyler LeBlond , Joseph Munoz , Fred Lu , Maya Fuchs , Elliott Zaresky-Williams , Edward Raff , Brian Testa

Artificial Intelligence (AI) models are vulnerable to information leakage of their training data, which can be highly sensitive, for example in medical imaging. Privacy Enhancing Technologies (PETs), such as Differential Privacy (DP), aim…

Differentially private stochastic gradient descent (DP-SGD) is the canonical approach to private deep learning. While the current privacy analysis of DP-SGD is known to be tight in some settings, several empirical results suggest that…

Machine Learning · Computer Science 2024-07-17 Anvith Thudi , Hengrui Jia , Casey Meehan , Ilia Shumailov , Nicolas Papernot

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

Deployment of deep learning in different fields and industries is growing day by day due to its performance, which relies on the availability of data and compute. Data is often crowd-sourced and contains sensitive information about its…

Machine Learning · Computer Science 2020-10-06 Tom Farrand , Fatemehsadat Mireshghallah , Sahib Singh , Andrew Trask

Training machine learning models with differential privacy (DP) limits an adversary's ability to infer sensitive information about the training data. It can be interpreted as a bound on adversary's capability to distinguish two adjacent…

Cryptography and Security · Computer Science 2026-04-08 Gauri Pradhan , Joonas Jälkö , Santiago Zanella-Béguelin , Antti Honkela

Graph neural network (GNN) is a powerful tool for analyzing graph-structured data. However, their vulnerability to adversarial attacks raises serious concerns, especially when dealing with sensitive information. Local Differential Privacy…

Machine Learning · Computer Science 2026-03-24 Matta Varun , Ajay Kumar Dhakar , Yuan Hong , Shamik Sural

Differentially private gradient descent (DP-GD) is a popular algorithm to train deep learning models with provable guarantees on the privacy of the training data. In the last decade, the problem of understanding its performance cost with…

Machine Learning · Statistics 2025-05-29 Simone Bombari , Marco Mondelli

Machine learning models should not reveal particular information that is not otherwise accessible. Differential privacy provides a formal framework to mitigate privacy risks by ensuring that the inclusion or exclusion of any single data…

Cryptography and Security · Computer Science 2026-03-12 Francisco Aguilera-Martínez , Fernando Berzal

Differential Privacy (DP) provides a formal framework for training machine learning models with individual example level privacy. In the field of deep learning, Differentially Private Stochastic Gradient Descent (DP-SGD) has emerged as a…

Machine Learning · Computer Science 2022-05-24 Harsh Mehta , Abhradeep Thakurta , Alexey Kurakin , Ashok Cutkosky

In federated learning collaborative learning takes place by a set of clients who each want to remain in control of how their local training data is used, in particular, how can each client's local training data remain private? Differential…

Machine Learning · Computer Science 2023-07-18 Marten van Dijk , Phuong Ha Nguyen

Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization of the training data…

Cryptography and Security · Computer Science 2020-05-27 Daniel Bernau , Philip-William Grassal , Jonas Robl , Florian Kerschbaum

Language modeling is a keystone task in natural language processing. When training a language model on sensitive information, differential privacy (DP) allows us to quantify the degree to which our private data is protected. However,…

Machine Learning · Computer Science 2020-10-27 Gavin Kerrigan , Dylan Slack , Jens Tuyls

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai
‹ Prev 1 3 4 5 6 7 10 Next ›