English
Related papers

Related papers: The Limits of Differential Privacy (and its Misuse…

200 papers

Privacy-preserving machine learning aims to train models on private data without leaking sensitive information. Differential privacy (DP) is considered the gold standard framework for privacy-preserving training, as it provides formal…

Differential Privacy (DP) is an important privacy-enhancing technology for private machine learning systems. It allows to measure and bound the risk associated with an individual participation in a computation. However, it was recently…

Machine Learning · Computer Science 2022-09-09 Cuong Tran , My H. Dinh , Ferdinando Fioretto

Differential privacy (DP) is the de facto notion of privacy both in theory and in practice. However, despite its popularity, DP imposes strict requirements which guard against strong worst-case scenarios. For example, it guards against…

Data Structures and Algorithms · Computer Science 2025-12-01 Guy Blanc , William Pires , Toniann Pitassi

Differential Privacy (DP) provides an elegant mathematical framework for defining a provable disclosure risk in the presence of arbitrary adversaries; it guarantees that whether an individual is in a database or not, the results of a DP…

Cryptography and Security · Computer Science 2021-08-19 Aleksandra Slavkovic , Roberto Molinari

Differential Privacy (DP) is often presented as a strong privacy-enhancing technology with broad applicability and advocated as a de-facto standard for releasing aggregate statistics on sensitive data. However, in many embodiments, DP…

Cryptography and Security · Computer Science 2024-02-13 Ari Biswas , Graham Cormode

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

Cryptography and Security · Computer Science 2025-05-02 Hao Du , Shang Liu , Yang Cao

Data-driven advancements significantly contribute to societal progress, yet they also pose substantial risks to privacy. In this landscape, differential privacy (DP) has become a cornerstone in privacy preservation efforts. However, the…

Cryptography and Security · Computer Science 2025-02-11 Sara Saeidian , Tobias J. Oechtering , Mikael Skoglund

ML models are ubiquitous in real world applications and are a constant focus of research. At the same time, the community has started to realize the importance of protecting the privacy of ML training data. Differential Privacy (DP) has…

Mobility data is essential for cities and communities to identify areas for necessary improvement. Data collected by mobility providers already contains all the information necessary, but privacy of the individuals needs to be preserved.…

Human-Computer Interaction · Computer Science 2023-06-23 Daniel Franzen , Saskia Nuñez von Voigt , Peter Sörries , Florian Tschorsch , Claudia Müller-Birn

Differential Privacy (DP) provides strong guarantees on the risk of compromising a user's data in statistical learning applications, though these strong protections make learning challenging and may be too stringent for some use cases. To…

Machine Learning · Computer Science 2019-12-10 Hilal Asi , John Duchi , Omid Javidbakht

Across academia, government, and industry, data stewards are facing increasing pressure to make datasets more openly accessible for researchers while also protecting the privacy of data subjects. Differential privacy (DP) is one promising…

Human-Computer Interaction · Computer Science 2023-02-24 Jayshree Sarathy , Sophia Song , Audrey Haque , Tania Schlatter , Salil Vadhan

Training machine learning models with differential privacy (DP) limits an adversary's ability to infer sensitive information about the training data. It can be interpreted as a bound on adversary's capability to distinguish two adjacent…

Cryptography and Security · Computer Science 2026-04-08 Gauri Pradhan , Joonas Jälkö , Santiago Zanella-Béguelin , Antti Honkela

Differential privacy, a notion of algorithmic stability, is a gold standard for measuring the additional risk an algorithm's output poses to the privacy of a single record in the dataset. Differential privacy is defined as the distance…

Machine Learning · Computer Science 2019-07-05 Kamalika Chaudhuri , Jacob Imola , Ashwin Machanavajjhala

Differential privacy (DP) provides formal guarantees that the output of a database query does not reveal too much information about any individual present in the database. While many differentially private algorithms have been proposed in…

Cryptography and Security · Computer Science 2019-11-27 Royce J Wilson , Celia Yuxin Zhang , William Lam , Damien Desfontaines , Daniel Simmons-Marengo , Bryant Gipson

High quality data is needed to unlock the full potential of AI for end users. However finding new sources of such data is getting harder: most publicly-available human generated data will soon have been used. Additionally, publicly…

This paper surveys recent work in the intersection of differential privacy (DP) and fairness. It reviews the conditions under which privacy and fairness may have aligned or contrasting goals, analyzes how and why DP may exacerbate bias and…

Machine Learning · Computer Science 2022-09-09 Ferdinando Fioretto , Cuong Tran , Pascal Van Hentenryck , Keyu Zhu

Federated learning (FL) has great potential for large-scale machine learning (ML) without exposing raw data.Differential privacy (DP) is the de facto standard of privacy protection with provable guarantees.Advances in ML suggest that DP…

Cryptography and Security · Computer Science 2024-10-24 Xuebin Ren , Shusen Yang , Cong Zhao , Julie McCann , Zongben Xu

Differential Privacy (DP) has become a gold standard in privacy-preserving data analysis. While it provides one of the most rigorous notions of privacy, there are many settings where its applicability is limited. Our main contribution is in…

Cryptography and Security · Computer Science 2021-10-20 Aman Bansal , Rahul Chunduru , Deepesh Data , Manoj Prabhakaran

Differential privacy (DP) is a compelling privacy definition that explains the privacy-utility tradeoff via formal, provable guarantees. Inspired by recent progress toward general-purpose data release algorithms, we propose a private…

Data Structures and Algorithms · Computer Science 2020-06-17 Benjamin Coleman , Anshumali Shrivastava

Differential privacy protects an individual's privacy by perturbing data on an aggregated level (DP) or individual level (LDP). We report four online human-subject experiments investigating the effects of using different approaches to…

Cryptography and Security · Computer Science 2020-04-01 Aiping Xiong , Tianhao Wang , Ninghui Li , Somesh Jha