English
Related papers

Related papers: Why Does Differential Privacy with Large Epsilon D…

200 papers

Differential privacy (DP) is a key technique for protecting sensitive patient data in medical deep learning (DL). As clinical models grow more data-dependent, balancing privacy with utility and fairness has become a critical challenge. This…

Differential privacy quantifies privacy through the privacy budget $\epsilon$, yet its practical interpretation is complicated by variations across models and datasets. Recent research on differentially private machine learning and…

Machine Learning · Computer Science 2024-10-31 Yuechun Gu , Keke Chen

The integration of Differential Privacy (DP) with diffusion models (DMs) presents a promising yet challenging frontier, particularly due to the substantial memorization capabilities of DMs that pose significant privacy risks. Differential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yu-Lin Tsai , Yizhe Li , Zekai Chen , Po-Yu Chen , Chia-Mu Yu , Xuebin Ren , Francois Buet-Golfouse

Fine-tuning large language models (LLMs) for specific tasks introduces privacy risks, as models may inadvertently memorise and leak sensitive training data. While Differential Privacy (DP) offers a solution to mitigate these risks, it…

Machine Learning · Computer Science 2024-11-26 Olivia Ma , Jonathan Passerat-Palmbach , Dmitrii Usynin

The standard definition of differential privacy (DP) ensures that a mechanism's output distribution on adjacent datasets is indistinguishable. However, real-world implementations of DP can, and often do, reveal information through their…

Cryptography and Security · Computer Science 2024-11-26 Zachary Ratliff , Salil Vadhan

Differential privacy protects an individual's privacy by perturbing data on an aggregated level (DP) or individual level (LDP). We report four online human-subject experiments investigating the effects of using different approaches to…

Cryptography and Security · Computer Science 2020-04-01 Aiping Xiong , Tianhao Wang , Ninghui Li , Somesh Jha

Large Language Models (LLMs) have seen widespread adoption due to their remarkable natural language capabilities. However, when deploying them in real-world settings, it is important to align LLMs to generate texts according to acceptable…

Artificial Intelligence · Computer Science 2025-04-29 Qizhang Feng , Siva Rajesh Kasa , Santhosh Kumar Kasa , Hyokun Yun , Choon Hui Teo , Sravan Babu Bodapati

Composition is one of the most important properties of differential privacy (DP), as it allows algorithm designers to build complex private algorithms from DP primitives. We consider precise composition bounds of the overall privacy loss…

Cryptography and Security · Computer Science 2020-06-26 Jinshuo Dong , David Durfee , Ryan Rogers

In modern distributed computing applications, such as federated learning and AIoT systems, protecting privacy is crucial to prevent adversarial parties from colluding to steal others' private information. However, guaranteeing the utility…

Cryptography and Security · Computer Science 2023-06-01 Jiandong Liu , Lan Zhang , Chaojie Lv , Ting Yu , Nikolaos M. Freris , Xiang-Yang Li

The collection of individuals' data has become commonplace in many industries. Local differential privacy (LDP) offers a rigorous approach to preserving privacy whereby the individual privatises their data locally, allowing only their…

Machine Learning · Computer Science 2022-05-17 Alex Mansbridge , Gregory Barbour , Davide Piras , Michael Murray , Christopher Frye , Ilya Feige , David Barber

Differential Privacy (DP) is a well-established framework to quantify privacy loss incurred by any algorithm. Traditional DP formulations impose a uniform privacy requirement for all users, which is often inconsistent with real-world…

Cryptography and Security · Computer Science 2023-05-18 Syomantak Chaudhuri , Thomas A. Courtade

Membership inference attacks (MIAs) aim to infer whether a data point has been used to train a machine learning model. These attacks can be employed to identify potential privacy vulnerabilities and detect unauthorized use of personal data.…

Machine Learning · Computer Science 2023-10-03 Myeongseob Ko , Ming Jin , Chenguang Wang , Ruoxi Jia

Differential Privacy (DP) is a mathematical framework for releasing information with formal privacy guarantees. While numerous DP procedures have been developed for statistical analysis and machine learning, valid statistical inference…

Methodology · Statistics 2025-06-27 Ruyu Zhou , Fang Liu

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

Machine Learning · Computer Science 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

Generative Adversarial Networks (GANs) and diffusion models have emerged as leading approaches for high-quality image synthesis. While both can be trained under differential privacy (DP) to protect sensitive data, their sensitivity to…

Machine Learning · Computer Science 2025-09-04 Ilana Sebag , Jean-Yves Franceschi , Alain Rakotomamonjy , Alexandre Allauzen , Jamal Atif

There has been an explosion of research on differential privacy (DP) and its various applications in recent years, ranging from novel variants and accounting techniques in differential privacy to the thriving field of differentially private…

Cryptography and Security · Computer Science 2024-04-09 Saswat Das , Subhankar Mishra

We consider the problem of computing tight privacy guarantees for the composition of subsampled differentially private mechanisms. Recent algorithms can numerically compute the privacy parameters to arbitrary precision but must be carefully…

Cryptography and Security · Computer Science 2025-04-09 Christian Janos Lebeda , Matthew Regehr , Gautam Kamath , Thomas Steinke

This paper introduces a differentially private (DP) mechanism to protect the information exchanged during the coordination of sequential and interdependent markets. This coordination represents a classic Stackelberg game and relies on the…

Optimization and Control · Mathematics 2020-04-20 Ferdinando Fioretto , Lesia Mitridati , Pascal Van Hentenryck

Metric differential privacy (DP) provides heterogeneous privacy guarantees based on a distance between the pair of inputs. It is a widely popular notion of privacy since it captures the natural privacy semantics for many applications (such…

Cryptography and Security · Computer Science 2024-10-10 Jacob Imola , Amrita Roy Chowdhury , Kamalika Chaudhuri

Differential privacy (DP) is a popular mechanism for training machine learning models with bounded leakage about the presence of specific points in the training data. The cost of differential privacy is a reduction in the model's accuracy.…

Machine Learning · Computer Science 2019-10-29 Eugene Bagdasaryan , Vitaly Shmatikov