English
Related papers

Related papers: User-Entity Differential Privacy in Learning Natur…

200 papers

Parameter estimation in statistics and system identification relies on data that may contain sensitive information. To protect this sensitive information, the notion of \emph{differential privacy} (DP) has been proposed, which enforces…

Optimization and Control · Mathematics 2022-11-21 Braghadeesh Lakshminarayanan , Cristian R. Rojas

Analyzing data owned by several parties while achieving a good trade-off between utility and privacy is a key challenge in federated learning and analytics. In this work, we introduce a novel relaxation of local differential privacy (LDP)…

Machine Learning · Computer Science 2022-03-08 Edwige Cyffers , Aurélien Bellet

We study model personalization under user-level differential privacy (DP) in the shared representation framework. In this problem, there are $n$ users whose data is statistically heterogeneous, and their optimal parameters share an unknown…

Machine Learning · Computer Science 2025-06-25 Conor Snedeker , Xinyu Zhou , Raef Bassily

Large language models (LLMs) are increasingly integrated into real-time machine learning applications, where safeguarding user privacy is paramount. Traditional differential privacy mechanisms often struggle to balance privacy and accuracy,…

Cryptography and Security · Computer Science 2024-10-04 Jessica Smith , David Williams , Emily Brown

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

Text data has become extremely valuable due to the emergence of machine learning algorithms that learn from it. A lot of high-quality text data generated in the real world is private and therefore cannot be shared or used freely due to…

Computation and Language · Computer Science 2024-07-25 Chulin Xie , Zinan Lin , Arturs Backurs , Sivakanth Gopi , Da Yu , Huseyin A Inan , Harsha Nori , Haotian Jiang , Huishuai Zhang , Yin Tat Lee , Bo Li , Sergey Yekhanin

How can agents exchange information to learn while protecting privacy? Healthcare centers collaborating on clinical trials must balance knowledge sharing with safeguarding sensitive patient data. We address this challenge by using…

Machine Learning · Computer Science 2025-03-19 Marios Papachristou , M. Amin Rahimian

Differential privacy (DP) is a formal notion that restricts the privacy leakage of an algorithm when running on sensitive data, in which privacy-utility trade-off is one of the central problems in private data analysis. In this work, we…

Machine Learning · Computer Science 2025-03-18 Bo Li , Wei Wang , Peng Ye

The deployment of Machine-Generated Text (MGT) detection systems necessitates processing sensitive user data, creating a fundamental conflict between authorship verification and privacy preservation. Standard anonymization techniques often…

Cryptography and Security · Computer Science 2026-01-09 Lionel Z. Wang , Yusheng Zhao , Jiabin Luo , Xinfeng Li , Lixu Wang , Yinan Peng , Haoyang Li , XiaoFeng Wang , Wei Dong

In the recent decades, the advance of information technology and abundant personal data facilitate the application of algorithmic personalized pricing. However, this leads to the growing concern of potential violation of privacy due to…

Machine Learning · Statistics 2021-09-13 Xi Chen , Sentao Miao , Yining Wang

Local Differential Privacy (LDP) provides provable privacy protection for data collection without the assumption of the trusted data server. In the real-world scenario, different data have different privacy requirements due to the distinct…

Cryptography and Security · Computer Science 2020-02-25 Xiaolan Gu , Ming Li , Li Xiong , Yang Cao

Protecting patient privacy in clinical narratives is essential for enabling secondary use of healthcare data under regulations such as GDPR and HIPAA. While manual de-identification remains the gold standard, it is costly and slow,…

Cryptography and Security · Computer Science 2026-04-24 Michele Miranda , Xinlan Yan , Nishant Mishra , Rachel Murphy , Ameen Abu-Hanna , Sébastien Bratières , Iacer Calixto

In-context learning (ICL) in Large Language Models (LLMs) has shown remarkable performance across various tasks without requiring fine-tuning. However, recent studies have highlighted the risk of private data leakage through the prompt in…

Artificial Intelligence · Computer Science 2025-09-16 Seongho Joo , Hyukhun Koh , Kyomin Jung

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

Cryptography and Security · Computer Science 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

This paper considers subject level privacy in the FL setting, where a subject is an individual whose private information is embodied by several data items either confined within a single federation user or distributed across multiple…

Machine Learning · Computer Science 2023-06-16 Virendra J. Marathe , Pallika Kanani , Daniel W. Peterson , Guy Steele

Fine-tuning large language models (LLMs) for specific tasks introduces privacy risks, as models may inadvertently memorise and leak sensitive training data. While Differential Privacy (DP) offers a solution to mitigate these risks, it…

Machine Learning · Computer Science 2024-11-26 Olivia Ma , Jonathan Passerat-Palmbach , Dmitrii Usynin

Large language models (LLMs) frequently memorize sensitive or personal information, raising significant privacy concerns. Existing variants of differential privacy stochastic gradient descent (DPSGD) inject uniform noise into every gradient…

Machine Learning · Computer Science 2025-09-30 Manjiang Yu , Priyanka Singh , Xue Li , Yang Cao

Density-adaptive domain discretization is essential for high-utility privacy-preserving analytics but remains challenging under Local Differential Privacy (LDP) due to the privacy-budget costs associated with iterative refinement. We…

Machine Learning · Computer Science 2026-02-24 Alexey Kroshnin , Alexandra Suvorikova

Large language models (LLMs) are commonly adapted to downstream tasks through fine-tuning, but fine-tuning data often contains sensitive information that may be leaked by the resulting model. Differential privacy (DP) offers formal…

Machine Learning · Computer Science 2026-05-19 Haichao Sha , Zihao Wang , Yuncheng Wu , Hong Chen , Wei Dong

Most deep learning frameworks require users to pool their local data or model updates to a trusted server to train or maintain a global model. The assumption of a trusted server who has access to user information is ill-suited in many…

Machine Learning · Computer Science 2020-06-26 Lingjuan Lyu , Yitong Li , Xuanli He , Tong Xiao