English
Related papers

Related papers: Accuracy, Interpretability, and Differential Priva…

200 papers

Large language models (LLMs) are increasingly integrated into real-time machine learning applications, where safeguarding user privacy is paramount. Traditional differential privacy mechanisms often struggle to balance privacy and accuracy,…

Cryptography and Security · Computer Science 2024-10-04 Jessica Smith , David Williams , Emily Brown

Differential privacy (DP) is applied when fine-tuning pre-trained large language models (LLMs) to limit leakage of training examples. While most DP research has focused on improving a model's privacy-utility tradeoff, some find that DP can…

Computation and Language · Computer Science 2024-10-25 Md. Khairul Islam , Andrew Wang , Tianhao Wang , Yangfeng Ji , Judy Fox , Jieyu Zhao

Differential Privacy (DP) is the de facto standard for reasoning about the privacy guarantees of a training algorithm. Despite the empirical observation that DP reduces the vulnerability of models to existing membership inference (MI)…

Machine Learning · Computer Science 2022-12-20 Anvith Thudi , Ilia Shumailov , Franziska Boenisch , Nicolas Papernot

Boosted ensemble of decision tree (DT) classifiers are extremely popular in international competitions, yet to our knowledge nothing is formally known on how to make them \textit{also} differential private (DP), up to the point that random…

Machine Learning · Computer Science 2020-02-05 Richard Nock , Wilko Henecka

The iterative nature of the expectation maximization (EM) algorithm presents a challenge for privacy-preserving estimation, as each iteration increases the amount of noise needed. We propose a practical private EM algorithm that overcomes…

Machine Learning · Computer Science 2016-11-01 Mijung Park , Jimmy Foulds , Kamalika Chaudhuri , Max Welling

Data privacy and eXplainable Artificial Intelligence (XAI) are two important aspects for modern Machine Learning systems. To enhance data privacy, recent machine learning models have been designed as a Federated Learning (FL) system. On top…

Machine Learning · Computer Science 2026-04-23 Júlio Oliveira , Rodrigo Ferreira , André Riker , Glaucio H. S. Carvalho , Eirini Eleni Tsilopoulou

The widespread adoption of complex machine learning models in high-stakes domains has brought the "black-box" problem to the forefront of responsible AI research. This paper aims at addressing this issue by improving the Explainable…

Machine Learning · Computer Science 2025-12-02 Isara Liyanage , Uthayasanker Thayasivam

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

Machine Learning · Computer Science 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot

Differential privacy provides strong privacy guarantees for machine learning applications. Much recent work has been focused on developing differentially private models, however there has been a gap in other stages of the machine learning…

Machine Learning · Computer Science 2021-09-07 Ashly Lau , Jonathan Passerat-Palmbach

There has been an explosion of research on differential privacy (DP) and its various applications in recent years, ranging from novel variants and accounting techniques in differential privacy to the thriving field of differentially private…

Cryptography and Security · Computer Science 2024-04-09 Saswat Das , Subhankar Mishra

Balancing differential privacy (DP) with recommendation accuracy is a key challenge in privacy-preserving recommender systems, since DP-noise degrades accuracy. We address this trade-off at both the data and model levels. At the data level,…

Information Retrieval · Computer Science 2026-05-13 Peter Müllner , Dominik Kowald , Markus Schedl , Elisabeth Lex

Estimating heterogeneous treatment effects in domains such as healthcare or social science often involves sensitive data where protecting privacy is important. We introduce a general meta-algorithm for estimating conditional average…

Machine Learning · Statistics 2022-02-23 Fengshi Niu , Harsha Nori , Brian Quistorff , Rich Caruana , Donald Ngwe , Aadharsh Kannan

Differential privacy (DP) techniques can be applied to the federated learning model to protect data privacy against inference attacks to communication among the learning agents. The DP techniques, however, hinder achieving a greater…

Machine Learning · Computer Science 2021-10-08 Minseok Ryu , Kibaek Kim

Differential privacy (DP) is the prevailing technique for protecting user data in machine learning models. However, deficits to this framework include a lack of clarity for selecting the privacy budget $\epsilon$ and a lack of…

Machine Learning · Computer Science 2023-06-29 Tyler LeBlond , Joseph Munoz , Fred Lu , Maya Fuchs , Elliott Zaresky-Williams , Edward Raff , Brian Testa

Differential Privacy (DP) is a widely adopted technique, valued for its effectiveness in protecting the privacy of task-specific datasets, making it a critical tool for large language models. However, its effectiveness in Multimodal Large…

Cryptography and Security · Computer Science 2025-06-10 Qianshan Wei , Jiaqi Li , Zihan You , Yi Zhan , Kecen Li , Jialin Wu , Xinfeng Li Hengjun Liu , Yi Yu , Bin Cao , Yiwen Xu , Yang Liu , Guilin Qi

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

Machine learning techniques based on neural networks are achieving remarkable results in a wide variety of domains. Often, the training of models requires large, representative datasets, which may be crowdsourced and contain sensitive…

Machine Learning · Statistics 2018-12-21 Martín Abadi , Andy Chu , Ian Goodfellow , H. Brendan McMahan , Ilya Mironov , Kunal Talwar , Li Zhang

The worldwide adoption of machine learning (ML) and deep learning models, particularly in critical sectors, such as healthcare and finance, presents substantial challenges in maintaining individual privacy and fairness. These two elements…

Machine Learning · Computer Science 2024-04-16 Mengmeng Yang , Ming Ding , Youyang Qu , Wei Ni , David Smith , Thierry Rakotoarivelo

Applying machine learning (ML) to sensitive domains requires privacy protection of the underlying training data through formal privacy frameworks, such as differential privacy (DP). Yet, usually, the privacy of the training data comes at…

Machine Learning · Computer Science 2022-11-09 Franziska Boenisch , Christopher Mühl , Roy Rinberg , Jannis Ihrig , Adam Dziedzic