English
Related papers

Related papers: SoK: What Makes Private Learning Unfair?

200 papers

Differentially private learning on real-world data poses challenges for standard machine learning practice: privacy guarantees are difficult to interpret, hyperparameter tuning on private data reduces the privacy budget, and ad-hoc privacy…

Machine Learning · Statistics 2018-12-10 Koen Lennart van der Veen , Ruben Seggers , Peter Bloem , Giorgio Patrini

Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspired by recent advances in auditing which have been used for…

Machine Learning · Computer Science 2022-03-29 Florian Tramer , Andreas Terzis , Thomas Steinke , Shuang Song , Matthew Jagielski , Nicholas Carlini

Differential privacy is a widely adopted framework designed to safeguard the sensitive information of data providers within a data set. It is based on the application of controlled noise at the interface between the server that stores and…

Cryptography and Security · Computer Science 2024-05-06 Rūta Binkytė , Carlos Pinzón , Szilvia Lestyán , Kangsoo Jung , Héber H. Arcolezi , Catuscia Palamidessi

Since its introduction in 2006, differential privacy has emerged as a predominant statistical tool for quantifying data privacy in academic works. Yet despite the plethora of research and open-source utilities that have accompanied its…

Cryptography and Security · Computer Science 2022-11-09 Gonzalo Munilla Garrido , Xiaoyuan Liu , Florian Matthes , Dawn Song

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

Supervised learning models have been increasingly used for making decisions about individuals in applications such as hiring, lending, and college admission. These models may inherit pre-existing biases from training datasets and…

Machine Learning · Computer Science 2020-12-08 Mohammad Mahdi Khalili , Xueru Zhang , Mahed Abroshan , Somayeh Sojoudi

Differential privacy is a popular privacy-enhancing technology that has been deployed both in industry and government agencies. Unfortunately, existing explanations of differential privacy fail to set accurate privacy expectations for data…

Cryptography and Security · Computer Science 2025-09-29 Mary Anne Smart , Priyanka Nanayakkara , Rachel Cummings , Gabriel Kaptchuk , Elissa Redmiles

Differential privacy is a strong mathematical notion of privacy. Still, a prominent challenge when using differential privacy in real data collection is understanding and counteracting the accuracy loss that differential privacy imposes. As…

Cryptography and Security · Computer Science 2021-08-24 Boel Nelson

Federated learning has emerged as a powerful framework for analysing distributed data, yet two challenges remain pivotal: heterogeneity across sites and privacy of local data. In this paper, we address both challenges within a federated…

Machine Learning · Computer Science 2026-04-07 Mengchu Li , Ye Tian , Yang Feng , Yi Yu

While significant progress has been made in conventional fairness-aware machine learning (ML) and differentially private ML (DPML), the fairness of privacy protection across groups remains underexplored. Existing studies have proposed…

Machine Learning · Computer Science 2025-11-18 Zhi Yang , Changwu Huang , Ke Tang , Xin Yao

Machine learning techniques are increasingly used for high-stakes decision-making, such as college admissions, loan attribution or recidivism prediction. Thus, it is crucial to ensure that the models learnt can be audited or understood by…

Machine Learning · Computer Science 2023-12-29 Julien Ferry , Ulrich Aïvodji , Sébastien Gambs , Marie-José Huguet , Mohamed Siala

Data collected about individuals is regularly used to make decisions that impact those same individuals. We consider settings where sensitive personal data is used to decide who will receive resources or benefits. While it is well known…

Databases · Computer Science 2020-01-28 Satya Kuppam , Ryan Mckenna , David Pujol , Michael Hay , Ashwin Machanavajjhala , Gerome Miklau

Machine learning models in health care are often deployed in settings where it is important to protect patient privacy. In such settings, methods for differentially private (DP) learning provide a general-purpose approach to learn models…

Machine Learning · Computer Science 2020-10-15 Vinith M. Suriyakumar , Nicolas Papernot , Anna Goldenberg , Marzyeh Ghassemi

Federated learning (FL) as distributed machine learning has gained popularity as privacy-aware Machine Learning (ML) systems have emerged as a technique that prevents privacy leakage by building a global model and by conducting…

Cryptography and Security · Computer Science 2023-07-17 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae

Statistical agencies rely on sampling techniques to collect socio-demographic data crucial for policy-making and resource allocation. This paper shows that surveys of important societal relevance introduce sampling errors that unevenly…

Cryptography and Security · Computer Science 2025-01-22 Joonhyuk Ko , Juba Ziani , Saswat Das , Matt Williams , Ferdinando Fioretto

Federated learning (FL) is a distributed machine learning strategy that enables participants to collaborate and train a shared model without sharing their individual datasets. Privacy and fairness are crucial considerations in FL. While FL…

Machine Learning · Computer Science 2023-05-24 Ayush K. Varshney , Sonakshi Garg , Arka Ghosh , Sargam Gupta

Large language models (LLMs) trained on web-scale corpora can memorize sensitive training data, posing significant privacy risks. Differential privacy (DP) has emerged as a principled framework that limits the influence of individual data…

Computation and Language · Computer Science 2026-05-13 Eduardo Tenorio , Karuna Bhaila , Xintao Wu

Machine learning algorithms, when applied to sensitive data, pose a potential threat to privacy. A growing body of prior work has demonstrated that membership inference attack (MIA) can disclose specific private information in the training…

Cryptography and Security · Computer Science 2020-01-27 Bo Zhang , Ruotong Yu , Haipei Sun , Yanying Li , Jun Xu , Hui Wang

Privacy preserving in machine learning is a crucial issue in industry informatics since data used for training in industries usually contain sensitive information. Existing differentially private machine learning algorithms have not…

Machine Learning · Computer Science 2020-10-08 Tao Zhang , Tianqing Zhu , Ping Xiong , Huan Huo , Zahir Tari , Wanlei Zhou

In order to both learn and protect sensitive training data, there has been a growing interest in privacy preserving machine learning methods. Differential privacy has emerged as an important measure of privacy. We are interested in the…

Cryptography and Security · Computer Science 2025-02-11 Antoine Barczewski , Amal Mawass , Jan Ramon