English
Related papers

Related papers: SoK: What Makes Private Learning Unfair?

200 papers

The rise of connected personal devices together with privacy concerns call for machine learning algorithms capable of leveraging the data of a large number of agents to learn personalized models under strong privacy requirements. In this…

Machine Learning · Computer Science 2018-02-20 Aurélien Bellet , Rachid Guerraoui , Mahsa Taziki , Marc Tommasi

Differential Privacy (DP) has emerged as a pivotal approach for safeguarding individual privacy in data analysis, yet its practical adoption is often hindered by challenges in the implementation and communication of DP. This paper presents…

Human-Computer Interaction · Computer Science 2025-07-03 Onyinye Dibia , Prianka Bhattacharjee , Brad Stenger , Steven Baldasty , Mako Bates , Ivoline C. Ngong , Yuanyuan Feng , Joseph P. Near

Differential privacy is often applied with a privacy parameter that is larger than the theory suggests is ideal; various informal justifications for tolerating large privacy parameters have been proposed. In this work, we consider partial…

Cryptography and Security · Computer Science 2022-09-12 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Thomas Steinke

We study the problem of multi-task learning under user-level differential privacy, in which $n$ users contribute data to $m$ tasks, each involving a subset of users. One important aspect of the problem, that can significantly impact…

Machine Learning · Computer Science 2023-02-17 Walid Krichene , Prateek Jain , Shuang Song , Mukund Sundararajan , Abhradeep Thakurta , Li Zhang

Predictive risk models in the public sector are commonly developed using administrative data that is more complete for subpopulations that more greatly rely on public services. In the United States, for instance, information on health care…

Machine Learning · Computer Science 2024-05-06 Nil-Jana Akpinar , Zachary C. Lipton , Alexandra Chouldechova

Historically, machine learning methods have not been designed with security in mind. In turn, this has given rise to adversarial examples, carefully perturbed input samples aimed to mislead detection at test time, which have been applied to…

Machine Learning · Computer Science 2022-01-11 Jamie Hayes

We theoretically study the impact of differential privacy on fairness in classification. We prove that, given a class of models, popular group fairness measures are pointwise Lipschitz-continuous with respect to the parameters of the model.…

Machine Learning · Computer Science 2023-09-19 Paul Mangold , Michaël Perrot , Aurélien Bellet , Marc Tommasi

Security, privacy, and fairness have become critical in the era of data science and machine learning. More and more we see that achieving universally secure, private, and fair systems is practically impossible. We have seen for example how…

Machine Learning · Statistics 2017-05-24 Jure Sokolic , Qiang Qiu , Miguel R. D. Rodrigues , Guillermo Sapiro

Differentially private (DP) synthetic data is a promising approach to maximizing the utility of data containing sensitive information. Due to the suppression of underrepresented classes that is often required to achieve privacy, however, it…

Machine Learning · Computer Science 2022-06-22 Blake Bullwinkel , Kristen Grabarz , Lily Ke , Scarlett Gong , Chris Tanner , Joshua Allen

This paper is a survey of recent work at the intersection of mechanism design and privacy. The connection is a natural one, but its study has been jump-started in recent years by the advent of differential privacy, which provides a…

Computer Science and Game Theory · Computer Science 2013-06-11 Mallesh Pai , Aaron Roth

The leakage of data might have been an extreme effect on the personal level if it contains sensitive information. Common prevention methods like encryption-decryption, endpoint protection, intrusion detection system are prone to leakage.…

Cryptography and Security · Computer Science 2020-06-12 Poushali Sengupta , Sudipta Paul , Subhankar Mishra

Using real-world study data usually requires contractual agreements where research results may only be published in anonymized form. Requiring formal privacy guarantees, such as differential privacy, could be helpful for data-driven…

Cryptography and Security · Computer Science 2024-07-08 Jonas Allmann , Saskia Nuñez von Voigt , Florian Tschorsch

In this work, we investigate binary classification under the constraints of both differential privacy and fairness. We first propose an algorithm based on the decoupling technique for learning a classifier with only fairness guarantee. This…

Machine Learning · Computer Science 2024-05-21 Hrad Ghoukasian , Shahab Asoodeh

Strict privacy is of paramount importance in distributed machine learning. Federated learning, with the main idea of communicating only what is needed for learning, has been recently introduced as a general approach for distributed learning…

Cryptography and Security · Computer Science 2020-07-14 Mikko A. Heikkilä , Antti Koskela , Kana Shimizu , Samuel Kaski , Antti Honkela

Differential privacy is a privacy measure based on the difficulty of discriminating between similar input data. In differential privacy analysis, similar data usually implies that their distance does not exceed a predetermined threshold.…

Optimization and Control · Mathematics 2021-06-25 Genki Sugiura , Kaito Ito , Kenji Kashima

Neural networks trained on real-world data often exhibit biases while simultaneously being vulnerable to privacy attacks aimed at extracting sensitive information. Despite extensive research on each problem individually, their intersection…

Machine Learning · Computer Science 2025-10-07 Chenxiang Zhang , Jun Pang , Sjouke Mauw

A critical concern in data-driven processes is to build models whose outcomes do not discriminate against some demographic groups, including gender, ethnicity, or age. To ensure non-discrimination in learning tasks, knowledge of the group…

Machine Learning · Computer Science 2022-04-12 Cuong Tran , Keyu Zhu , Ferdinando Fioretto , Pascal Van Hentenryck

The Private Aggregation of Teacher Ensembles (PATE) is an important private machine learning framework. It combines multiple learning models used as teachers for a student model that learns to predict an output chosen by noisy voting among…

Machine Learning · Computer Science 2021-09-20 Cuong Tran , My H. Dinh , Kyle Beiter , Ferdinando Fioretto

Differential privacy is a leading protection setting, focused by design on individual privacy. Many applications, in medical / pharmaceutical domains or social networks, rather posit privacy at a group level, a setting we call integral…

Machine Learning · Statistics 2019-07-04 Hisham Husain , Zac Cranko , Richard Nock

We study the privatization of distributed learning and optimization strategies. We focus on differential privacy schemes and study their effect on performance. We show that the popular additive random perturbation scheme degrades…

Machine Learning · Computer Science 2023-01-18 Elsa Rizk , Stefan Vlaski , Ali H. Sayed