English
Related papers

Related papers: Fair Learning with Private Demographic Data

200 papers

Much of the previous machine learning (ML) fairness literature assumes that protected features such as race and sex are present in the dataset, and relies upon them to mitigate fairness concerns. However, in practice factors like privacy…

Machine Learning · Computer Science 2020-11-04 Preethi Lahoti , Alex Beutel , Jilin Chen , Kang Lee , Flavien Prost , Nithum Thain , Xuezhi Wang , Ed H. Chi

A private learner is trained on a sample of labeled points and generates a hypothesis that can be used for predicting the labels of newly sampled points while protecting the privacy of the training set [Kasiviswannathan et al., FOCS 2008].…

Machine Learning · Computer Science 2023-05-17 Moni Naor , Kobbi Nissim , Uri Stemmer , Chao Yan

Ensuring differential privacy of models learned from sensitive user data is an important goal that has been studied extensively in recent years. It is now known that for some basic learning problems, especially those involving…

Machine Learning · Computer Science 2018-05-10 Cynthia Dwork , Vitaly Feldman

Differential privacy has emerged as the most studied framework for privacy-preserving machine learning. However, recent studies show that enforcing differential privacy guarantees can not only significantly degrade the utility of the model,…

Machine Learning · Computer Science 2025-01-27 Kai Yao , Marc Juarez

Current approaches to group fairness in federated learning assume the existence of predefined and labeled sensitive groups during training. However, due to factors ranging from emerging regulations to dynamics and location-dependency of…

Machine Learning · Computer Science 2024-02-26 Afroditi Papadaki , Natalia Martinez , Martin Bertran , Guillermo Sapiro , Miguel Rodrigues

Federated Learning enables entities to collaboratively learn a shared prediction model while keeping their training data locally. It prevents data collection and aggregation and, therefore, mitigates the associated privacy risks. However,…

Cryptography and Security · Computer Science 2020-10-16 Raouf Kerkouche , Gergely Ács , Claude Castelluccia

Ensuring the privacy of sensitive data used to train modern machine learning models is of paramount importance in many areas of practice. One approach to study these concerns is through the lens of differential privacy. In this framework,…

Machine Learning · Computer Science 2020-03-03 Lichao Sun , Yingbo Zhou , Philip S. Yu , Caiming Xiong

Fair representation learning is an attractive approach that promises fairness of downstream predictors by encoding sensitive data. Unfortunately, recent work has shown that strong adversarial predictors can still exhibit unfairness by…

Machine Learning · Computer Science 2022-03-21 Mislav Balunović , Anian Ruoss , Martin Vechev

Federated learning becomes a prominent approach when different entities want to learn collaboratively a common model without sharing their training data. However, Federated learning has two main drawbacks. First, it is quite bandwidth…

Cryptography and Security · Computer Science 2021-03-02 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

The vast majority of techniques to train fair models require access to the protected attribute (e.g., race, gender), either at train time or in production. However, in many important applications this protected attribute is largely…

Machine Learning · Computer Science 2023-10-04 Hadi Elzayn , Emily Black , Patrick Vossler , Nathanael Jo , Jacob Goldin , Daniel E. Ho

Differentially Private (DP) data release is a promising technique to disseminate data without compromising the privacy of data subjects. However the majority of prior work has focused on scenarios where a single party owns all the data. In…

Cryptography and Security · Computer Science 2022-06-22 Ruihan Wu , Xin Yang , Yuanshun Yao , Jiankai Sun , Tianyi Liu , Kilian Q. Weinberger , Chong Wang

Deep learning's unprecedented success raises several ethical concerns ranging from biased predictions to data privacy. Researchers tackle these issues by introducing fairness metrics, or federated learning, or differential privacy. A first,…

Machine Learning · Computer Science 2021-08-24 Manisha Padala , Sankarshan Damle , Sujit Gujar

The scarcity of accessible, compliant, and ethically sourced data presents a considerable challenge to the adoption of artificial intelligence (AI) in sensitive fields like healthcare, finance, and biomedical research. Furthermore, access…

Machine Learning · Computer Science 2025-04-02 Kumar Kshitij Patel , Weitong Zhang , Lingxiao Wang

We consider the problem of fitting a linear model to data held by individuals who are concerned about their privacy. Incentivizing most players to truthfully report their data to the analyst constrains our design to mechanisms that provide…

Computer Science and Game Theory · Computer Science 2015-06-12 Rachel Cummings , Stratis Ioannidis , Katrina Ligett

A private machine learning algorithm hides as much as possible about its training data while still preserving accuracy. In this work, we study whether a non-private learning algorithm can be made private by relying on an instance-encoding…

Algorithms deployed in education can shape the learning experience and success of a student. It is therefore important to understand whether and how such algorithms might create inequalities or amplify existing biases. In this paper, we…

Computers and Society · Computer Science 2022-12-21 Jade Maï Cock , Muhammad Bilal , Richard Davis , Mirko Marras , Tanja Käser

Machine learning models are often personalized with information that is protected, sensitive, self-reported, or costly to acquire. These models use information about people but do not facilitate nor inform their consent. Individuals cannot…

Machine Learning · Computer Science 2023-10-13 Hailey Joren , Chirag Nagpal , Katherine Heller , Berk Ustun

Federated learning enables training a global machine learning model from data distributed across multiple sites, without having to move the data. This is particularly relevant in healthcare applications, where data is rife with personal,…

Cryptography and Security · Computer Science 2020-02-24 Olivia Choudhury , Aris Gkoulalas-Divanis , Theodoros Salonidis , Issa Sylla , Yoonyoung Park , Grace Hsu , Amar Das

People are rated and ranked, towards algorithmic decision making in an increasing number of applications, typically based on machine learning. Research on how to incorporate fairness into such tasks has prevalently pursued the paradigm of…

Machine Learning · Computer Science 2019-02-07 Preethi Lahoti , Krishna P. Gummadi , Gerhard Weikum

Allowing organizations to share their data for training of machine learning (ML) models without unintended information leakage is an open problem in practice. A promising technique for this still-open problem is to train models on the…