English
Related papers

Related papers: Fair Learning with Private Demographic Data

200 papers

Fairness-aware learning involves designing algorithms that do not discriminate with respect to some sensitive feature (e.g., race or gender). Existing work on the problem operates under the assumption that the sensitive feature available in…

Machine Learning · Computer Science 2020-01-10 Alexandre Louis Lamy , Ziyuan Zhong , Aditya Krishna Menon , Nakul Verma

We show that participating in federated learning can be detrimental to group fairness. In fact, the bias of a few parties against under-represented groups (identified by sensitive attributes such as gender or race) can propagate through the…

Machine Learning · Computer Science 2023-09-06 Hongyan Chang , Reza Shokri

Supervised learning models have been increasingly used for making decisions about individuals in applications such as hiring, lending, and college admission. These models may inherit pre-existing biases from training datasets and…

Machine Learning · Computer Science 2020-12-08 Mohammad Mahdi Khalili , Xueru Zhang , Mahed Abroshan , Somayeh Sojoudi

In large-scale statistical learning, data collection and model fitting are moving increasingly toward peripheral devices---phones, watches, fitness trackers---away from centralized data collection. Concomitant with this rise in…

Machine Learning · Statistics 2019-06-04 Abhishek Bhowmick , John Duchi , Julien Freudiger , Gaurav Kapoor , Ryan Rogers

As machine learning is increasingly used to make real-world decisions, recent research efforts aim to define and ensure fairness in algorithmic decision making. Existing methods often assume a fixed set of observable features to define…

Machine Learning · Computer Science 2020-05-11 YooJung Choi , Golnoosh Farnadi , Behrouz Babaki , Guy Van den Broeck

When it is ethical and legal to use a sensitive attribute (such as gender or race) in machine learning systems, the question remains how to do so. We show that the naive application of machine learning algorithms using sensitive features…

Machine Learning · Computer Science 2017-07-21 Cynthia Dwork , Nicole Immorlica , Adam Tauman Kalai , Max Leiserson

Statistical methods protecting sensitive information or the identity of the data owner have become critical to ensure privacy of individuals as well as of organizations. This paper investigates anonymization methods based on representation…

Machine Learning · Statistics 2018-02-27 Clément Feutry , Pablo Piantanida , Yoshua Bengio , Pierre Duhamel

Fairness is becoming a rising concern w.r.t. machine learning model performance. Especially for sensitive fields such as criminal justice and loan decision, eliminating the prediction discrimination towards a certain group of population…

Machine Learning · Computer Science 2019-09-09 Xiaoqian Wang , Heng Huang

Strict privacy is of paramount importance in distributed machine learning. Federated learning, with the main idea of communicating only what is needed for learning, has been recently introduced as a general approach for distributed learning…

Cryptography and Security · Computer Science 2020-07-14 Mikko A. Heikkilä , Antti Koskela , Kana Shimizu , Samuel Kaski , Antti Honkela

Federated learning (FL) is a distributed machine learning strategy that enables participants to collaborate and train a shared model without sharing their individual datasets. Privacy and fairness are crucial considerations in FL. While FL…

Machine Learning · Computer Science 2023-05-24 Ayush K. Varshney , Sonakshi Garg , Arka Ghosh , Sargam Gupta

Existing regulations prohibit model developers from accessing protected attributes (gender, race, etc.), often resulting in fairness assessments on populations without knowing their protected groups. In such scenarios, institutions often…

Machine Learning · Computer Science 2023-06-07 Faisal Hamman , Jiahao Chen , Sanghamitra Dutta

Adversarial learning is a widely used technique in fair representation learning to remove the biases on sensitive attributes from data representations. It usually requires to incorporate the sensitive attribute labels as prediction targets.…

Machine Learning · Computer Science 2022-04-04 Chuhan Wu , Fangzhao Wu , Tao Qi , Yongfeng Huang

Fairness and privacy are two important concerns in social decision-making processes such as resource allocation. We study privacy in the fair allocation of indivisible resources using the well-established framework of differential privacy.…

Computer Science and Game Theory · Computer Science 2025-06-17 Pasin Manurangsi , Warut Suksompong

Fairness has become a central issue for our research community as classification algorithms are adopted in societally critical domains such as recidivism prediction and loan approval. In this work, we consider the potential bias based on…

Machine Learning · Computer Science 2019-05-01 Rui Feng , Yang Yang , Yuehan Lyu , Chenhao Tan , Yizhou Sun , Chunping Wang

Federated learning with differential privacy, or private federated learning, provides a strategy to train machine learning models while respecting users' privacy. However, differential privacy can disproportionately degrade the performance…

Machine Learning · Computer Science 2022-04-18 Borja Rodríguez-Gálvez , Filip Granqvist , Rogier van Dalen , Matt Seigel

Differential Privacy (DP) is an important privacy-enhancing technology for private machine learning systems. It allows to measure and bound the risk associated with an individual participation in a computation. However, it was recently…

Machine Learning · Computer Science 2022-09-09 Cuong Tran , My H. Dinh , Ferdinando Fioretto

In recent years, Local Differential Privacy (LDP), a robust privacy-preserving methodology, has gained widespread adoption in real-world applications. With LDP, users can perturb their data on their devices before sending it out for…

Machine Learning · Computer Science 2023-08-02 Héber H. Arcolezi , Karima Makhlouf , Catuscia Palamidessi

When applying differential privacy to sensitive data, we can often improve performance using external information such as other sensitive data, public data, or human priors. We propose to use the learning-augmented algorithms (or algorithms…

Cryptography and Security · Computer Science 2023-05-09 Mikhail Khodak , Kareem Amin , Travis Dick , Sergei Vassilvitskii

We study statistical risk minimization problems under a privacy model in which the data is kept confidential even from the learner. In this local privacy framework, we establish sharp upper and lower bounds on the convergence rates of…

Machine Learning · Statistics 2013-10-11 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

This paper introduces a novel approach to bolster algorithmic fairness in scenarios where sensitive information is only partially known. In particular, we propose to leverage instances with uncertain identity with regards to the sensitive…

Machine Learning · Computer Science 2024-06-28 Ainhize Barrainkua , Paula Gordaliza , Jose A. Lozano , Novi Quadrianto