English
Related papers

Related papers: Fair Learning with Private Demographic Data

200 papers

Federated Learning (FL) is a novel privacy-protection distributed machine learning paradigm that guarantees user privacy and prevents the risk of data leakage due to the advantage of the client's local training. Researchers have struggled…

Machine Learning · Computer Science 2023-12-01 Kangkang Sun , Xiaojin Zhang , Xi Lin , Gaolei Li , Jing Wang , Jianhua Li

The protection of sensitive data becomes more vital, as data increases in value and potency. Furthermore, the pressure increases from regulators and society on model developers to make their Artificial Intelligence (AI) models…

Machine Learning · Computer Science 2026-05-12 Florian van der Steen , Fré Vink , Heysem Kaya

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

This work examines how to train fair classifiers in settings where training labels are corrupted with random noise, and where the error rates of corruption depend both on the label class and on the membership function for a protected…

Machine Learning · Computer Science 2021-02-18 Jialu Wang , Yang Liu , Caleb Levy

Data privacy is an increasingly important aspect of many real-world Data sources that contain sensitive information may have immense potential which could be unlocked using the right privacy enhancing transformations, but current methods…

Machine Learning · Computer Science 2021-02-09 John Martinsson , Edvin Listo Zec , Daniel Gillblad , Olof Mogren

The performance of machine learning algorithms can be considerably improved when trained over larger datasets. In many domains, such as medicine and finance, larger datasets can be obtained if several parties, each having access to limited…

Machine Learning · Computer Science 2021-09-30 Dana Pessach , Tamir Tassa , Erez Shmueli

The objective of machine learning is to extract useful information from data, while privacy is preserved by concealing information. Thus it seems hard to reconcile these competing interests. However, they frequently must be balanced when…

Machine Learning · Computer Science 2014-12-25 Zhanglong Ji , Zachary C. Lipton , Charles Elkan

Differentially private data generation techniques have become a promising solution to the data privacy challenge -- it enables sharing of data while complying with rigorous privacy guarantees, which is essential for scientific progress in…

Cryptography and Security · Computer Science 2022-11-09 Dingfan Chen , Raouf Kerkouche , Mario Fritz

Fairness concerns about algorithmic decision-making systems have been mainly focused on the outputs (e.g., the accuracy of a classifier across individuals or groups). However, one may additionally be concerned with fairness in the inputs.…

Machine Learning · Computer Science 2020-05-26 Bashir Rastegarpanah , Mark Crovella , Krishna P. Gummadi

Training data privacy has been a top concern in AI modeling. While methods like differentiated private learning allow data contributors to quantify acceptable privacy loss, model utility is often significantly damaged. In practice,…

Machine Learning · Computer Science 2024-10-31 Yuechun Gu , Jiajie He , Keke Chen

Private data analysis suffers a costly curse of dimensionality. However, the data often has an underlying low-dimensional structure. For example, when optimizing via gradient descent, the gradients often lie in or near a low-dimensional…

Cryptography and Security · Computer Science 2021-08-12 Vikrant Singhal , Thomas Steinke

Machine learning is increasingly used in the most diverse applications and domains, whether in healthcare, to predict pathologies, or in the financial sector to detect fraud. One of the linchpins for efficiency and accuracy in machine…

Machine Learning · Computer Science 2022-01-17 Tânia Carvalho , Nuno Moniz , Pedro Faria , Luís Antunes

In critical machine learning applications, ensuring fairness is essential to avoid perpetuating social inequities. In this work, we address the challenges of reducing bias and improving accuracy in data-scarce environments, where the cost…

Machine Learning · Computer Science 2023-12-15 Romain Camilleri , Andrew Wagenmaker , Jamie Morgenstern , Lalit Jain , Kevin Jamieson

Machine learning systems are notoriously prone to biased predictions about certain demographic groups, leading to algorithmic fairness issues. Due to privacy concerns and data quality problems, some demographic information may not be…

Machine Learning · Computer Science 2024-12-31 Yingtao Luo , Zhixun Li , Qiang Liu , Jun Zhu

Machine learning models are often trained on sensitive data (e.g., medical records and race/gender) that is distributed across different "silos" (e.g., hospitals). These federated learning models may then be used to make consequential…

Machine Learning · Computer Science 2024-11-13 Devansh Gupta , A. S. Poornash , Andrew Lowy , Meisam Razaviyayn

Ensuring the privacy of sensitive data used to train modern machine learning models is of paramount importance in many areas of practice. One recent popular approach to study these concerns is using the differential privacy via a…

Cryptography and Security · Computer Science 2020-07-29 Lichao Sun , Ji Wang , Philip S. Yu , Lifang He

Modern machine learning (ML) models are becoming increasingly popular and are widely used in decision-making systems. However, studies have shown critical issues of ML discrimination and unfairness, which hinder their adoption on high-stake…

Machine Learning · Computer Science 2023-06-01 Yueqing Liang , Canyu Chen , Tian Tian , Kai Shu

An important use of private data is to build machine learning classifiers. While there is a burgeoning literature on differentially private classification algorithms, we find that they are not practical in real applications due to two…

Machine Learning · Computer Science 2014-11-24 Ben Stoddard , Yan Chen , Ashwin Machanavajjhala

Bias-transforming methods of fairness-aware machine learning aim to correct a non-neutral status quo with respect to a protected attribute (PA). Current methods, however, lack an explicit formulation of what drives non-neutrality. We…

Machine Learning · Computer Science 2025-02-04 Ludwig Bothmann , Philip A. Boustani , Jose M. Alvarez , Giuseppe Casalicchio , Bernd Bischl , Susanne Dandl

The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within. A biased model can then make decisions that disproportionately harm certain groups in society. Much…

Machine Learning · Computer Science 2022-06-28 José Pombal , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro