English
Related papers

Related papers: Learning from Discriminatory Training Data

200 papers

There has been a growing concern about the fairness of decision-making systems based on machine learning. The shortage of labeled data has been always a challenging problem facing machine learning based systems. In such scenarios,…

Machine Learning · Computer Science 2020-01-01 Vahid Noroozi , Sara Bahaadini , Samira Sheikhi , Nooshin Mojab , Philip S. Yu

We observe standard transfer learning can improve prediction accuracies of target tasks at the cost of lowering their prediction fairness -- a phenomenon we named discriminatory transfer. We examine prediction fairness of a standard…

Computers and Society · Computer Science 2017-08-09 Chao Lan , Jun Huan

In this work, we propose data augmentation via pairwise mixup across subgroups to improve group fairness. Many real-world applications of machine learning systems exhibit biases across certain groups due to under-representation or training…

Machine Learning · Statistics 2023-09-14 Madeline Navarro , Camille Little , Genevera I. Allen , Santiago Segarra

We introduce a boosting algorithm to pre-process data for fairness. Starting from an initial fair but inaccurate distribution, our approach shifts towards better data fitting while still ensuring a minimal fairness guarantee. To do so, it…

Machine Learning · Statistics 2023-08-16 Alexander Soen , Hisham Husain , Richard Nock

Mitigating bias in automated decision-making systems, particularly in deep learning models, is a critical challenge due to nuanced definitions of fairness, dataset-specific biases, and the inherent trade-off between fairness and accuracy.…

Machine Learning · Computer Science 2025-10-22 Charmaine Barker , Daniel Bethell , Dimitar Kazakov

The use of algorithmic (learning-based) decision making in scenarios that affect human lives has motivated a number of recent studies to investigate such decision making systems for potential unfairness, such as discrimination against…

Machine Learning · Computer Science 2021-05-11 Junaid Ali , Muhammad Bilal Zafar , Adish Singla , Krishna P. Gummadi

Data-driven predictive solutions predominant in commercial applications tend to suffer from biases and stereotypes, which raises equity concerns. Prediction models may discover, use, or amplify spurious correlations based on gender or other…

Computation and Language · Computer Science 2022-11-28 Abdelrahman Zayed , Prasanna Parthasarathi , Goncalo Mordido , Hamid Palangi , Samira Shabanian , Sarath Chandar

This work addresses fair generative models. Dataset biases have been a major cause of unfairness in deep generative models. Previous work had proposed to augment large, biased datasets with small, unbiased reference datasets. Under this…

Machine Learning · Computer Science 2022-12-05 Christopher TH Teo , Milad Abdollahzadeh , Ngai-Man Cheung

Recent research has identified discriminatory behavior of automated prediction algorithms towards groups identified on specific protected attributes (e.g., gender, ethnicity, age group, etc.). When deployed in real-world scenarios, such…

Machine Learning · Computer Science 2023-12-20 Anubha Pandey , Aditi Rai , Maneet Singh , Deepak Bhatt , Tanmoy Bhowmik

Recently, there has been a growing interest in developing machine learning (ML) models that can promote fairness, i.e., eliminating biased predictions towards certain populations (e.g., individuals from a specific demographic group). Most…

Machine Learning · Computer Science 2023-08-29 Song Wang , Jing Ma , Lu Cheng , Jundong Li

As machine learning is increasingly used to make real-world decisions, recent research efforts aim to define and ensure fairness in algorithmic decision making. Existing methods often assume a fixed set of observable features to define…

Machine Learning · Computer Science 2020-05-11 YooJung Choi , Golnoosh Farnadi , Behrouz Babaki , Guy Van den Broeck

Knowledge Distillation is an effective method to transfer the learning across deep neural networks. Typically, the dataset originally used for training the Teacher model is chosen as the "Transfer Set" to conduct the knowledge transfer to…

Machine Learning · Computer Science 2020-11-19 Gaurav Kumar Nayak , Konda Reddy Mopuri , Anirban Chakraborty

Artificial Intelligence has the potential to exacerbate societal bias and set back decades of advances in equal rights and civil liberty. Data used to train machine learning algorithms may capture social injustices, inequality or…

Computers and Society · Computer Science 2020-08-18 Susan Leavy , Barry O'Sullivan , Eugenia Siapera

Data sets for fairness relevant tasks can lack examples or be biased according to a specific label in a sensitive attribute. We demonstrate the usefulness of weight based meta-learning approaches in such situations. For models that can be…

Machine Learning · Computer Science 2019-11-12 Dylan Slack , Sorelle Friedler , Emile Givental

Incremental learning enables artificial agents to learn from sequential data. While important progress was made by exploiting deep neural networks, incremental learning remains very challenging. This is particularly the case when no memory…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Habib Slim , Eden Belouadah , Adrian Popescu , Darian Onchis

Settings such as lending and policing can be modeled by a centralized agent allocating a resource (loans or police officers) amongst several groups, in order to maximize some objective (loans given that are repaid or criminals that are…

Machine Learning · Computer Science 2018-11-16 Hadi Elzayn , Shahin Jabbari , Christopher Jung , Michael Kearns , Seth Neel , Aaron Roth , Zachary Schutzman

Deep neural networks are efficient at learning the data distribution if it is sufficiently sampled. However, they can be strongly biased by non-relevant factors implicitly incorporated in the training data. These include operational biases,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Kirill Sirotkin , Pablo Carballeira , Marcos Escudero-Viñolo

The idealization of a static machine-learned model, trained once and deployed forever, is not practical. As input distributions change over time, the model will not only lose accuracy, any constraints to reduce bias against a protected…

Machine Learning · Computer Science 2022-06-15 Abdulaziz A. Almuzaini , Chidansh A. Bhatt , David M. Pennock , Vivek K. Singh

Predictive models learned from historical data are widely used to help companies and organizations make decisions. However, they may digitally unfairly treat unwanted groups, raising concerns about fairness and discrimination. In this…

Machine Learning · Computer Science 2018-03-07 Yongkai Wu , Lu Zhang , Xintao Wu

Machine learning models often make predictions based on biased features such as gender, race, and other social attributes, posing significant fairness risks, especially in societal applications, such as hiring, banking, and criminal…

Machine Learning · Computer Science 2024-08-28 Yi Zhang , Dongyuan Lu , Jitao Sang