English
Related papers

Related papers: Bias in Machine Learning Software: Why? How? What …

200 papers

Fairness-aware machine learning has recently attracted various communities to mitigate discrimination against certain societal groups in data-driven tasks. For fair supervised learning, particularly in pre-processing, there have been two…

Machine Learning · Computer Science 2026-01-21 Jinwon Sohn , Guang Lin , Qifan Song

We tackle the problem of bias mitigation of algorithmic decisions in a setting where both the output of the algorithm and the sensitive variable are continuous. Most of prior work deals with discrete sensitive variables, meaning that the…

Machine learning models trained on real-world data may inadvertently make biased predictions that negatively impact marginalized communities. Reweighting, which assigns a weight to each data point used during model training, can mitigate…

Machine Learning · Computer Science 2026-03-20 Anil K. Saini , Jose Guadalupe Hernandez , Emily F. Wong , Debanshi Misra , Tiffani J. Bright , Jason H. Moore

Highly regulated domains such as finance have long favoured the use of machine learning algorithms that are scalable, transparent, robust and yield better performance. One of the most prominent examples of such an algorithm is XGBoost.…

Artificial Intelligence · Computer Science 2020-10-08 Srinivasan Ravichandran , Drona Khurana , Bharath Venkatesh , Narayanan Unny Edakunni

Credit scoring has been catalogued by the European Commission and the Executive Office of the US President as a high-risk classification task, a key concern being the potential harms of making loan approval decisions based on models that…

Machine Learning · Computer Science 2024-02-06 Pablo Casas , Christophe Mues , Huan Yu

Fairness studies of algorithmic decision-making systems often simplify complex decision processes, such as bail or loan approvals, into binary classification tasks. However, these approaches overlook that such decisions are not inherently…

Machine Learning · Computer Science 2025-11-13 Ayan Majumdar , Deborah D. Kanubala , Kavya Gupta , Isabel Valera

Traditional software fairness research typically emphasizes ethical and social imperatives, neglecting that fairness fundamentally represents a core software quality issue arising directly from performance disparities across sensitive user…

Software Engineering · Computer Science 2025-12-29 Ying Xiao , Shangwen Wang , Sicen Liu , Dingyuan Xue , Xian Zhan , Yepang Liu , Jie M. Zhang

Machine learning systems are increasingly being used to make impactful decisions such as loan applications and criminal justice risk assessments, and as such, ensuring fairness of these systems is critical. This is often challenging as the…

Machine Learning · Computer Science 2020-12-18 YooJung Choi , Meihua Dang , Guy Van den Broeck

A significant level of stigma and inequality exists in mental healthcare, especially in under-served populations. Inequalities are reflected in the data collected for scientific purposes. When not properly accounted for, machine learning…

Biases in existing datasets used to train algorithmic decision rules can raise ethical and economic concerns due to the resulting disparate treatment of different groups. We propose an algorithm for sequentially debiasing such datasets…

Machine Learning · Computer Science 2023-01-11 Yifan Yang , Yang Liu , Parinaz Naghizadeh

Machine learning applications are becoming increasingly pervasive in our society. Since these decision-making systems rely on data-driven learning, risk is that they will systematically spread the bias embedded in data. In this paper, we…

Machine Learning · Statistics 2023-02-09 Alessandro Castelnovo , Riccardo Crupi , Nicole Inverardi , Daniele Regoli , Andrea Cosentini

Computer vision systems have witnessed rapid progress over the past two decades due to multiple advances in the field. As these systems are increasingly being deployed in high-stakes real-world applications, there is a dire need to ensure…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Sepehr Dehdashtian , Ruozhen He , Yi Li , Guha Balakrishnan , Nuno Vasconcelos , Vicente Ordonez , Vishnu Naresh Boddeti

Machine learning models often make predictions based on biased features such as gender, race, and other social attributes, posing significant fairness risks, especially in societal applications, such as hiring, banking, and criminal…

Machine Learning · Computer Science 2024-08-28 Yi Zhang , Dongyuan Lu , Jitao Sang

Mitigating algorithmic bias is a critical task in the development and deployment of machine learning models. While several toolkits exist to aid machine learning practitioners in addressing fairness issues, little is known about the…

Human-Computer Interaction · Computer Science 2023-03-02 Zahra Ashktorab , Benjamin Hoover , Mayank Agarwal , Casey Dugan , Werner Geyer , Hao Bang Yang , Mikhail Yurochkin

This paper presents novel experiments shedding light on the shortcomings of current metrics for assessing biases of gender discrimination made by machine learning algorithms on textual data. We focus on the Bios dataset, and our learning…

Computation and Language · Computer Science 2023-06-09 Fanny Jourdan , Laurent Risser , Jean-Michel Loubes , Nicholas Asher

Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the…

Machine Learning · Statistics 2017-03-10 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

As algorithmic decision-making systems become more prevalent in society, ensuring the fairness of these systems is becoming increasingly important. Whilst there has been substantial research in building fair algorithmic decision-making…

Machine Learning · Computer Science 2023-10-30 Madeleine Waller , Odinaldo Rodrigues , Oana Cocarascu

In recent years the development of artificial intelligence (AI) systems for automated medical image analysis has gained enormous momentum. At the same time, a large body of work has shown that AI systems can systematically and unfairly…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 María Agustina Ricci Lara , Candelaria Mosquera , Enzo Ferrante , Rodrigo Echeveste

This paper strives to address image classifier bias, with a focus on both feature and label embedding spaces. Previous works have shown that spurious correlations from protected attributes, such as age, gender, or skin tone, can cause…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 William Thong , Cees G. M. Snoek

Algorithmic bias in medical imaging can perpetuate health disparities, yet its causes remain poorly understood in segmentation tasks. While fairness has been extensively studied in classification, segmentation remains underexplored despite…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Aditya Parikh , Sneha Das , Aasa Feragen