English
Related papers

Related papers: A survey on bias in machine learning research

200 papers

Fairness metrics are a core tool in the fair machine learning literature (FairML), used to determine that ML models are, in some sense, "fair". Real-world data, however, are typically plagued by various measurement biases and other violated…

Machine Learning · Computer Science 2024-10-16 Jake Fawkes , Nic Fishman , Mel Andrews , Zachary C. Lipton

Bias mitigation methods for binary classification decision-making systems have been widely researched due to the ever-growing importance of designing fair machine learning processes that are impartial and do not discriminate against…

Machine Learning · Computer Science 2023-06-01 Madeleine Waller , Odinaldo Rodrigues , Oana Cocarascu

The digitization of healthcare data coupled with advances in computational capabilities has propelled the adoption of machine learning (ML) in healthcare. However, these methods can perpetuate or even exacerbate existing disparities,…

Machine Learning · Computer Science 2024-02-02 Qizhang Feng , Mengnan Du , Na Zou , Xia Hu

Due to the recent cases of algorithmic bias in data-driven decision-making, machine learning methods are being put under the microscope in order to understand the root cause of these biases and how to correct them. Here, we consider a basic…

Machine Learning · Computer Science 2016-10-25 L. Elisa Celis , Amit Deshpande , Tarun Kathuria , Nisheeth K. Vishnoi

Fairness in machine learning (ML) has garnered significant attention. However, current research has mainly concentrated on the distributive fairness of ML models, with limited focus on another dimension of fairness, i.e., procedural…

Machine Learning · Computer Science 2026-02-27 Ziming Wang , Changwu Huang , Ke Tang , Xin Yao

Many machine learning systems make extensive use of large amounts of data regarding human behaviors. Several researchers have found various discriminatory practices related to the use of human-related machine learning systems, for example…

Machine Learning · Computer Science 2019-03-25 Elena Beretta , Antonio Santangelo , Bruno Lepri , Antonio Vetrò , Juan Carlos De Martin

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

Machine Learning · Computer Science 2024-08-30 Saish Shinde

Confounding variables are a well known source of nuisance in biomedical studies. They present an even greater challenge when we combine them with black-box machine learning techniques that operate on raw data. This work presents two case…

Generative AI technologies, particularly Large Language Models (LLMs), have transformed information management systems but introduced substantial biases that can compromise their effectiveness in informing business decision-making. This…

Computers and Society · Computer Science 2025-02-18 Xiahua Wei , Naveen Kumar , Han Zhang

This paper presents novel experiments shedding light on the shortcomings of current metrics for assessing biases of gender discrimination made by machine learning algorithms on textual data. We focus on the Bios dataset, and our learning…

Computation and Language · Computer Science 2023-06-09 Fanny Jourdan , Laurent Risser , Jean-Michel Loubes , Nicholas Asher

Machine learning models are routinely integrated into process mining pipelines to carry out tasks like data transformation, noise reduction, anomaly detection, classification, and prediction. Often, the design of such models is based on…

Machine Learning · Computer Science 2024-02-21 Paolo Ceravolo , Sylvio Barbon Junior , Ernesto Damiani , Wil van der Aalst

Datasets are rarely a realistic approximation of the target population. Say, prevalence is misrepresented, image quality is above clinical standards, etc. This mismatch is known as sampling bias. Sampling biases are a major hindrance for…

Background: Many published machine learning studies are irreproducible. Issues with methodology and not properly accounting for variation introduced by the algorithm themselves or their implementations are attributed as the main…

Machine Learning · Computer Science 2023-04-17 Odd Erik Gundersen , Kevin Coakley , Christine Kirkpatrick , Yolanda Gil

Due to the widespread use of data-powered systems in our everyday lives, the notions of bias and fairness gained significant attention among researchers and practitioners, in both industry and academia. Such issues typically emerge from the…

Information Retrieval · Computer Science 2021-10-27 Gianluca Demartini , Kevin Roitero , Stefano Mizzaro

Bias issues of neural networks garner significant attention along with its promising advancement. Among various bias issues, mitigating two predominant biases is crucial in advancing fair and trustworthy AI: (1) ensuring neural networks…

Machine Learning · Computer Science 2025-02-18 Jiazhi Li , Mahyar Khayatkhoei , Jiageng Zhu , Hanchen Xie , Mohamed E. Hussein , Wael AbdAlmageed

Prediction failures of machine learning models often arise from deficiencies in training data, such as incorrect labels, outliers, and selection biases. However, such data points that are responsible for a given failure mode are generally…

Machine Learning · Computer Science 2022-11-11 Ryutaro Tanno , Melanie F. Pradier , Aditya Nori , Yingzhen Li

Unintended biases in machine learning (ML) models are among the major concerns that must be addressed to maintain public trust in ML. In this paper, we address process fairness of ML models that consists in reducing the dependence of models…

Machine Learning · Computer Science 2021-08-06 Guilherme Alves , Maxime Amblard , Fabien Bernier , Miguel Couceiro , Amedeo Napoli

Nowadays, we delegate many of our decisions to Artificial Intelligence (AI) that acts either in solo or as a human companion in decisions made to support several sensitive domains, like healthcare, financial services and law enforcement. AI…

Artificial Intelligence · Computer Science 2025-12-15 Nicoleta Tantalaki , Athena Vakali

An increasing number of decisions regarding the daily lives of human beings are being controlled by artificial intelligence (AI) algorithms in spheres ranging from healthcare, transportation, and education to college admissions,…

Computers and Society · Computer Science 2020-01-28 Dana Pessach , Erez Shmueli

Fairness is a critical requirement for human-related, high-stakes software systems, motivating extensive research on bias mitigation. Prior work has largely focused on tabular data settings using traditional Machine Learning (ML) methods.…

Software Engineering · Computer Science 2026-04-15 Xinyue Li , Sixuan Li , Ying Xiao , Jie M. Zhang , Zhou Yang , Xuanzhe Liu , Zhenpeng Chen