English
Related papers

Related papers: On Comparing Fair Classifiers under Data Bias

200 papers

It is widely accepted that biased data leads to biased and thus potentially unfair models. Therefore, several measures for bias in data and model predictions have been proposed, as well as bias mitigation techniques whose aim is to learn…

Machine Learning · Computer Science 2024-03-26 Marco Favier , Toon Calders , Sam Pinxteren , Jonathan Meyer

Undesirable biases encoded in the data are key drivers of algorithmic discrimination. Their importance is widely recognized in the algorithmic fairness literature, as well as legislation and standards on anti-discrimination in AI. Despite…

Machine Learning · Computer Science 2025-07-15 Marina Ceccon , Giandomenico Cornacchia , Davide Dalle Pezze , Alessandro Fabris , Gian Antonio Susto

Analysis of the fairness of machine learning (ML) algorithms recently attracted many researchers' interest. Most ML methods show bias toward protected groups, which limits the applicability of ML models in many applications like crime rate…

Machine Learning · Computer Science 2022-11-03 Haris Mansoor , Sarwan Ali , Shafiq Alam , Muhammad Asad Khan , Umair ul Hassan , Imdadullah Khan

Most fair regression algorithms mitigate bias towards sensitive sub populations and therefore improve fairness at group level. In this paper, we investigate the impact of such implementation of fair regression on the individual. More…

Machine Learning · Computer Science 2021-04-12 Boris Ruf , Marcin Detyniecki

Machine learning actively impacts our everyday life in almost all endeavors and domains such as healthcare, finance, and energy. As our dependence on the machine learning increases, it is inevitable that these algorithms will be used to…

Machine Learning · Computer Science 2021-02-23 Ankit Kulshrestha , Ilya Safro

With the proliferation of algorithmic decision-making, increased scrutiny has been placed on these systems. This paper explores the relationship between the quality of the training data and the overall fairness of the models trained with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Aki Barry , Lei Han , Gianluca Demartini

Fairness has been a critical issue that affects the adoption of deep learning models in real practice. To improve model fairness, many existing methods have been proposed and evaluated to be effective in their own contexts. However, there…

Machine Learning · Computer Science 2024-03-26 Junjie Yang , Jiajun Jiang , Zeyu Sun , Junjie Chen

Interpreting the inference-time behavior of deep neural networks remains a challenging problem. Existing approaches to counterfactual explanation typically ask: What is the closest alternative input that would alter the model's prediction…

Machine Learning · Computer Science 2026-02-12 Brian Hyeongseok Kim , Jacqueline L. Mitchell , Chao Wang

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

Artificial intelligence systems, especially those using machine learning, are being deployed in domains from hiring to loan issuance in order to automate these complex decisions. Judging both the effectiveness and fairness of these AI…

Artificial Intelligence · Computer Science 2025-07-04 Disa Sariola , Patrick Button , Aron Culotta , Nicholas Mattei

Fairness in machine learning has received considerable attention. However, most studies on fair learning focus on either supervised learning or unsupervised learning. Very few consider semi-supervised settings. Yet, in reality, most machine…

Machine Learning · Computer Science 2020-09-15 Tao Zhang , Tianqing Zhu , Mengde Han , Jing Li , Wanlei Zhou , Philip S. Yu

The rapid developments of various machine learning models and their deployments in several applications has led to discussions around the importance of looking beyond the accuracies of these models. Fairness of such models is one such…

Machine Learning · Computer Science 2024-04-16 Biswajit Rout , Ananya B. Sai , Arun Rajkumar

We investigate the prominent class of fair representation learning methods for bias mitigation. Using causal reasoning to define and formalise different sources of dataset bias, we reveal important implicit assumptions inherent to these…

Machine Learning · Computer Science 2025-02-11 Charles Jones , Fabio de Sousa Ribeiro , Mélanie Roschewitz , Daniel C. Castro , Ben Glocker

A trade-off between accuracy and fairness is almost taken as a given in the existing literature on fairness in machine learning. Yet, it is not preordained that accuracy should decrease with increased fairness. Novel to this work, we…

Machine Learning · Statistics 2020-12-14 Sanghamitra Dutta , Dennis Wei , Hazar Yueksel , Pin-Yu Chen , Sijia Liu , Kush R. Varshney

The label bias and selection bias are acknowledged as two reasons in data that will hinder the fairness of machine-learning outcomes. The label bias occurs when the labeling decision is disturbed by sensitive features, while the selection…

Machine Learning · Computer Science 2021-07-08 Yixuan Zhang , Feng Zhou , Zhidong Li , Yang Wang , Fang Chen

In this paper, we propose an innovative approach to thoroughly explore dataset features that introduce bias in downstream machine-learning tasks. Depending on the data format, we use different techniques to map instances into a similarity…

Machine Learning · Computer Science 2024-11-11 Samira Maghool , Paolo Ceravolo

Fair classification aims to stress the classification models to achieve the equality (treatment or prediction quality) among different sensitive groups. However, fair classification can be under the risk of poisoning attacks that…

Machine Learning · Computer Science 2022-10-19 Han Xu , Xiaorui Liu , Yuxuan Wan , Jiliang Tang

Applications that deal with sensitive information may have restrictions placed on the data available to a machine learning (ML) classifier. For example, in some applications, a classifier may not have direct access to sensitive attributes,…

Machine Learning · Computer Science 2024-03-13 Zachary McBride Lazri , Danial Dervovic , Antigoni Polychroniadou , Ivan Brugere , Dana Dachman-Soled , Min Wu

We study the impact of pre and post processing for reducing discrimination in data-driven decision makers. We first analyze the fundamental trade-off between fairness and accuracy in a pre-processing approach, and propose a design for a…

Machine Learning · Computer Science 2021-02-04 Sajad Khodadadian , AmirEmad Ghassami , Negar Kiyavash

Removing bias while keeping all task-relevant information is challenging for fair representation learning methods since they would yield random or degenerate representations w.r.t. labels when the sensitive attributes correlate with labels.…

Machine Learning · Computer Science 2022-08-02 Yixuan Zhang , Feng Zhou , Zhidong Li , Yang Wang , Fang Chen