English
Related papers

Related papers: Evaluating Fairness and Mitigating Bias in Machine…

200 papers

Addressing fairness in lesion classification from dermatological images is crucial due to variations in how skin diseases manifest across skin tones. However, the absence of skin tone labels in public datasets hinders building a fair…

Image and Video Processing · Electrical Eng. & Systems 2023-08-21 Thorsten Kalb , Kaisar Kushibar , Celia Cintas , Karim Lekadir , Oliver Diaz , Richard Osuala

Machine learning (ML) may be oblivious to human bias but it is not immune to its perpetuation. Marginalisation and iniquitous group representation are often traceable in the very data used for training, and may be reflected or even enhanced…

Machine Learning · Computer Science 2024-12-02 Stefano Sarao Mannelli , Federica Gerace , Negar Rostamzadeh , Luca Saglietti

Unintended biases in machine learning (ML) models are among the major concerns that must be addressed to maintain public trust in ML. In this paper, we address process fairness of ML models that consists in reducing the dependence of models…

Machine Learning · Computer Science 2021-08-06 Guilherme Alves , Maxime Amblard , Fabien Bernier , Miguel Couceiro , Amedeo Napoli

Fairness-aware learning aims to mitigate discrimination against specific protected social groups (e.g., those categorized by gender, ethnicity, age) while minimizing predictive performance loss. Despite efforts to improve fairness in…

Machine Learning · Computer Science 2025-05-02 Kewen Peng , Yicheng Yang , Hao Zhuo

Software bias is an increasingly important operational concern for software engineers. We present a large-scale, comprehensive empirical study of 17 representative bias mitigation methods for Machine Learning (ML) classifiers, evaluated…

Software Engineering · Computer Science 2023-02-13 Zhenpeng Chen , Jie M. Zhang , Federica Sarro , Mark Harman

Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly data-driven, relying on billion-sized datasets randomly…

This paper presents novel experiments shedding light on the shortcomings of current metrics for assessing biases of gender discrimination made by machine learning algorithms on textual data. We focus on the Bios dataset, and our learning…

Computation and Language · Computer Science 2023-06-09 Fanny Jourdan , Laurent Risser , Jean-Michel Loubes , Nicholas Asher

As machine learning (ML) algorithms are increasingly used in medical image analysis, concerns have emerged about their potential biases against certain social groups. Although many approaches have been proposed to ensure the fairness of ML…

Machine Learning · Computer Science 2025-10-13 Thai-Hoang Pham , Jiayuan Chen , Seungyeon Lee , Yuanlong Wang , Sayoko Moroi , Xueru Zhang , Ping Zhang

Machine learning (ML) is playing an increasing role in decision-making tasks that directly affect individuals, e.g., loan approvals, or job applicant screening. Significant concerns arise that, without special provisions, individuals from…

Machine Learning · Computer Science 2023-02-07 Sina Shaham , Gabriel Ghinita , Cyrus Shahabi

Machine learning algorithms are increasingly deployed in critical domains such as finance, healthcare, and criminal justice [1]. The increasing popularity of algorithmic decision-making has stimulated interest in algorithmic fairness within…

Machine Learning · Computer Science 2025-11-18 Animesh Joshi

The advent of AI and ML algorithms has led to opportunities as well as challenges. In this paper, we provide an overview of bias and fairness issues that arise with the use of ML algorithms. We describe the types and sources of data bias,…

Machine Learning · Statistics 2021-05-17 Nengfeng Zhou , Zach Zhang , Vijayan N. Nair , Harsh Singhal , Jie Chen , Agus Sudjianto

Deep learning models often inherit biases from their training data. While fairness across gender and ethnicity is well-studied, fine-grained skin tone analysis remains a challenge due to the lack of granular, annotated datasets. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Vitor Pereira Matias , Márcus Vinícius Lobo Costa , João Batista Neto , Tiago Novello de Brito

Deep neural networks (DNNs) are often prone to learn the spurious correlations between target classes and bias attributes, like gender and race, inherent in a major portion of training data (bias-aligned samples), thus showing unfair…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mei Wang , Weihong Deng , Jiani Hu , Sen Su

With growing applications of Machine Learning (ML) techniques in the real world, it is highly important to ensure that these models work in an equitable manner. One main step in ensuring fairness is to effectively measure fairness, and to…

Machine Learning · Computer Science 2024-06-21 Abdalwahab Almajed , Maryam Tabar , Peyman Najafirad

With the growing adoption of machine learning (ML) systems in areas like law enforcement, criminal justice, finance, hiring, and admissions, it is increasingly critical to guarantee the fairness of decisions assisted by ML. In this paper,…

Machine Learning · Computer Science 2024-05-17 Meiyu Zhong , Ravi Tandon

Data and algorithms have the potential to produce and perpetuate discrimination and disparate treatment. As such, significant effort has been invested in developing approaches to defining, detecting, and eliminating unfair outcomes in…

Machine Learning · Computer Science 2025-02-07 Alexander Asemota , Giles Hooker

Bias in machine learning has manifested injustice in several areas, such as medicine, hiring, and criminal justice. In response, computer scientists have developed myriad definitions of fairness to correct this bias in fielded algorithms.…

Computers and Society · Computer Science 2020-07-06 Debjani Saha , Candice Schumann , Duncan C. McElfresh , John P. Dickerson , Michelle L. Mazurek , Michael Carl Tschantz

With growing awareness of societal impact of artificial intelligence, fairness has become an important aspect of machine learning algorithms. The issue is that human biases towards certain groups of population, defined by sensitive features…

Machine Learning · Computer Science 2020-11-17 Andrija Petrović , Mladen Nikolić , Sandro Radovanović , Boris Delibašić , Miloš Jovanović

We consider training machine learning models that are fair in the sense that their performance is invariant under certain sensitive perturbations to the inputs. For example, the performance of a resume screening system should be invariant…

Machine Learning · Statistics 2020-03-16 Mikhail Yurochkin , Amanda Bower , Yuekai Sun

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu