English
Related papers

Related papers: Evaluating Fairness and Mitigating Bias in Machine…

200 papers

Machine learning (ML) models often exhibit bias that can exacerbate inequities in biomedical applications. Fairness auditing, the process of evaluating a model's performance across subpopulations, is critical for identifying and mitigating…

Methodology · Statistics 2026-05-19 Jianhui Gao , Jessica Gronsbell

Despite being responsible for state-of-the-art results in several computer vision and natural language processing tasks, neural networks have faced harsh criticism due to some of their current shortcomings. One of them is that neural…

The issue of fairness in machine learning stems from the fact that historical data often displays biases against specific groups of people which have been underprivileged in the recent past, or still are. In this context, one of the…

Machine Learning · Computer Science 2022-01-19 Mattia Cerrato , Marius Köppel , Alexander Segner , Stefan Kramer

Computer vision systems have witnessed rapid progress over the past two decades due to multiple advances in the field. As these systems are increasingly being deployed in high-stakes real-world applications, there is a dire need to ensure…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Sepehr Dehdashtian , Ruozhen He , Yi Li , Guha Balakrishnan , Nuno Vasconcelos , Vicente Ordonez , Vishnu Naresh Boddeti

Artificial intelligence (AI) has shown remarkable promise in dermatology, offering accurate and non-invasive diagnosis of skin cancer. While extensive research has addressed skin tone-related bias, gender bias in dermatologic AI remains…

Image and Video Processing · Electrical Eng. & Systems 2025-12-01 Mingcheng Zhu , Mingxuan Liu , Han Yuan , Yilin Ning , Zhiyao Luo , Tingting Zhu , Nan Liu

Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities, but their susceptibility to biases poses significant risks, since biases may negatively impact generalization performance. In this…

Machine Learning · Computer Science 2025-04-29 Haroui Ma , Francesco Quinzan , Theresa Willem , Stefan Bauer

Fairness is a fundamental requirement for trustworthy and human-centered Artificial Intelligence (AI) system. However, deep neural networks (DNNs) tend to make unfair predictions when the training data are collected from different…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Ruichen Yao , Ziteng Cui , Xiaoxiao Li , Lin Gu

This survey article assesses and compares existing critiques of current fairness-enhancing technical interventions into machine learning (ML) that draw from a range of non-computing disciplines, including philosophy, feminist studies,…

Machine Learning · Computer Science 2022-05-11 Lindsay Weinberg

The rise of machine learning (ML) is accompanied by several high-profile cases that have stressed the need for fairness, accountability, explainability and trust in ML systems. The existing literature has largely focused on fully automated…

Computers and Society · Computer Science 2023-06-14 Bhavya Ghai

Fairness-aware learning involves designing algorithms that do not discriminate with respect to some sensitive feature (e.g., race or gender). Existing work on the problem operates under the assumption that the sensitive feature available in…

Machine Learning · Computer Science 2020-01-10 Alexandre Louis Lamy , Ziyuan Zhong , Aditya Krishna Menon , Nakul Verma

While deep learning (DL) approaches are reaching human-level performance for many tasks, including for diagnostics AI, the focus is now on challenges possibly affecting DL deployment, including AI privacy, domain generalization, and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Neil Joshi , Phil Burlina

Individual fairness is an intuitive definition of algorithmic fairness that addresses some of the drawbacks of group fairness. Despite its benefits, it depends on a task specific fair metric that encodes our intuition of what is fair and…

Machine Learning · Statistics 2020-06-23 Debarghya Mukherjee , Mikhail Yurochkin , Moulinath Banerjee , Yuekai Sun

Fairness and bias are crucial concepts in artificial intelligence, yet they are relatively ignored in machine learning applications in clinical psychiatry. We computed fairness metrics and present bias mitigation strategies using a model…

Machine Learning · Computer Science 2022-05-25 Pablo Mosteiro , Jesse Kuiper , Judith Masthoff , Floortje Scheepers , Marco Spruit

Fairness in deep learning models trained with high-dimensional inputs and subjective labels remains a complex and understudied area. Facial emotion recognition, a domain where datasets are often racially imbalanced, can lead to models that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Alex Fan , Xingshuo Xiao , Peter Washington

Applications that deal with sensitive information may have restrictions placed on the data available to a machine learning (ML) classifier. For example, in some applications, a classifier may not have direct access to sensitive attributes,…

Machine Learning · Computer Science 2024-03-13 Zachary McBride Lazri , Danial Dervovic , Antigoni Polychroniadou , Ivan Brugere , Dana Dachman-Soled , Min Wu

Machine learning (ML) models are increasingly used for high-stake applications that can greatly impact people's lives. Despite their use, these models have the potential to be biased towards certain social groups on the basis of race,…

Machine Learning · Computer Science 2021-11-16 Jashandeep Singh , Arashdeep Singh , Ariba Khan , Amar Gupta

The influence of bias in datasets on the fairness of model predictions is a topic of ongoing research in various fields. We evaluate the performance of skin lesion classification using ResNet-based CNNs, focusing on patient sex variations…

Machine Learning · Computer Science 2024-12-10 Ralf Raumanns , Gerard Schouten , Josien P. W. Pluim , Veronika Cheplygina

Machine learning (ML) algorithms are increasingly deployed to make critical decisions in socioeconomic applications such as finance, criminal justice, and autonomous driving. However, due to their data-driven and pattern-seeking nature, ML…

Software Engineering · Computer Science 2026-01-08 Verya Monjezi , Ashish Kumar , Ashutosh Trivedi , Gang Tan , Saeid Tizpaz-Niari

In this paper, we deal with bias mitigation techniques that remove specific data points from the training set to aim for a fair representation of the population in that set. Machine learning models are trained on these pre-processed…

Machine Learning · Computer Science 2024-09-24 Manh Khoi Duong , Stefan Conrad

While deep learning based approaches have demonstrated expert-level performance in dermatological diagnosis tasks, they have also been shown to exhibit biases toward certain demographic attributes, particularly skin types (e.g., light…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Arezou Pakzad , Kumar Abhishek , Ghassan Hamarneh