English
Related papers

Related papers: Worst-Group Equalized Odds Regularization for Mult…

200 papers

Current face recognition systems achieve high progress on several benchmark tests. Despite this progress, recent works showed that these systems are strongly biased against demographic sub-groups. Consequently, an easily integrable solution…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Philipp Terhörst , Jan Niklas Kolf , Naser Damer , Florian Kirchbuchner , Arjan Kuijper

Ensuring fairness has emerged as one of the primary concerns in AI and its related algorithms. Over time, the field of machine learning fairness has evolved to address these issues. This paper provides an extensive overview of this field…

Machine Learning · Computer Science 2024-11-15 Quan Zhou

In this paper we consider the problem of maximizing the Area under the ROC curve (AUC) which is a widely used performance metric in imbalanced classification and anomaly detection. Due to the pairwise nonlinearity of the objective function,…

Machine Learning · Computer Science 2019-06-17 Yunwen Lei , Yiming Ying

The use of machine learning systems to support decision making in healthcare raises questions as to what extent these systems may introduce or exacerbate disparities in care for historically underrepresented and mistreated groups, due to…

Machine Learning · Computer Science 2019-07-16 Stephen Pfohl , Tony Duan , Daisy Yi Ding , Nigam H. Shah

Recent advancements in deep learning have shown transformative potential in medical imaging, yet concerns about fairness persist due to performance disparities across demographic subgroups. Existing methods aim to address these biases by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yicheng Gao , Jinkui Hao , Bo Zhou

The Jaccard index, also known as Intersection-over-Union (IoU score), is one of the most critical evaluation metrics in medical image segmentation. However, directly optimizing the mean IoU (mIoU) score over multiple objective classes is an…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Zhibin Li , Litao Yu , Jian Zhang

The present study performs a comprehensive fairness analysis of machine learning (ML) models for the diagnosis of Mild Cognitive Impairment (MCI) and Alzheimer's disease (AD) from MRI-derived neuroimaging features. Biases associated with…

Machine Learning · Computer Science 2025-05-30 Maria Eleftheria Vlontzou , Maria Athanasiou , Christos Davatzikos , Konstantina S. Nikita

Fairness in medical AI is increasingly recognized as a crucial aspect of healthcare delivery. While most of the prior work done on fairness emphasizes the importance of equal performance, we argue that decreases in fairness can be either…

Machine Learning · Computer Science 2024-10-01 Samia Belhadj , Sanguk Park , Ambika Seth , Hesham Dar , Thijs Kooi

In this extended abstract, we will present and discuss opportunities and challenges brought about by a new deep learning method by AUC maximization (aka \underline{\bf D}eep \underline{\bf A}UC \underline{\bf M}aximization or {\bf DAM}) for…

Machine Learning · Computer Science 2021-11-05 Tianbao Yang

Artificial intelligence (AI) models trained using medical images for clinical tasks often exhibit bias in the form of disparities in performance between subgroups. Since not all sources of biases in real-world medical imaging data are…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Emma A. M. Stanley , Raissa Souza , Anthony Winder , Vedant Gulve , Kimberly Amador , Matthias Wilms , Nils D. Forkert

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Trustworthy deployment of deep learning medical imaging models into real-world clinical practice requires that they be calibrated. However, models that are well calibrated overall can still be poorly calibrated for a sub-population,…

Image and Video Processing · Electrical Eng. & Systems 2023-07-21 Changjian Shui , Justin Szeto , Raghav Mehta , Douglas L. Arnold , Tal Arbel

Machine learning models deployed in critical care settings exhibit demographic biases, particularly gender disparities, that undermine clinical trust and equitable treatment. This paper introduces FairMed-XGB, a novel framework that…

Machine Learning · Computer Science 2026-03-17 Mitul Goswami , Romit Chatterjee , Arif Ahmed Sekh

Most work in algorithmic fairness to date has focused on discrete outcomes, such as deciding whether to grant someone a loan or not. In these classification settings, group fairness criteria such as independence, separation and sufficiency…

Machine Learning · Computer Science 2020-02-18 Daniel Steinberg , Alistair Reid , Simon O'Callaghan , Finnian Lattimore , Lachlan McCalman , Tiberio Caetano

Deep neural networks excel in medical imaging but remain prone to biases, leading to fairness gaps across demographic groups. We provide the first systematic exploration of Human-AI alignment and fairness in this domain. Our results show…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Haozhe Luo , Ziyu Zhou , Zixin Shu , Aurélie Pahud de Mortanges , Robert Berke , Mauricio Reyes

Search and recommendation systems, such as search engines, recruiting tools, online marketplaces, news, and social media, output ranked lists of content, products, and sometimes, people. Credit ratings, standardized tests, risk assessments…

Information Retrieval · Computer Science 2021-02-19 Sruthi Gorantla , Amit Deshpande , Anand Louis

The most prevalent notions of fairness in machine learning are statistical definitions: they fix a small collection of pre-defined groups, and then ask for parity of some statistic of the classifier across these groups. Constraints of this…

Machine Learning · Computer Science 2018-12-04 Michael Kearns , Seth Neel , Aaron Roth , Zhiwei Steven Wu

Mitigating the disparate impact of statistical machine learning methods is crucial for ensuring fairness. While extensive research aims to reduce disparity, the effect of using a \emph{finite dataset} -- as opposed to the entire population…

Machine Learning · Statistics 2024-03-28 Xianli Zeng , Guang Cheng , Edgar Dobriban

Machine learning actively impacts our everyday life in almost all endeavors and domains such as healthcare, finance, and energy. As our dependence on the machine learning increases, it is inevitable that these algorithms will be used to…

Machine Learning · Computer Science 2021-02-23 Ankit Kulshrestha , Ilya Safro

AI models for medical diagnosis often exhibit uneven performance across patient populations due to heterogeneity in disease prevalence, imaging appearance, and clinical risk profiles. Existing algorithmic fairness approaches typically seek…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Gelei Xu , Yuying Duan , Jun Xia , Ruining Deng , Wei Jin , Yiyu Shi