English
Related papers

Related papers: Detecting Shortcut Learning for Fair Medical AI us…

200 papers

As machine learning (ML) algorithms are increasingly used in medical image analysis, concerns have emerged about their potential biases against certain social groups. Although many approaches have been proposed to ensure the fairness of ML…

Machine Learning · Computer Science 2025-10-13 Thai-Hoang Pham , Jiayuan Chen , Seungyeon Lee , Yuanlong Wang , Sayoko Moroi , Xueru Zhang , Ping Zhang

Machine Learning (ML) models are widely employed to drive many modern data systems. While they are undeniably powerful tools, ML models often demonstrate imbalanced performance and unfair behaviors. The root of this problem often lies in…

Machine Learning · Computer Science 2023-08-10 Ke Yang , Alexandra Meliou

The potential for machine learning (ML) systems to amplify social inequities and unfairness is receiving increasing popular and academic attention. A surge of recent work has focused on the development of algorithmic tools to assess and…

Human-Computer Interaction · Computer Science 2019-01-09 Kenneth Holstein , Jennifer Wortman Vaughan , Hal Daumé , Miro Dudík , Hanna Wallach

Fairness in machine learning (ML) has become a rapidly growing area of research. But why, in the first place, is unfairness in ML wrong? And why should we care about improving fairness? Most fair-ML research implicitly appeals to…

Machine Learning · Computer Science 2026-02-27 Youjin Kong

Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities, but their susceptibility to biases poses significant risks, since biases may negatively impact generalization performance. In this…

Machine Learning · Computer Science 2025-04-29 Haroui Ma , Francesco Quinzan , Theresa Willem , Stefan Bauer

Mitigating the discrimination of machine learning models has gained increasing attention in medical image analysis. However, rare works focus on fair treatments for patients with multiple sensitive demographic ones, which is a crucial yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Wenlong Deng , Yuan Zhong , Qi Dou , Xiaoxiao Li

The global need for effective disease diagnosis remains substantial, given the complexities of various disease mechanisms and diverse patient symptoms. To tackle these challenges, researchers, physicians, and patients are turning to machine…

Machine Learning · Computer Science 2023-10-27 S M Atikur Rahman , Sifat Ibtisum , Ehsan Bazgir , Tumpa Barai

Machine-learning (ML) shortcuts or spurious correlations are artifacts in datasets that lead to very good training and test performance but severely limit the model's generalization capability. Such shortcuts are insidious because they go…

Artificial Intelligence · Computer Science 2023-10-31 Nicolas M. Müller , Maximilian Burgert , Pascal Debus , Jennifer Williams , Philip Sperl , Konstantin Böttinger

Causal machine learning methods which flexibly generate heterogeneous treatment effect estimates could be very useful tools for governments trying to make and implement policy. However, as the critical artificial intelligence literature has…

Econometrics · Economics 2023-09-06 Patrick Rehill , Nicholas Biddle

One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This…

A significant level of stigma and inequality exists in mental healthcare, especially in under-served populations. Inequalities are reflected in the data collected for scientific purposes. When not properly accounted for, machine learning…

As machine learning methods gain prominence within clinical decision-making, addressing fairness concerns becomes increasingly urgent. Despite considerable work dedicated to detecting and ameliorating algorithmic bias, today's methods are…

Machine Learning · Computer Science 2023-08-01 Charles Jones , Daniel C. Castro , Fabio De Sousa Ribeiro , Ozan Oktay , Melissa McCradden , Ben Glocker

Machine learning models have achieved high overall accuracy in medical image analysis. However, performance disparities on specific patient groups pose challenges to their clinical utility, safety, and fairness. This can affect known…

Machine Learning · Computer Science 2024-10-23 Vincent Olesen , Nina Weng , Aasa Feragen , Eike Petersen

Fairness in AI and machine learning systems has become a fundamental problem in the accountability of AI systems. While the need for accountability of AI models is near ubiquitous, healthcare in particular is a challenging field where…

Machine Learning · Computer Science 2021-02-09 Ming Yuan , Vikas Kumar , Muhammad Aurangzeb Ahmad , Ankur Teredesai

Applications of machine learning (ML) to high-stakes policy settings -- such as education, criminal justice, healthcare, and social service delivery -- have grown rapidly in recent years, sparking important conversations about how to ensure…

Machine Learning · Computer Science 2021-05-14 Hemank Lamba , Kit T. Rodolfa , Rayid Ghani

Machine learning (ML) models often exhibit bias that can exacerbate inequities in biomedical applications. Fairness auditing, the process of evaluating a model's performance across subpopulations, is critical for identifying and mitigating…

Methodology · Statistics 2026-05-19 Jianhui Gao , Jessica Gronsbell

Fairness in machine learning (ML) has garnered significant attention in recent years. While existing research has predominantly focused on the distributive fairness of ML models, there has been limited exploration of procedural fairness.…

Machine Learning · Computer Science 2025-01-14 Ziming Wang , Changwu Huang , Ke Tang , Xin Yao

Machine learning (ML) is increasingly being used in high-stakes applications impacting society. Therefore, it is of critical importance that ML models do not propagate discrimination. Collecting accurate labeled data in societal…

Machine Learning · Computer Science 2020-07-03 Hadis Anahideh , Abolfazl Asudeh , Saravanan Thirumuruganathan

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

This thesis explores open-sourced machine learning (ML) model explanation tools to understand whether these tools can allow a layman to visualize, understand, and suggest intuitive remedies to unfairness in ML-based decision-support…

Machine Learning · Computer Science 2023-07-12 Normen Yu , Gang Tan , Saeid Tizpaz-Niari