English
Related papers

Related papers: Explaining medical AI performance disparities acro…

200 papers

Machine learning (ML) models are increasingly used to support clinical decision-making. However, real-world medical datasets are often noisy, incomplete, and imbalanced, leading to performance disparities across patient subgroups. These…

Machine learned models exhibit bias, often because the datasets used to train them are biased. This presents a serious problem for the deployment of such technology, as the resulting models might perform poorly on populations that are…

Machine Learning · Computer Science 2018-10-02 Daniel McDuff , Roger Cheng , Ashish Kapoor

Artificial intelligence (AI) models trained using medical images for clinical tasks often exhibit bias in the form of disparities in performance between subgroups. Since not all sources of biases in real-world medical imaging data are…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Emma A. M. Stanley , Raissa Souza , Anthony Winder , Vedant Gulve , Kimberly Amador , Matthias Wilms , Nils D. Forkert

Machine learning (ML) algorithms can often differ in performance across domains. Understanding $\textit{why}$ their performance differs is crucial for determining what types of interventions (e.g., algorithmic or operational) are most…

Machine Learning · Computer Science 2024-02-23 Jean Feng , Harvineet Singh , Fan Xia , Adarsh Subbaswamy , Alexej Gossmann

Deep learning algorithms have demonstrated remarkable efficacy in various medical image analysis (MedIA) applications. However, recent research highlights a performance disparity in these algorithms when applied to specific subgroups, such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Zikang Xu , Jun Li , Qingsong Yao , Han Li , Mingyue Zhao , S. Kevin Zhou

Deep learning has been successfully applied to medical image segmentation, enabling accurate identification of regions of interest such as organs and lesions. This approach works effectively across diverse datasets, including those with…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Tianyi Ren , Juampablo Heras Rivera , Hitender Oswal , Yutong Pan , Agamdeep Chopra , Jacob Ruzevick , Mehmet Kurt

AI models are increasingly deployed in live clinical environments where they must perform reliably across complex, high-stakes workflows that standard training and validation datasets were never designed to capture. Evaluating these systems…

Artificial Intelligence · Computer Science 2026-05-12 Prasanna Desikan , Harshit Rajgarhia , Shivali Dalmia , Ananya Mantravadi

A multitude of work has shown that machine learning-based medical diagnosis systems can be biased against certain subgroups of people. This has motivated a growing number of bias mitigation algorithms that aim to address fairness issues in…

Machine Learning · Computer Science 2023-02-21 Yongshuo Zong , Yongxin Yang , Timothy Hospedales

Although machine learning (ML) models of AI achieve high performances in medicine, they are not free of errors. Empowering clinicians to identify incorrect model recommendations is crucial for engendering trust in medical AI. Explainable AI…

Artificial Intelligence · Computer Science 2022-12-20 Isil Guzey , Ozlem Ucar , Nukhet Aladag Ciftdemir , Betul Acunas

For safety, medical AI systems undergo thorough evaluations before deployment, validating their predictions against a ground truth which is assumed to be fixed and certain. However, this ground truth is often curated in the form of…

Artificial intelligence (AI) systems have the potential to revolutionize clinical practices, including improving diagnostic accuracy and surgical decision-making, while also reducing costs and manpower. However, it is important to recognize…

Artificial Intelligence · Computer Science 2024-09-18 Yifan Yang , Mingquan Lin , Han Zhao , Yifan Peng , Furong Huang , Zhiyong Lu

Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities, but their susceptibility to biases poses significant risks, since biases may negatively impact generalization performance. In this…

Machine Learning · Computer Science 2025-04-29 Haroui Ma , Francesco Quinzan , Theresa Willem , Stefan Bauer

Bias in medical AI is often framed as a problem of representation. However, in image-based tasks such as fetal ultrasound, performance disparities can arise even when representation is adequate, because predictive accuracy depends strongly…

Background: In medical imaging, prior studies have demonstrated disparate AI performance by race, yet there is no known correlation for race on medical imaging that would be obvious to the human expert interpreting the images. Methods:…

Artificial intelligence (AI) is increasingly integrated into modern healthcare, offering powerful support for clinical decision-making. However, in real-world settings, AI systems may experience performance degradation over time, due to…

Artificial Intelligence · Computer Science 2026-02-05 Hao Guan , David Bates , Li Zhou

Accurate and interpretable image-based diagnosis remains a fundamental challenge in medical AI, particularly under domain shifts and rare-class conditions. Deep learning models often struggle with real-world distribution changes, exhibit…

Machine Learning · Computer Science 2025-12-13 Midhat Urooj , Ayan Banerjee , Farhat Shaikh , Kuntal Thakur , Sandeep Gupta

While deep learning has shown promise in the domain of disease classification from medical images, models based on state-of-the-art convolutional neural network architectures often exhibit performance loss due to dataset shift. Models…

Machine Learning · Computer Science 2020-01-14 Joseph D. Janizek , Gabriel Erion , Alex J. DeGrave , Su-In Lee

Artificial intelligence (AI) systems, particularly those based on deep learning models, have increasingly achieved expert-level performance in medical applications. However, there is growing concern that such AI systems may reflect and…

Computation and Language · Computer Science 2025-04-25 Xiuying Chen , Tairan Wang , Juexiao Zhou , Zirui Song , Xin Gao , Xiangliang Zhang

In the current development and deployment of many artificial intelligence (AI) systems in healthcare, algorithm fairness is a challenging problem in delivering equitable care. Recent evaluation of AI models stratified across race…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Richard J. Chen , Tiffany Y. Chen , Jana Lipkova , Judy J. Wang , Drew F. K. Williamson , Ming Y. Lu , Sharifa Sahai , Faisal Mahmood

Access to dermatological care is a major issue, with an estimated 3 billion people lacking access to care globally. Artificial intelligence (AI) may aid in triaging skin diseases. However, most AI models have not been rigorously assessed on…

‹ Prev 1 2 3 10 Next ›