English
Related papers

Related papers: Detecting algorithmic bias in medical-AI models us…

200 papers

Artificial Intelligence (AI) is poised to transform healthcare delivery through revolutionary advances in clinical decision support and diagnostic capabilities. While human expertise remains foundational to medical practice, AI-powered…

The adoption of diagnosis and prognostic algorithms in healthcare has led to concerns about the perpetuation of bias against disadvantaged groups of individuals. Deep learning methods to detect and mitigate bias have revolved around…

The objective of this work is to develop an Electronic Medical Record (EMR) data processing tool that confers clinical context to Machine Learning (ML) algorithms for error handling, bias mitigation and interpretability. We present…

Much attention and concern has been raised recently about bias and the use of machine learning algorithms in healthcare, especially as it relates to perpetuating racial discrimination and health disparities. Following an initial system…

Machine Learning · Computer Science 2023-05-24 Jill A. Kuhlberg , Irene Headen , Ellis A. Ballard , Donald Martin

Artificial intelligence (AI) is increasingly being used for medical imaging tasks. However, there can be biases in AI models, particularly when they are trained using imbalanced training datasets. One such example has been the strong…

Image and Video Processing · Electrical Eng. & Systems 2026-02-04 Tiarna Lee , Esther Puyol-Antón , Bram Ruijsink , Pier-Giorgio Masci , Louise Keehn , Phil Chowienczyk , Emily Haseler , Miaojing Shi , Andrew P. King

Sepsis is a life-threatening condition that requires rapid detection and treatment to prevent progression to severe sepsis, septic shock, or multi-organ failure. Despite advances in medical technology, it remains a major challenge for…

Machine Learning · Computer Science 2025-11-11 Atharva Thakur , Shruti Dhumal

Estimating the test performance of software AI-based medical devices under distribution shifts is crucial for evaluating the safety, efficiency, and usability prior to clinical deployment. Due to the nature of regulated medical device…

Machine Learning · Computer Science 2022-07-14 Charles Lu , Syed Rakin Ahmed , Praveer Singh , Jayashree Kalpathy-Cramer

With the current ongoing debate about fairness, explainability and transparency of machine learning models, their application in high-impact clinical decision-making systems must be scrutinized. We consider a real-life example of risk…

Machine Learning · Computer Science 2020-11-13 Sandhya Tripathi , Bradley A. Fritz , Mohamed Abdelhack , Michael S. Avidan , Yixin Chen , Christopher R. King

Artificial intelligence (AI) systems accelerate medical workflows and improve diagnostic accuracy in healthcare, serving as second-opinion systems. However, the unpredictability of AI errors poses a significant challenge, particularly in…

This study evaluates the effectiveness of Artificial Intelligence (AI) in mitigating medical overtreatment, a significant issue characterized by unnecessary interventions that inflate healthcare costs and pose risks to patients. We…

General Economics · Economics 2024-06-05 Ziyi Wang , Lijia Wei , Lian Xue

In recent years the development of artificial intelligence (AI) systems for automated medical image analysis has gained enormous momentum. At the same time, a large body of work has shown that AI systems can systematically and unfairly…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 María Agustina Ricci Lara , Candelaria Mosquera , Enzo Ferrante , Rodrigo Echeveste

Most Fairness in AI research focuses on exposing biases in AI systems. A broader lens on fairness reveals that AI can serve a greater aspiration: rooting out societal inequities from their source. Specifically, we focus on inequities in…

Artificial Intelligence · Computer Science 2021-09-07 Shiri Dori-Hacohen , Roberto Montenegro , Fabricio Murai , Scott A. Hale , Keen Sung , Michela Blain , Jennifer Edwards-Johnson

A multitude of work has shown that machine learning-based medical diagnosis systems can be biased against certain subgroups of people. This has motivated a growing number of bias mitigation algorithms that aim to address fairness issues in…

Machine Learning · Computer Science 2023-02-21 Yongshuo Zong , Yongxin Yang , Timothy Hospedales

Ensuring equitable Artificial Intelligence (AI) in healthcare demands systems that make unbiased decisions across all demographic groups, bridging technical innovation with ethical principles. Foundation Models (FMs), trained on vast…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Dilermando Queiroz , Anderson Carlos , André Anjos , Lilian Berton

Machine learning models used in medical applications often face challenges due to the covariate shift, which occurs when there are discrepancies between the distributions of training and target data. This can lead to decreased predictive…

Machine Learning · Computer Science 2024-12-24 Mingyang Cai , Thomas Klausch , Mark A. van de Wiel

As artificial intelligence (AI) becomes increasingly embedded in healthcare delivery, this chapter explores the critical aspects of developing reliable and ethical Clinical Decision Support Systems (CDSS). Beginning with the fundamental…

Artificial Intelligence · Computer Science 2025-02-18 Muhammet Alkan , Idris Zakariyya , Samuel Leighton , Kaushik Bhargav Sivangi , Christos Anagnostopoulos , Fani Deligianni

Patient triage plays a crucial role in emergency departments, ensuring timely and appropriate care based on correctly evaluating the emergency grade of patient conditions. Triage methods are generally performed by human operator based on…

Machine Learning · Computer Science 2024-03-13 Annamaria Defilippo , Pierangelo Veltri , Pietro Lio' , Pietro Hiram Guzzi

Explainable artificial intelligence (XAI) plays an indispensable role in demystifying the decision-making processes of AI, especially within the healthcare industry. Clinicians rely heavily on detailed reasoning when making a diagnosis,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Anna Stubbin , Thompson Chyrikov , Jim Zhao , Christina Chajo

The use of AI in healthcare has the potential to improve patient care, optimize clinical workflows, and enhance decision-making. However, bias, data incompleteness, and inaccuracies in training datasets can lead to unfair outcomes and…

Computers and Society · Computer Science 2025-01-13 Marjia Siddik , Harshvardhan J. Pandit

There is currently a dearth of appropriate methods to estimate the causal effects of multiple treatments when the outcome is binary. For such settings, we propose the use of nonparametric Bayesian modeling, Bayesian Additive Regression…

Methodology · Statistics 2020-03-02 Chenyang Gu , Michael J. Lopez , Liangyuan Hu