English
Related papers

Related papers: Detecting algorithmic bias in medical-AI models us…

200 papers

With the universal adoption of machine learning in healthcare, the potential for the automation of societal biases to further exacerbate health disparities poses a significant risk. We explore algorithmic fairness from the perspective of…

Machine Learning · Computer Science 2024-04-02 Md Rahat Shahriar Zawad , Peter Washington

Screening patients for clinical trial eligibility remains a manual, time-consuming, and resource-intensive process. We present a secure, scalable proof-of-concept system for Artificial Intelligence (AI)-augmented patient-trial matching that…

Fairness in AI-driven decision-making systems has become a critical concern, especially when these systems directly affect human lives. This paper explores the public's comprehension of fairness in healthcare recommendations. We conducted a…

Machine Learning · Computer Science 2024-09-10 Veronica Kecki , Alan Said

Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities, but their susceptibility to biases poses significant risks, since biases may negatively impact generalization performance. In this…

Machine Learning · Computer Science 2025-04-29 Haroui Ma , Francesco Quinzan , Theresa Willem , Stefan Bauer

With the rapid advancement of AI, there is a growing trend to integrate AI into decision-making processes. However, AI systems may exhibit biases that lead decision-makers to draw unfair conclusions. Notably, the COMPAS system used in the…

Computers and Society · Computer Science 2024-09-12 Chih-Cheng Rex Yuan , Bow-Yaw Wang

Comparative diagnostic in brain tumor evaluation makes possible to use the available information of a medical center to compare similar cases when a new patient is evaluated. By leveraging Artificial Intelligence models, the proposed system…

Image and Video Processing · Electrical Eng. & Systems 2024-05-31 Guillermo Iglesias , Edgar Talavera , Jesús Troya Garcìa , Alberto Díaz-Álvarez , Miguel Gracía-Remesal

It has recently been shown that deep learning models for anatomical segmentation in medical images can exhibit biases against certain sub-populations defined in terms of protected attributes like sex or ethnicity. In this context, auditing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Nicolás Gaggion , Rodrigo Echeveste , Lucas Mansilla , Diego H. Milone , Enzo Ferrante

Artificial intelligence (AI)-based decision support systems can be highly accurate yet still fail to support users or improve decisions. Existing theories of AI-assisted decision-making focus on calibrating reliance on AI advice, leaving it…

Human-Computer Interaction · Computer Science 2026-02-03 Venkatesh Sivaraman , Eric P. Mason , Mengfan Ellen Li , Jessica Tong , Andrew J. King , Jeremy M. Kahn , Adam Perer

Algorithmic bias in medical imaging can perpetuate health disparities, yet its causes remain poorly understood in segmentation tasks. While fairness has been extensively studied in classification, segmentation remains underexplored despite…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Aditya Parikh , Sneha Das , Aasa Feragen

Designing sustainable medical devices requires balancing environmental, economic, and social demands, yet trade-offs across these pillars are difficult to identify using manual assessment alone. Current methods depend heavily on expert…

Physics and Society · Physics 2025-12-16 Apala Chakrabarti

Medical imaging AI systems such as disease classification and segmentation are increasingly inspired and transformed from computer vision based AI systems. Although an array of adversarial training and/or loss function based defense…

Machine Learning · Computer Science 2020-06-25 Xin Li , Deng Pan , Dongxiao Zhu

The pervasive application of algorithmic decision-making is raising concerns on the risk of unintended bias in AI systems deployed in critical settings such as healthcare. The detection and mitigation of biased models is a very delicate…

Machine Learning · Computer Science 2020-11-10 Cecilia Panigutti , Alan Perotti , Andrè Panisson , Paolo Bajardi , Dino Pedreschi

Healthcare disparities persist across socioeconomic boundaries, often attributed to unequal access to screening, diagnostics, and therapeutics. However, this perspective highlights that critical biases can emerge much earlier, during data…

Artificial Intelligence · Computer Science 2026-04-17 Michal Rosen-Zvi , Yoav Kan-Tor , Michael Danziger , Agata Ferretti , Javier Aula-Blasco , Julia Falcao , Ron Shamir , Mordechai Muszkat

AI tools increasingly guide targeted interventions in healthcare, education, and recruiting. Algorithms score individuals, trigger outreach to those above a threshold (e.g., high-risk or high-value), and encourage them to request service;…

Methodology · Statistics 2026-04-17 Carri W. Chan , Yi Han , Hannah Li , Benjamin L. Ranard

Health care decisions are increasingly informed by clinical decision support algorithms, but these algorithms may perpetuate or increase racial and ethnic disparities in access to and quality of health care. Further complicating the…

Methodology · Statistics 2024-02-28 Solvejg Wastvedt , Joshua Snoke , Denis Agniel , Julie Lai , Marc N. Elliott , Steven C. Martino

Artificial intelligence (AI) is increasingly integrated into modern healthcare, offering powerful support for clinical decision-making. However, in real-world settings, AI systems may experience performance degradation over time, due to…

Artificial Intelligence · Computer Science 2026-02-05 Hao Guan , David Bates , Li Zhou

Artificial intelligence (AI) systems in healthcare have demonstrated remarkable potential to improve patient outcomes. However, if not designed with fairness in mind, they also carry the risks of perpetuating or exacerbating existing health…

Machine Learning · Computer Science 2025-01-24 Xiaoyang Wang , Christopher C. Yang

This paper examines what it means for a medical AI system to be right by grounding the question in a specific clinical context: the automatic classification of plasma cells in digitized bone marrow smears for the diagnosis of multiple…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Antony Gitau

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Patient triage plays a crucial role in healthcare, ensuring timely and appropriate care based on the urgency of patient conditions. Traditional triage methods heavily rely on human judgment, which can be subjective and prone to errors.…

Machine Learning · Computer Science 2023-10-11 Pietro Hiram Guzzi , Annamaria De Filippo , Pierangelo Veltri