English
Related papers

Related papers: Medical Imaging AI Competitions Lack Fairness

200 papers

Ensuring fairness in AI systems is critical, especially in high-stakes domains such as lending, hiring, and healthcare. This urgency is reflected in emerging global regulations that mandate fairness assessments and independent bias audits.…

Machine Learning · Computer Science 2025-08-19 Varsha Ramineni , Hossein A. Rahmani , Emine Yilmaz , David Barber

Publicly accessible benchmarks that allow for assessing and comparing model performances are important drivers of progress in artificial intelligence (AI). While recent advances in AI capabilities hold the potential to transform medical…

Artificial Intelligence · Computer Science 2022-12-26 Kathrin Blagec , Jakob Kraiger , Wolfgang Frühwirt , Matthias Samwald

Algorithmic fairness has emerged as a critical concern in artificial intelligence (AI) research. However, the development of fair AI systems is not an objective process. Fairness is an inherently subjective concept, shaped by the values,…

Most Fairness in AI research focuses on exposing biases in AI systems. A broader lens on fairness reveals that AI can serve a greater aspiration: rooting out societal inequities from their source. Specifically, we focus on inequities in…

Artificial Intelligence · Computer Science 2021-09-07 Shiri Dori-Hacohen , Roberto Montenegro , Fabricio Murai , Scott A. Hale , Keen Sung , Michela Blain , Jennifer Edwards-Johnson

Deep learning algorithms have demonstrated remarkable efficacy in various medical image analysis (MedIA) applications. However, recent research highlights a performance disparity in these algorithms when applied to specific subgroups, such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Zikang Xu , Jun Li , Qingsong Yao , Han Li , Mingyue Zhao , S. Kevin Zhou

Addressing fairness in artificial intelligence (AI), particularly in medical AI, is crucial for ensuring equitable healthcare outcomes. Recent efforts to enhance fairness have introduced new methodologies and datasets in medical AI.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-22 Yu Tian , Congcong Wen , Min Shi , Muhammad Muneeb Afzal , Hao Huang , Muhammad Osama Khan , Yan Luo , Yi Fang , Mengyu Wang

In a world of daily emerging scientific inquisition and discovery, the prolific launch of machine learning across industries comes to little surprise for those familiar with the potential of ML. Neither so should the congruent expansion of…

Artificial Intelligence · Computer Science 2021-12-13 Brianna Richardson , Juan E. Gilbert

As the real-world impact of Artificial Intelligence (AI) systems has been steadily growing, so too have these systems come under increasing scrutiny. In response, the study of AI fairness has rapidly developed into a rich field of research…

Computers and Society · Computer Science 2023-09-19 Maarten Buyl , Tijl De Bie

Machine learning (ML) models are increasingly used to support clinical decision-making. However, real-world medical datasets are often noisy, incomplete, and imbalanced, leading to performance disparities across patient subgroups. These…

As artificial intelligence (AI) rapidly approaches human-level performance in medical imaging, it is crucial that it does not exacerbate or propagate healthcare disparities. Prior research has established AI's capacity to infer demographic…

Computers and Society · Computer Science 2023-12-19 Yuzhe Yang , Haoran Zhang , Judy W Gichoya , Dina Katabi , Marzyeh Ghassemi

Artificial intelligence (AI) has rapidly transformed various sectors, including healthcare, where it holds the potential to revolutionize clinical practice and improve patient outcomes. However, its integration into medical settings brings…

Computers and Society · Computer Science 2024-12-06 Ellison B. Weiner , Irene Dankwa-Mullan , William A. Nelson , Saeed Hassanpour

Efforts to mitigate bias and enhance fairness in the artificial intelligence (AI) community have predominantly focused on technical solutions. While numerous reviews have addressed bias in AI, this review uniquely focuses on the practical…

Artificial Intelligence · Computer Science 2024-10-24 Abdoul Jalil Djiberou Mahamadou , Artem A. Trotsyuk

The digitization of healthcare data coupled with advances in computational capabilities has propelled the adoption of machine learning (ML) in healthcare. However, these methods can perpetuate or even exacerbate existing disparities,…

Machine Learning · Computer Science 2024-02-02 Qizhang Feng , Mengnan Du , Na Zou , Xia Hu

As AI becomes prevalent in high-risk domains and decision-making, it is essential to test for potential harms and biases. This urgency is reflected by the global emergence of AI regulations that emphasise fairness and adequate testing, with…

Machine Learning · Computer Science 2025-07-25 Varsha Ramineni , Hossein A. Rahmani , Emine Yilmaz , David Barber

Equity in AI for healthcare is crucial due to its direct impact on human well-being. Despite advancements in 2D medical imaging fairness, the fairness of 3D models remains underexplored, hindered by the small sizes of 3D fairness datasets.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yan Luo , Muhammad Osama Khan , Yu Tian , Min Shi , Zehao Dou , Tobias Elze , Yi Fang , Mengyu Wang

Recent advances in data-centric medical AI have produced highly accurate diagnostic systems, but the emphasis on data curation and performance metrics has not translated into widespread clinical adoption. We conjecture that this limited…

Artificial Intelligence (AI) has demonstrated remarkable capabilities in domains such as recruitment, finance, healthcare, and the judiciary. However, biases in AI systems raise ethical and societal concerns, emphasizing the need for…

The rapid trend of deploying artificial intelligence (AI) and machine learning (ML) systems in socially consequential domains has raised growing concerns about their trustworthiness, including potential discriminatory behaviours. Research…

Machine Learning · Computer Science 2025-09-22 Yijun Bian , Lei You , Yuya Sasaki , Haruka Maeda , Akira Igarashi

While interest in the application of machine learning to improve healthcare has grown tremendously in recent years, a number of barriers prevent deployment in medical practice. A notable concern is the potential to exacerbate entrenched…

Machine Learning · Computer Science 2022-05-19 Isabel Chien , Nina Deliu , Richard E. Turner , Adrian Weller , Sofia S. Villar , Niki Kilbertus

As machine learning algorithms have been widely deployed across applications, many concerns have been raised over the fairness of their predictions, especially in high stakes settings (such as facial recognition and medical imaging). To…

Machine Learning · Computer Science 2021-02-16 Valeriia Cherepanova , Vedant Nanda , Micah Goldblum , John P. Dickerson , Tom Goldstein