English
Related papers

Related papers: Medical Imaging AI Competitions Lack Fairness

200 papers

Fairness in artificial intelligence models has gained significantly more attention in recent years, especially in the area of medicine, as fairness in medical models is critical to people's well-being and lives. High-quality medical…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Yu Tian , Min Shi , Yan Luo , Ava Kouhana , Tobias Elze , Mengyu Wang

The number of biomedical image analysis challenges organized per year is steadily increasing. These international competitions have the purpose of benchmarking algorithms on common data sets, typically to identify the best method for a…

The increasing use of Artificial Intelligence (AI) in critical societal domains has amplified concerns about fairness, particularly regarding unequal treatment across sensitive attributes such as race, gender, and socioeconomic status.…

Machine Learning · Computer Science 2025-12-09 Munshi Mahbubur Rahman , Shimei Pan , James R. Foulds

While clinical trials are the state-of-the-art methods to assess the effect of new medication in a comparative manner, benchmarking in the field of medical image analysis is performed by so-called challenges. Recently, comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Annika Reinke , Georg Grab , Lena Maier-Hein

Artificial intelligence (AI) models trained using medical images for clinical tasks often exhibit bias in the form of disparities in performance between subgroups. Since not all sources of biases in real-world medical imaging data are…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Emma A. M. Stanley , Raissa Souza , Anthony Winder , Vedant Gulve , Kimberly Amador , Matthias Wilms , Nils D. Forkert

The rise of general-purpose artificial intelligence (AI) systems, particularly large language models (LLMs), has raised pressing moral questions about how to reduce bias and ensure fairness at scale. Researchers have documented a sort of…

Computation and Language · Computer Science 2025-06-06 Jacy Anthis , Kristian Lum , Michael Ekstrand , Avi Feller , Chenhao Tan

Advances in computing power, deep learning architectures, and expert labelled datasets have spurred the development of medical imaging artificial intelligence systems that rival clinical experts in a variety of scenarios. The National…

Image and Video Processing · Electrical Eng. & Systems 2021-11-18 Rohan Shad , John P. Cunningham , Euan A. Ashley , Curtis P. Langlotz , William Hiesinger

Fairness has been a critical issue that affects the adoption of deep learning models in real practice. To improve model fairness, many existing methods have been proposed and evaluated to be effective in their own contexts. However, there…

Machine Learning · Computer Science 2024-03-26 Junjie Yang , Jiajun Jiang , Zeyu Sun , Junjie Chen

As machine learning methods gain prominence within clinical decision-making, addressing fairness concerns becomes increasingly urgent. Despite considerable work dedicated to detecting and ameliorating algorithmic bias, today's methods are…

Machine Learning · Computer Science 2023-08-01 Charles Jones , Daniel C. Castro , Fabio De Sousa Ribeiro , Ozan Oktay , Melissa McCradden , Ben Glocker

With the widespread use of AI systems and applications in our everyday lives, it is important to take fairness issues into consideration while designing and engineering these types of systems. Such systems can be used in many sensitive…

Machine Learning · Computer Science 2022-01-26 Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , Aram Galstyan

Medical data poses a daunting challenge for AI algorithms: it exists in many different modalities, experiences frequent distribution shifts, and suffers from a scarcity of examples and labels. Recent advances, including transformers and…

With the universal adoption of machine learning in healthcare, the potential for the automation of societal biases to further exacerbate health disparities poses a significant risk. We explore algorithmic fairness from the perspective of…

Machine Learning · Computer Science 2024-04-02 Md Rahat Shahriar Zawad , Peter Washington

Artificial intelligence (AI) can potentially transform global health, but algorithmic bias can exacerbate social inequities and disparity. Trustworthy AI entails the intentional design to ensure equity and mitigate potential biases. To…

Performance comparisons are fundamental in medical imaging Artificial Intelligence (AI) research, often driving claims of superiority based on relative improvements in common performance metrics. However, such claims frequently rely solely…

The use of machine learning to guide clinical decision making has the potential to worsen existing health disparities. Several recent works frame the problem as that of algorithmic fairness, a framework that has attracted considerable…

Machine Learning · Statistics 2021-06-16 Stephen R. Pfohl , Agata Foryciarz , Nigam H. Shah

With the growing utilization of machine learning in healthcare, there is increasing potential to enhance healthcare outcomes. However, this also brings the risk of perpetuating biases in data and model design that can harm certain…

Machine Learning · Computer Science 2023-08-15 Shaina Raza , Parisa Osivand Pour , Syed Raza Bashir

The astounding success made by artificial intelligence (AI) in healthcare and other fields proves that AI can achieve human-like performance. However, success always comes with challenges. Deep learning algorithms are data-dependent and…

Image and Video Processing · Electrical Eng. & Systems 2021-06-25 Johann Li , Guangming Zhu , Cong Hua , Mingtao Feng , BasheerBennamoun , Ping Li , Xiaoyuan Lu , Juan Song , Peiyi Shen , Xu Xu , Lin Mei , Liang Zhang , Syed Afaq Ali Shah , Mohammed Bennamoun

Fairness and accountability are two essential pillars for trustworthy Artificial Intelligence (AI) in healthcare. However, the existing AI model may be biased in its decision marking. To tackle this issue, we propose an adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Xiaoxiao Li , Ziteng Cui , Yifan Wu , Lin Gu , Tatsuya Harada

Healthcare disparities persist across socioeconomic boundaries, often attributed to unequal access to screening, diagnostics, and therapeutics. However, this perspective highlights that critical biases can emerge much earlier, during data…

Artificial Intelligence · Computer Science 2026-04-17 Michal Rosen-Zvi , Yoav Kan-Tor , Michael Danziger , Agata Ferretti , Javier Aula-Blasco , Julia Falcao , Ron Shamir , Mordechai Muszkat

Artificial Intelligence (AI) is poised to transform healthcare delivery through revolutionary advances in clinical decision support and diagnostic capabilities. While human expertise remains foundational to medical practice, AI-powered…