English
Related papers

Related papers: Algorithmic encoding of protected characteristics …

200 papers

Magnetic resonance imaging (MRI) is the gold standard for brain imaging. Deep learning (DL) algorithms have been proposed to aid in the diagnosis of diseases such as Alzheimer's disease (AD) from MRI scans. However, DL algorithms can suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Akshit Achara , Esther Puyol Anton , Alexander Hammers , Andrew P. King

Access to dermatological care is a major issue, with an estimated 3 billion people lacking access to care globally. Artificial intelligence (AI) may aid in triaging skin diseases. However, most AI models have not been rigorously assessed on…

This article investigates the critical issue of dataset bias in medical imaging, with a particular emphasis on racial disparities caused by uneven population distribution in dataset collection. Our analysis reveals that medical segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yixiao Chen , Yue Yao , Ruining Yang , Md Zakir Hossain , Ashu Gupta , Tom Gedeon

Shifts in data distribution can substantially harm the performance of clinical AI models and lead to misdiagnosis. Hence, various methods have been developed to detect the presence of such shifts at deployment time. However, the root causes…

Artificial Intelligence · Computer Science 2025-06-23 Mélanie Roschewitz , Raghav Mehta , Charles Jones , Ben Glocker

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Esther Puyol-Anton , Bram Ruijsink , Stefan K. Piechnik , Stefan Neubauer , Steffen E. Petersen , Reza Razavi , Andrew P. King

Distribution shifts remain a fundamental problem for the safe application of machine learning systems. If undetected, they may impact the real-world performance of such systems or will at least render original performance claims invalid. In…

Machine Learning · Computer Science 2023-03-10 Lisa M. Koch , Christian M. Schürch , Christian F. Baumgartner , Arthur Gretton , Philipp Berens

Deep Learning has established in the latest years as a successful approach to address a great variety of tasks. Healthcare is one of the most promising field of application for Deep Learning approaches since it would allow to help…

Machine Learning · Computer Science 2021-10-05 Edoardo Giacomello , Michele Cataldo , Daniele Loiacono , Pier Luca Lanzi

In medical imaging, particularly in early disease detection and prognosis tasks, discerning the rationale behind an AI model's predictions is crucial for evaluating the reliability of its decisions. Conventional explanation methods face…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yingying Fang , Zihao Jin , Xiaodan Xing , Simon Walsh , Guang Yang

Deep learning methodologies have been employed in several different fields, with an outstanding success in image recognition applications, such as material quality control, medical imaging, autonomous driving, etc. Deep learning models rely…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Saul Calderon-Ramirez , Shengxiang Yang , David Elizondo

With the rapid advancement of artificial intelligence and deep learning, medical image analysis has become a critical tool in modern healthcare, significantly improving diagnostic accuracy and efficiency. However, AI-based methods also…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew , Hui Tian

Machine Learning (ML) algorithms are vital for supporting clinical decision-making in biomedical informatics. However, their predictive performance can vary across demographic groups, often due to the underrepresentation of historically…

Machine Learning · Computer Science 2025-03-04 Ioannis Bilionis , Ricardo C. Berrios , Luis Fernandez-Luque , Carlos Castillo

AI models for medical diagnosis often exhibit uneven performance across patient populations due to heterogeneity in disease prevalence, imaging appearance, and clinical risk profiles. Existing algorithmic fairness approaches typically seek…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Gelei Xu , Yuying Duan , Jun Xia , Ruining Deng , Wei Jin , Yiyu Shi

The increasing impact of algorithmic decisions on people's lives compels us to scrutinize their fairness and, in particular, the disparate impacts that ostensibly-color-blind algorithms can have on different groups. Examples include credit…

Machine Learning · Statistics 2020-06-17 Nathan Kallus , Xiaojie Mao , Angela Zhou

While deep learning has shown promise in improving the automated diagnosis of disease based on chest X-rays, deep networks may exhibit undesirable behavior related to shortcuts. This paper studies the case of spurious class skew in which…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Sarah Jabbour , David Fouhey , Ella Kazerooni , Michael W. Sjoding , Jenna Wiens

Automated mammography screening plays an important role in early breast cancer detection. However, current machine learning models, developed on some training datasets, may exhibit performance degradation and bias when deployed in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Amit Kumar Kundu , Florence X. Doo , Vaishnavi Patil , Amitabh Varshney , Joseph Jaja

Deep learning has been shown to accurately assess 'hidden' phenotypes and predict biomarkers from medical imaging beyond traditional clinician interpretation of medical imaging. Given the black box nature of artificial intelligence (AI)…

Machine Learning · Computer Science 2023-08-31 Grant Duffy , Shoa L. Clarke , Matthew Christensen , Bryan He , Neal Yuan , Susan Cheng , David Ouyang

Much attention and concern has been raised recently about bias and the use of machine learning algorithms in healthcare, especially as it relates to perpetuating racial discrimination and health disparities. Following an initial system…

Machine Learning · Computer Science 2023-05-24 Jill A. Kuhlberg , Irene Headen , Ellis A. Ballard , Donald Martin

One of the critical challenges in machine learning applications is to have fair predictions. There are numerous recent examples in various domains that convincingly show that algorithms trained with biased datasets can easily lead to…

Machine Learning · Computer Science 2020-06-18 Samaneh Abbasi-Sureshjani , Ralf Raumanns , Britt E. J. Michels , Gerard Schouten , Veronika Cheplygina

In recent years, the rapid development of artificial intelligence (AI) systems has raised concerns about our ability to ensure their fairness, that is, how to avoid discrimination based on protected characteristics such as gender, race, or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Iris Dominguez-Catena , Daniel Paternain , Mikel Galar , MaryBeth Defrance , Maarten Buyl , Tijl De Bie

Algorithms and technologies are essential tools that pervade all aspects of our daily lives. In the last decades, health care research benefited from new computer-based recruiting methods, the use of federated architectures for data…

Computers and Society · Computer Science 2023-01-26 Chiara Criscuolo , Tommaso Dolci , Mattia Salnitri