English
Related papers

Related papers: Algorithmic Bias, Generalist Models,and Clinical M…

200 papers

Bias is known to be an impediment to fair decisions in many domains such as human resources, the public sector, health care etc. Recently, hope has been expressed that the use of machine learning methods for taking such decisions would…

Machine Learning · Computer Science 2019-09-05 Jindong Gu , Daniela Oelke

Predictive algorithms have a powerful potential to offer benefits in areas as varied as medicine or education. However, these algorithms and the data they use are built by humans, consequently, they can inherit the bias and prejudices…

Human-Computer Interaction · Computer Science 2022-03-22 Cristina Manresa-Yee , Silvia Ramis

Following the successful paradigm shift of large language models, leveraging pre-training on a massive corpus of data and fine-tuning on different downstream tasks, generalist models have made their foray into computer vision. The…

Image and Video Processing · Electrical Eng. & Systems 2025-11-21 Andrea Moglia , Matteo Leccardi , Matteo Cavicchioli , Alice Maccarini , Marco Marcon , Luca Mainardi , Pietro Cerveri

Recently, there has been great progress in the ability of artificial intelligence (AI) algorithms to classify dermatological conditions from clinical photographs. However, little is known about the robustness of these algorithms in…

Inevitable domain and task discrepancies in real-world scenarios can impair the generalization performance of the pre-trained deep models for medical data. Therefore, we audaciously propose that we should build a general-purpose medical AI…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huahui Yi , Ziyuan Qin , Qicheng Lao , Wei Xu , Zekun Jiang , Dequan Wang , Shaoting Zhang , Kang Li

Machine learning in medicine is typically optimized for population averages. This frequency weighted training privileges common presentations and marginalizes rare yet clinically critical cases, a bias we call the average patient fallacy.…

Artificial Intelligence · Computer Science 2025-10-01 Alaleh Azhir , Shawn N. Murphy , Hossein Estiri

The rising popularity of artificial intelligence in healthcare is highlighting the problem that a computational model achieving super-human clinical performance at its training sites may perform substantially worse at new sites. In this…

Machine Learning · Computer Science 2023-12-29 Thomas A. Lasko , Eric V. Strobl , William W. Stead

Algorithmic bias in medical imaging can perpetuate health disparities, yet its causes remain poorly understood in segmentation tasks. While fairness has been extensively studied in classification, segmentation remains underexplored despite…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Aditya Parikh , Sneha Das , Aasa Feragen

Advances in artificial intelligence (AI) have achieved expert-level performance in medical imaging applications. Notably, self-supervised vision-language foundation models can detect a broad spectrum of pathologies without relying on…

Computers and Society · Computer Science 2024-02-23 Yuzhe Yang , Yujia Liu , Xin Liu , Avanti Gulhane , Domenico Mastrodicasa , Wei Wu , Edward J Wang , Dushyant W Sahani , Shwetak Patel

The use of machine learning algorithms in healthcare can amplify social injustices and health inequities. While the exacerbation of biases can occur and compound during the problem selection, data collection, and outcome definition, this…

Machine Learning · Computer Science 2024-02-26 Nabil Kahouadji

This paper contributes with a pragmatic evaluation framework for explainable Machine Learning (ML) models for clinical decision support. The study revealed a more nuanced role for ML explanation models, when these are pragmatically embedded…

Artificial Intelligence · Computer Science 2022-12-22 Oskar Wysocki , Jessica Katharine Davies , Markel Vigo , Anne Caroline Armstrong , Dónal Landers , Rebecca Lee , André Freitas

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

Computation and Language · Computer Science 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Medical systems in general, and patient treatment decisions and outcomes in particular, are affected by bias based on gender and other demographic elements. As language models are increasingly applied to medicine, there is a growing…

Computation and Language · Computer Science 2021-03-11 Joshua R. Minot , Nicholas Cheney , Marc Maier , Danne C. Elbers , Christopher M. Danforth , Peter Sheridan Dodds

Artificial intelligence (AI) holds great promise for transforming healthcare. However, despite significant advances, the integration of AI solutions into real-world clinical practice remains limited. A major barrier is the quality and…

Artificial Intelligence · Computer Science 2025-10-24 Anna Arias-Duart , Maria Eugenia Cardello , Atia Cortés

Fairness and bias are crucial concepts in artificial intelligence, yet they are relatively ignored in machine learning applications in clinical psychiatry. We computed fairness metrics and present bias mitigation strategies using a model…

Machine Learning · Computer Science 2022-05-25 Pablo Mosteiro , Jesse Kuiper , Judith Masthoff , Floortje Scheepers , Marco Spruit

One of the major open problems in machine learning is to characterize generalization in the overparameterized regime, where most traditional generalization bounds become inconsistent even for overparameterized linear regression. In many…

Machine Learning · Computer Science 2023-11-22 Jing Xu , Jiaye Teng , Yang Yuan , Andrew Chi-Chih Yao

Foundation models, first introduced in 2021, refer to large-scale pretrained models (e.g., large language models (LLMs) and vision-language models (VLMs)) that learn from extensive unlabeled datasets through unsupervised methods, enabling…

The integration of large language models (LLMs) into healthcare holds promise to enhance clinical decision-making, yet their susceptibility to biases remains a critical concern. Gender has long influenced physician behaviors and patient…

It is fair to say that many of the prominent examples of bias in Machine Learning (ML) arise from bias that is there in the training data. In fact, some would argue that supervised ML algorithms cannot be biased, they reflect the data on…

Machine Learning · Computer Science 2021-04-30 William Blanzeisky , Pádraig Cunningham

Precision medicine has the potential to tailor treatment decisions to individual patients using machine learning (ML) and artificial intelligence (AI), but it faces significant challenges due to complex biases in clinical observational data…

Machine Learning · Computer Science 2024-11-26 Michael Vollenweider , Manuel Schürch , Chiara Rohrer , Gabriele Gut , Michael Krauthammer , Andreas Wicki