中文
相关论文

相关论文: Detecting Shortcut Learning for Fair Medical AI us…

200 篇论文

Medical artificial intelligence (AI) systems, particularly multimodal vision-language models (VLM), often exhibit intersectional biases where models are systematically less confident in diagnosing marginalised patient subgroups. Such bias…

计算机视觉与模式识别 · 计算机科学 2025-12-25 Yupeng Zhang , Adam G. Dunn , Usman Naseem , Jinman Kim

Developing AI tools that preserve fairness is of critical importance, specifically in high-stakes applications such as those in healthcare. However, health AI models' overall prediction performance is often prioritized over the possible…

机器学习 · 计算机科学 2023-05-22 Raphael Poulain , Mirza Farhan Bin Tarek , Rahmatollah Beheshti

This paper addresses significant obstacles that arise from the widespread use of machine learning models in the insurance industry, with a specific focus on promoting fairness. The initial challenge lies in effectively leveraging unlabeled…

机器学习 · 统计学 2024-05-21 Romuald Elie , Caroline Hillairet , François Hu , Marc Juillard

Over the last year, Large Language Models (LLMs) like ChatGPT have become widely available and have exhibited fairness issues similar to those in previous machine learning systems. Current research is primarily focused on analyzing and…

机器学习 · 计算机科学 2024-04-04 Anna Kruspe

Machine learning models are extensively being used to make decisions that have a significant impact on human life. These models are trained over historical data that may contain information about sensitive attributes such as race, sex,…

机器学习 · 计算机科学 2020-10-22 Ramanujam Madhavan , Mohit Wadhwa

The advent of AI and ML algorithms has led to opportunities as well as challenges. In this paper, we provide an overview of bias and fairness issues that arise with the use of ML algorithms. We describe the types and sources of data bias,…

机器学习 · 统计学 2021-05-17 Nengfeng Zhou , Zach Zhang , Vijayan N. Nair , Harsh Singhal , Jie Chen , Agus Sudjianto

It has been rightfully emphasized that the use of AI for clinical decision making could amplify health disparities. An algorithm may encode protected characteristics, and then use this information for making predictions due to undesirable…

机器学习 · 计算机科学 2022-07-22 Ben Glocker , Charles Jones , Melanie Bernhardt , Stefan Winzeck

Recent years have seen the development of many open-source ML fairness toolkits aimed at helping ML practitioners assess and address unfairness in their systems. However, there has been little research investigating how ML practitioners…

The use of AI systems in healthcare for the early screening of diseases is of great clinical importance. Deep learning has shown great promise in medical imaging, but the reliability and trustworthiness of AI systems limit their deployment…

图像与视频处理 · 电气工程与系统科学 2023-05-17 Ke Zou , Zhihao Chen , Xuedong Yuan , Xiaojing Shen , Meng Wang , Huazhu Fu

This study presents a machine learning (ML) pipeline for clinical data classification in the context of a 30-day readmission problem, along with a fairness audit on subgroups based on sensitive attributes. A range of ML models are used for…

机器学习 · 计算机科学 2023-04-13 Shaina Raza

Objective: The growing availability of large-scale observational clinical datasets and challenges in conducting randomized controlled trials have spurred enthusiasm in using causal machine learning (ML) for causal inference in observational…

Fairness in artificial intelligence models has gained significantly more attention in recent years, especially in the area of medicine, as fairness in medical models is critical to people's well-being and lives. High-quality medical…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Yu Tian , Min Shi , Yan Luo , Ava Kouhana , Tobias Elze , Mengyu Wang

AI algorithms have become valuable in aiding professionals in healthcare. The increasing confidence obtained by these models is helpful in critical decision demands. In clinical dermatology, classification models can detect malignant…

Machine learning (ML) models that achieve high average accuracy can still underperform on semantically coherent subsets ("slices") of data. This behavior can have significant societal consequences for the safety or bias of the model in…

人机交互 · 计算机科学 2024-02-12 Nari Johnson , Ángel Alexander Cabrera , Gregory Plumb , Ameet Talwalkar

Fairness has become increasingly pivotal in medical image recognition. However, without mitigating bias, deploying unfair medical AI systems could harm the interests of underprivileged populations. In this paper, we observe that while…

计算机视觉与模式识别 · 计算机科学 2024-02-21 Ching-Hao Chiu , Hao-Wei Chung , Yu-Jen Chen , Yiyu Shi , Tsung-Yi Ho

Benchmarking competitions are central to the development of artificial intelligence (AI) in medical imaging, defining performance standards and shaping methodological progress. However, it remains unclear whether these benchmarks provide…

Machine learning algorithms are extensively used to make increasingly more consequential decisions about people, so achieving optimal predictive performance can no longer be the only focus. A particularly important consideration is fairness…

机器学习 · 计算机科学 2020-06-09 Giulio Morina , Viktoriia Oliinyk , Julian Waton , Ines Marusic , Konstantinos Georgatzis

Machine learning (ML) is increasingly being used in critical decision-making software, but incidents have raised questions about the fairness of ML predictions. To address this issue, new tools and methods are needed to mitigate bias in…

软件工程 · 计算机科学 2023-08-30 Giang Nguyen , Sumon Biswas , Hridesh Rajan

Deep neural networks excel in medical imaging but remain prone to biases, leading to fairness gaps across demographic groups. We provide the first systematic exploration of Human-AI alignment and fairness in this domain. Our results show…

计算机视觉与模式识别 · 计算机科学 2025-05-16 Haozhe Luo , Ziyu Zhou , Zixin Shu , Aurélie Pahud de Mortanges , Robert Berke , Mauricio Reyes

Despite numerous efforts to mitigate their biases, ML systems continue to harm already-marginalized people. While predominant ML approaches assume bias can be removed and fair models can be created, we show that these are not always…

计算与语言 · 计算机科学 2025-04-02 Lucy Havens , Benjamin Bach , Melissa Terras , Beatrice Alex