English
Related papers

Related papers: Intersectional Fairness in Vision-Language Models …

200 papers

Trustworthy deployment of deep learning medical imaging models into real-world clinical practice requires that they be calibrated. However, models that are well calibrated overall can still be poorly calibrated for a sub-population,…

Image and Video Processing · Electrical Eng. & Systems 2023-07-21 Changjian Shui , Justin Szeto , Raghav Mehta , Douglas L. Arnold , Tal Arbel

The deployment of vision-language models (VLMs) in dermatology is hindered by the trilemma of high computational costs, extreme data scarcity, and the black-box nature of deep learning. To address these challenges, we present SkinCLIP-VL, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhixiang Lu , Shijie Xu , Kaicheng Yan , Xuyue Cai , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Jionglong Su

The rapid advancement of artificial intelligence (AI) in healthcare imaging has revolutionized diagnostic medicine and clinical decision-making processes. This work presents an intelligent multimodal framework for medical image analysis…

Image and Video Processing · Electrical Eng. & Systems 2026-04-20 Samer Al-Hamadani

In recent years, the integration of multimodal machine learning in wellbeing assessment has offered transformative potential for monitoring mental health. However, with the rapid advancement of Vision-Language Models (VLMs), their…

Artificial Intelligence · Computer Science 2026-04-28 Sophie Chiang , Tom Brennan , Fethiye Irmak Dogan , Jiaee Cheong , Hatice Gunes

Brain disorders are a major challenge to global health, causing millions of deaths each year. Accurate diagnosis of these diseases relies heavily on advanced medical imaging techniques such as Magnetic Resonance Imaging (MRI) and Computed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Xuran Zhu

Recent advancements in large-scale visual-language pre-trained models have led to significant progress in zero-/few-shot anomaly detection within natural image domains. However, the substantial domain divergence between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Chaoqin Huang , Aofan Jiang , Jinghao Feng , Ya Zhang , Xinchao Wang , Yanfeng Wang

The scarcity of data presents a critical obstacle to the efficacy of medical visionlanguage pre-training (VLP). A potential solution lies in the combination of datasets from various language communities. Nevertheless, the main challenge…

Computation and Language · Computer Science 2024-02-20 Zhongwei Wan , Che Liu , Mi Zhang , Jie Fu , Benyou Wang , Sibo Cheng , Lei Ma , César Quilodrán-Casas , Rossella Arcucci

Multimodal large language models (MLLMs) have enormous potential to perform few-shot in-context learning in the context of medical image analysis. However, safe deployment of these models into real-world clinical practice requires an…

Image and Video Processing · Electrical Eng. & Systems 2025-07-22 Xing Shen , Justin Szeto , Mingyang Li , Hengguan Huang , Tal Arbel

Medical image segmentation is a pivotal step in diagnostic and therapeutic processes, relying on high-quality annotated data that is often challenging and costly to obtain. Semi-supervised learning offers a promising approach to enhance…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Yuxuan Cheng , Chenxi Shao , Jie Ma , Yunfei Xie , Guoliang Li

This study aimed to enhance disease classification accuracy from retinal fundus images by integrating fine-grained image features and global textual context using a novel multimodal deep learning architecture. Existing multimodal large…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Jason Jordan , Mohammadreza Akbari Lor , Peter Koulen , Mei-Ling Shyu , Shu-Ching Chen

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

As artificial intelligence (AI) rapidly approaches human-level performance in medical imaging, it is crucial that it does not exacerbate or propagate healthcare disparities. Prior research has established AI's capacity to infer demographic…

Computers and Society · Computer Science 2023-12-19 Yuzhe Yang , Haoran Zhang , Judy W Gichoya , Dina Katabi , Marzyeh Ghassemi

There has been significant progress in implementing deep learning models in disease diagnosis using chest X- rays. Despite these advancements, inherent biases in these models can lead to disparities in prediction accuracy across protected…

Machine Learning · Computer Science 2024-03-28 Dana Moukheiber , Saurabh Mahindre , Lama Moukheiber , Mira Moukheiber , Mingchen Gao

Vision language models (VLMs) show promise in medical diagnosis, but their performance across demographic subgroups when using in-context learning (ICL) remains poorly understood. We examine how the demographic composition of demonstration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Sonnet Xu , Joseph Janizek , Yixing Jiang , Roxana Daneshjou

Anomaly detection (AD) is a fundamental research problem in machine learning and computer vision, with practical applications in industrial inspection, video surveillance, and medical diagnosis. In medical imaging, AD is especially vital…

Image and Video Processing · Electrical Eng. & Systems 2024-04-30 Jinan Bao , Hanshi Sun , Hanqiu Deng , Yinsheng He , Zhaoxiang Zhang , Xingyu Li

Recent years have seen a surge of interest in anomaly detection for tackling industrial defect detection, event detection, etc. However, existing unsupervised anomaly detectors, particularly those for the vision modality, face significant…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Dong Chen , Kaihang Pan , Guoming Wang , Yueting Zhuang , Siliang Tang

Obtaining large pre-trained models that can be fine-tuned to new tasks with limited annotated samples has remained an open challenge for medical imaging data. While pre-trained deep networks on ImageNet and vision-language foundation models…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Duy M. H. Nguyen , Hoang Nguyen , Nghiem T. Diep , Tan N. Pham , Tri Cao , Binh T. Nguyen , Paul Swoboda , Nhat Ho , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag , Mathias Niepert

A multitude of work has shown that machine learning-based medical diagnosis systems can be biased against certain subgroups of people. This has motivated a growing number of bias mitigation algorithms that aim to address fairness issues in…

Machine Learning · Computer Science 2023-02-21 Yongshuo Zong , Yongxin Yang , Timothy Hospedales

MLLMs MLLMs are beginning to appear in clinical workflows, but their ability to perform complex medical reasoning remains unclear. We present Med-CMR, a fine-grained Medical Complex Multimodal Reasoning benchmark. Med-CMR distinguishes from…

Recent advancements in artificial intelligence (AI) have precipitated significant breakthroughs in healthcare, particularly in refining diagnostic procedures. However, previous studies have often been constrained to limited functionalities.…

Artificial Intelligence · Computer Science 2024-07-08 Asma Alkhaldi , Raneem Alnajim , Layan Alabdullatef , Rawan Alyahya , Jun Chen , Deyao Zhu , Ahmed Alsinan , Mohamed Elhoseiny