English
Related papers

Related papers: Merlin: A Computed Tomography Vision-Language Foun…

200 papers

Existing medical imaging datasets for abdominal CT often lack three-dimensional annotations, multi-organ coverage, or precise lesion-to-organ associations, hindering robust representation learning and clinical applications. To address this…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Mehran Advand , Zahra Dehghanian , Navid Faraji , Reza Barati , Seyed Amir Ahmad Safavi-Naini , Hamid R. Rabiee

Anatomical understanding through deep learning is critical for automatic report generation, intra-operative navigation, and organ localization in medical imaging; however, its progress is constrained by the scarcity of expert-labeled data.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yiwei Li , Yikang Liu , Jiaqi Guo , Lin Zhao , Zheyuan Zhang , Xiao Chen , Boris Mailhe , Ankush Mukherjee , Terrence Chen , Shanhui Sun

The rapid expansion of multimedia content has made accurately retrieving relevant videos from large collections increasingly challenging. Recent advancements in text-video retrieval have focused on cross-modal interactions, large-scale…

Computation and Language · Computer Science 2024-10-17 Donghoon Han , Eunhwan Park , Gisang Lee , Adam Lee , Nojun Kwak

Vision-Language Models (VLMs) are becoming increasingly popular in the medical domain, bridging the gap between medical images and clinical language. Existing VLMs demonstrate an impressive ability to comprehend medical images and text…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Bidur Khanal , Sandesh Pokhrel , Sanjay Bhandari , Ramesh Rana , Nikesh Shrestha , Ram Bahadur Gurung , Cristian Linte , Angus Watson , Yash Raj Shrestha , Binod Bhattarai

The combination of multimodal Vision-Language Models (VLMs) and Large Language Models (LLMs) opens up new possibilities for medical classification. This work offers a rigorous, unified benchmark by using four publicly available datasets…

Artificial Intelligence · Computer Science 2026-01-26 Meet Raval , Tejul Pandit , Dhvani Upadhyay

Despite the considerable progress in automatic abdominal multi-organ segmentation from CT/MRI scans in recent years, a comprehensive evaluation of the models' capabilities is hampered by the lack of a large-scale benchmark from diverse…

Image and Video Processing · Electrical Eng. & Systems 2022-09-05 Yuanfeng Ji , Haotian Bai , Jie Yang , Chongjian Ge , Ye Zhu , Ruimao Zhang , Zhen Li , Lingyan Zhang , Wanling Ma , Xiang Wan , Ping Luo

With Transformers achieving outstanding performance on individual remote sensing (RS) tasks, we are now approaching the realization of a unified model that excels across multiple tasks through multi-task learning (MTL). Compared to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Qingyun Li , Shuran Ma , Junwei Luo , Yi Yu , Yue Zhou , Fengxiang Wang , Xudong Lu , Xiaoxing Wang , Xin He , Yushi Chen , Xue Yang

Vision-Language Pre-training (VLP) has shown the merits of analysing medical images, by leveraging the semantic congruence between medical images and their corresponding reports. It efficiently learns visual representations, which in turn…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xiaoxuan He , Yifan Yang , Xinyang Jiang , Xufang Luo , Haoji Hu , Siyun Zhao , Dongsheng Li , Yuqing Yang , Lili Qiu

Medical image grounding aims to align natural language phrases with specific regions in medical images, serving as a foundational task for intelligent diagnosis, visual question answering (VQA), and automated report generation (MRG).…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Ziye Deng , Ruihan He , Jiaxiang Liu , Yuan Wang , Zijie Meng , Songtao Jiang , Yong Xie , Zuozhu Liu

Automated interpretation of chest X-rays (CXR) is a critical task with the potential to significantly improve clinical workflow and patient care. While recent advances in multimodal foundation models have shown promise, effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Alexander Davis , Rafael Souza , Jia-Hao Lim

Multi-sequence Magnetic Resonance Imaging (MRI) offers remarkable versatility, enabling the distinct visualization of different tissue types. Nevertheless, the inherent heterogeneity among MRI sequences poses significant challenges to the…

Computer-aided diagnosis (CAD) technology can assist clinicians in evaluating liver lesions and intervening with treatment in time. Although CAD technology has advanced in recent years, the application scope of existing datasets remains…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Zhe Liu , Kai Han , Siqi Ma , Yan Zhu , Jun Chen , Chongwen Lyu , Xinyi Qiu , Chengxuan Qian , Yuqing Song , Yi Liu , Liyuan Tian , Yang Ji , Yuefeng Li

Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training…

Extracting structured labels from radiology reports has been employed to create vision models to simultaneously detect several types of abnormalities. However, existing works focus mainly on the chest region. Few works have been…

There is an urgent need for triage and classification of high-volume medical imaging modalities such as computed tomography (CT), which can improve patient care and mitigate radiologist burnout. Study-level CT triage requires calibrated…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Lavsen Dahal , Yubraj Bhandari , Geoffrey D. Rubin , Joseph Y. Lo

Medical Visual Question Answering (Med-VQA) holds significant potential for clinical decision support, yet existing efforts primarily focus on 2D imaging with limited task diversity. This paper presents 3D-RAD, a large-scale dataset…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xiaotang Gai , Jiaxiang Liu , Yichen Li , Zijie Meng , Jian Wu , Zuozhu Liu

The reliable analysis of blood reports is important for health knowledge, but individuals often struggle with interpretation, leading to anxiety and overlooked issues. We explore the potential of general-purpose Vision-Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Nadia Bakhsheshi , Hamid Beigy

With the advent of Vision-Language Models (VLMs), medical artificial intelligence (AI) has experienced significant technological progress and paradigm shifts. This survey provides an extensive review of recent advancements in Medical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Beria Chingnabe Kalpelbe , Angel Gabriel Adaambiik , Wei Peng

Medical image segmentation traditionally relies on fully supervised 3D architectures that demand a large amount of dense, voxel-level annotations from clinical experts which is a prohibitively expensive process. Vision Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Pranjal Khadka

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across a wide range of vision-language tasks. However, their performance as embodied agents, which requires multi-round dialogue spatial reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Xunyi Zhao , Gengze Zhou , Qi Wu