English
Related papers

Related papers: Anatomical grounding pre-training for medical phra…

200 papers

Chest X-rays (CXRs) are the most frequently performed imaging examinations in clinical settings. Recent advancements in Large Multimodal Models (LMMs) have enabled automated CXR interpretation, enhancing diagnostic accuracy and efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Qingqiu Li , Zihang Cui , Seongsu Bae , Jilan Xu , Runtian Yuan , Yuejie Zhang , Rui Feng , Quanli Shen , Xiaobo Zhang , Junjun He , Shujun Wang

Several evaluation metrics have been developed recently to automatically assess the quality of generative AI reports for chest radiographs based only on textual information using lexical, semantic, or clinical named entity recognition…

Computation and Language · Computer Science 2025-05-23 Razi Mahmood , Pingkun Yan , Diego Machado Reyes , Ge Wang , Mannudeep K. Kalra , Parisa Kaviani , Joy T. Wu , Tanveer Syeda-Mahmood

Integrating high-level semantically correlated contents and low-level anatomical features is of central importance in medical image segmentation. Towards this end, recent deep learning-based medical segmentation methods have shown great…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chenyu You , Weicheng Dai , Yifei Min , Lawrence Staib , James S. Duncan

In medical reporting, the accuracy of radiological reports, whether generated by humans or machine learning algorithms, is critical. We tackle a new task in this paper: image-conditioned autocorrection of inaccuracies within these reports.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Arnold Caleb Asiimwe , Dídac Surís , Pranav Rajpurkar , Carl Vondrick

Segment Anything Model (SAM) demonstrates powerful zero-shot capabilities; however, its accuracy and robustness significantly decrease when applied to medical image segmentation. Existing methods address this issue through modality fusion,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yiheng Zhong , Zihong Luo , Chengzhi Liu , Feilong Tang , Zelin Peng , Ming Hu , Yingzhen Hu , Jionglong Su , Zongyuan Ge , Imran Razzak

Masked Autoencoder (MAE) has recently been shown to be effective in pre-training Vision Transformers (ViT) for natural image analysis. By reconstructing full images from partially masked inputs, a ViT encoder aggregates contextual…

Image and Video Processing · Electrical Eng. & Systems 2023-04-24 Lei Zhou , Huidong Liu , Joseph Bae , Junjun He , Dimitris Samaras , Prateek Prasanna

Medical caption prediction which can be regarded as a task of medical report generation (MRG), requires the automatic generation of coherent and accurate captions for the given medical images. However, the scarcity of labelled medical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Bang Yang , Asif Raza , Yuexian Zou , Tong Zhang

Clinically reliable perception of surgical scenes is essential for advancing intelligent, context-aware intraoperative assistance such as instrument handoff guidance, collision avoidance, and workflow-aware robotic support. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Tajamul Ashraf , Abrar Ul Riyaz , Wasif Tak , Tavaheed Tariq , Sonia Yadav , Moloud Abdar , Janibul Bashir

Parameter-efficient fine-tuning (PEFT) techniques have emerged to address overfitting and high computational costs associated with fully fine-tuning in self-supervised learning. Mainstream PEFT methods add a few trainable parameters while…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Xingliang Lei , Yiwen Ye , Zhisong Wang , Ziyang Chen , Minglei Shu , Weidong Cai , Yanning Zhang , Yong Xia

This paper proposes an automatic method for scapula bone segmentation from Magnetic Resonance (MR) images using deep learning. The purpose of this work is to incorporate anatomical priors into a conditional adversarial framework, given a…

Image and Video Processing · Electrical Eng. & Systems 2020-09-16 Arnaud Boutillon , Bhushan Borotikar , Valérie Burdin , Pierre-Henri Conze

Medical Image Grounding (MIG), which involves localizing specific regions in medical images based on textual descriptions, requires models to not only perceive regions but also deduce spatial relationships of these regions. Existing…

Machine Learning · Computer Science 2025-07-08 Huihui Xu , Yuanpeng Nie , Hualiang Wang , Ying Chen , Wei Li , Junzhi Ning , Lihao Liu , Hongqiu Wang , Lei Zhu , Jiyao Liu , Xiaomeng Li , Junjun He

In this paper, we aimed to provide a review and tutorial for researchers in the field of medical imaging using language models to improve their tasks at hand. We began by providing an overview of the history and concepts of language models,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Mingzhe Hu , Shaoyan Pan , Yuheng Li , Xiaofeng Yang

Vision-Language Models (VLMs) can generate convincing clinical narratives, yet frequently struggle to visually ground their statements. We posit this limitation arises from the scarcity of high-quality, large-scale clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Mengmeng Zhang , Xiaoping Wu , Hao Luo , Fan Wang , Yisheng Lv

Myocardial pathology segmentation (MyoPS) is critical for the risk stratification and treatment planning of myocardial infarction (MI). Multi-sequence cardiac magnetic resonance (MS-CMR) images can provide valuable information. For…

Image and Video Processing · Electrical Eng. & Systems 2023-02-08 Wangbin Ding , Lei Li , Junyi Qiu , Sihan Wang , Liqin Huang , Yinyin Chen , Shan Yang , Xiahai Zhuang

Vision--language models (VLMs) for radiology report generation (RRG) can produce long-form chest CT reports from volumetric scans and show strong potential to improve radiology workflow efficiency and consistency. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chenyu Wang , Weicheng Dai , Han Liu , Wenchao Li , Kayhan Batmanghelich

Latent Diffusion Models have shown remarkable results in text-guided image synthesis in recent years. In the domain of natural (RGB) images, recent works have shown that such models can be adapted to various vision-language downstream tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Konstantinos Vilouras , Ilias Stogiannidis , Junyu Yan , Alison Q. O'Neil , Sotirios A. Tsaftaris

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

Most prior unsupervised domain adaptation approaches for medical image segmentation are narrowly tailored to either the source-accessible setting, where adaptation is guided by source-target alignment, or the source-free setting, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xin Wang , Yin Guo , Jiamin Xia , Kaiyu Zhang , Niranjan Balu , Mahmud Mossa-Basha , Linda Shapiro , Chun Yuan

Multi-modal large language models have demonstrated impressive performance across various tasks in different modalities. However, existing multi-modal models primarily emphasize capturing global information within each modality while…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Zhaowei Li , Qi Xu , Dong Zhang , Hang Song , Yiqing Cai , Qi Qi , Ran Zhou , Junting Pan , Zefeng Li , Van Tu Vu , Zhida Huang , Tao Wang

Medical image segmentation is crucial for disease diagnosis and treatment planning, yet developing robust segmentation models often requires substantial computational resources and large datasets. Existing research shows that pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Paul Zaha , Lars Böcking , Simeon Allmendinger , Leopold Müller , Niklas Kühl