English
Related papers

Related papers: Scaling medical imaging report generation with mul…

200 papers

Increasing demands on medical imaging departments are taking a toll on the radiologist's ability to deliver timely and accurate reports. Recent technological advances in artificial intelligence have demonstrated great potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Phillip Sloan , Philip Clatworthy , Edwin Simpson , Majid Mirmehdi

Multimodal foundation models hold significant potential for automating radiology report generation, thereby assisting clinicians in diagnosing cardiac diseases. However, generated reports often suffer from serious factual inaccuracy. In…

Computation and Language · Computer Science 2025-02-07 Liwen Sun , James Zhao , Megan Han , Chenyan Xiong

Radiologists face high burnout rates, partially due to the increasing volume of Chest X-rays (CXRs) requiring interpretation and reporting. Automated CXR report generation holds promise for reducing this burden and improving patient care.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Aaron Nicolson , Jason Dowling , Bevan Koopman

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for enhancing large language models (LLMs) by retrieving relevant documents from an external corpus. However, existing RAG systems primarily focus on unimodal text…

Computation and Language · Computer Science 2025-10-21 Chenghao Zhang , Guanting Dong , Xinyu Yang , Zhicheng Dou

To reduce doctors' workload, deep-learning-based automatic medical report generation has recently attracted more and more research efforts, where deep convolutional neural networks (CNNs) are employed to encode the input images, and…

Artificial Intelligence · Computer Science 2022-10-26 Wenting Xu , Zhenghua Xu , Junyang Chen , Chang Qi , Thomas Lukasiewicz

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Automated radiology report generation (RRG) holds potential to reduce the workload of radiologists, and recent advances in multimodal large language models (MLLMs) have enabled multimodal chest X-ray (CXR) report generation. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jonggwon Park , Byungmu Yoon , Soobum Kim , Kyoyun Choi

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a…

Information Retrieval · Computer Science 2025-04-30 Hasan Md Tusfiqur Alam , Devansh Srivastav , Md Abdul Kadir , Daniel Sonntag

In the current paradigm of image captioning, deep learning models are trained to generate text from image embeddings of latent features. We challenge the assumption that fine-tuning of large, bespoke models is required to improve model…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Steven Song , Anirudh Subramanyam , Irene Madejski , Robert L. Grossman

Radiology Report Generation (RRG) has advanced considerably with the development of multimodal generative models. Despite the progress, the field still faces significant challenges in evaluation, as existing metrics lack robustness and…

Computation and Language · Computer Science 2025-05-20 Kun Zhao , Chenghao Xiao , Sixing Yan , Haoteng Tang , William K. Cheung , Noura Al Moubayed , Liang Zhan , Chenghua Lin

We propose Retrieval Augmented Generation (RAG) as an approach for automated radiology report writing that leverages multimodally aligned embeddings from a contrastively pretrained vision language model for retrieval of relevant candidate…

Computation and Language · Computer Science 2023-05-08 Mercy Ranjit , Gopinath Ganapathy , Ranjit Manuel , Tanuja Ganu

We present a radiology-specific multimodal model for the task for generating radiological reports from chest X-rays (CXRs). Our work builds on the idea that large language model(s) can be equipped with multimodal capabilities through…

Automated radiology report generation offers an effective solution to alleviate radiologists' workload. However, most existing methods focus primarily on single or fixed-view images to model current disease conditions, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Kang Liu , Zhuoqi Ma , Xiaolu Kang , Yunan Li , Kun Xie , Zhicheng Jiao , Qiguang Miao

Vision-Language Models (VLMs) have significantly advanced automated Radiology Report Generation (RRG). However, existing methods implicitly assume high-quality inputs, overlooking the noise and artifacts prevalent in real-world clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Hongze Zhu , Chen Hu , Jiaxuan Jiang , Hong Liu , Yawen Huang , Ming Hu , Tianyu Wang , Zhijian Wu , Yefeng Zheng

Accurately grounding regions of interest (ROIs) is critical for diagnosis and treatment planning in medical imaging. While multimodal large language models (MLLMs) combine visual perception with natural language, current medical-grounding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zhonghao Yan , Muxi Diao , Yuxuan Yang , Ruoyan Jing , Jiayuan Xu , Kaizhou Zhang , Lele Yang , Yanxi Liu , Kongming Liang , Zhanyu Ma

Large Language Models (LLMs) have demonstrated remarkable general capabilities, but enhancing skills such as reasoning often demands substantial computational resources and may compromise generalization. While Parameter-Efficient…

Artificial Intelligence · Computer Science 2026-05-21 Jaemin Kim , Hangeol Chang , Hyunmin Hwang , Choonghan Kim , Jong Chul Ye

There is growing interest in applying AI to radiology report generation, particularly for chest X-rays (CXRs). This paper investigates whether incorporating pixel-level information through segmentation masks can improve fine-grained image…

Learning-based medical image registration has matched the accuracy of conventional methods while offering superior computational efficiency. However, existing approaches suffer from poor generalization across diverse clinical scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zi Li , Jianpeng Zhang , Tai Ma , Tony C. W. Mok , Yan-Jie Zhou , Zeli Chen , Xianghua Ye , Le Lu , Cheng Chen , Dakai Jin

Automatic medical report generation (MRG) is of great research value as it has the potential to relieve radiologists from the heavy burden of report writing. Despite recent advancements, accurate MRG remains challenging due to the need for…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Haibo Jin , Haoxuan Che , Yi Lin , Hao Chen

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for enhancing the capabilities of large language models. However, existing RAG evaluation predominantly focuses on text retrieval and relies on opaque, end-to-end…

Information Retrieval · Computer Science 2025-05-19 Chuan Xu , Qiaosheng Chen , Yutong Feng , Gong Cheng