English
Related papers

Related papers: MAIRA-2: Grounded Radiology Report Generation

200 papers

The escalating demand for medical image interpretation underscores the critical need for advanced artificial intelligence solutions to enhance the efficiency and accuracy of radiological diagnoses. This paper introduces CXR-PathFinder, a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Pimchanok Sukjai , Apiradee Boonmee

Automating radiology report generation poses a dual challenge: building clinically reliable systems and designing rigorous evaluation protocols. We introduce a multi-agent reinforcement learning framework that serves as both a benchmark and…

Artificial Intelligence · Computer Science 2025-09-23 Ahmed T. Elboardy , Ghada Khoriba , Essam A. Rashed

Multimodal Large Language Models (MLLMs) have shown strong potential for radiology report generation, yet their clinical translation is hindered by architectural heterogeneity and the prevalence of factual hallucinations. Standard…

Machine Learning · Computer Science 2026-01-13 Kun Zhao , Siyuan Dai , Pan Wang , Jifeng Song , Hui Ji , Chenghua Lin , Liang Zhan , Haoteng Tang

Medical caption prediction which can be regarded as a task of medical report generation (MRG), requires the automatic generation of coherent and accurate captions for the given medical images. However, the scarcity of labelled medical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Bang Yang , Asif Raza , Yuexian Zou , Tong Zhang

Medical Report Generation (MRG) is a key part of modern medical diagnostics, as it automatically generates reports from radiological images to reduce radiologists' burden. However, reliable MRG models for lesion description face three main…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yucheng Song , Yifan Ge , Junhao Li , Zhining Liao , Zhifang Liao

Radiology report generation is critical for efficiency but current models lack the structured reasoning of experts, hindering clinical trust and explainability by failing to link visual findings to precise anatomical locations. This paper…

Artificial Intelligence · Computer Science 2026-03-03 Peiyuan Jing , Kinhei Lee , Zhenxuan Zhang , Huichi Zhou , Zhengqing Yuan , Zhifan Gao , Lei Zhu , Giorgos Papanastasiou , Yingying Fang , Guang Yang

Despite the progress of radiology report generation (RRG), existing works face two challenges: 1) The performances in clinical efficacy are unsatisfactory, especially for lesion attributes description; 2) the generated text lacks…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Haibo Jin , Haoxuan Che , Sunan He , Hao Chen

Automated radiology report generation holds significant potential to reduce radiologists' workload and enhance diagnostic accuracy. However, generating precise and clinically meaningful reports from chest radiographs remains challenging due…

Image and Video Processing · Electrical Eng. & Systems 2026-05-20 Md. Zihad Bin Jahangir , Muhammad Ashad Kabir , Sumaiya Akter , Israt Jahan , Minh Chau

Increasing demands on medical imaging departments are taking a toll on the radiologist's ability to deliver timely and accurate reports. Recent technological advances in artificial intelligence have demonstrated great potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Phillip Sloan , Philip Clatworthy , Edwin Simpson , Majid Mirmehdi

Medical image grounding aims to align natural language phrases with specific regions in medical images, serving as a foundational task for intelligent diagnosis, visual question answering (VQA), and automated report generation (MRG).…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Ziye Deng , Ruihan He , Jiaxiang Liu , Yuan Wang , Zijie Meng , Songtao Jiang , Yong Xie , Zuozhu Liu

Several evaluation metrics have been developed recently to automatically assess the quality of generative AI reports for chest radiographs based only on textual information using lexical, semantic, or clinical named entity recognition…

Computation and Language · Computer Science 2025-05-23 Razi Mahmood , Pingkun Yan , Diego Machado Reyes , Ge Wang , Mannudeep K. Kalra , Parisa Kaviani , Joy T. Wu , Tanveer Syeda-Mahmood

This paper explores the task of radiology report generation, which aims at generating free-text descriptions for a set of radiographs. One significant challenge of this task is how to correctly maintain the consistency between the images…

Computation and Language · Computer Science 2023-06-13 Wenjun Hou , Kaishuai Xu , Yi Cheng , Wenjie Li , Jiang Liu

This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning. Radiology-Llama2 is based on the Llama2 architecture and further trained on a large dataset of radiology…

Multimodal Large Language Models (MLLMs) have significantly advanced AI-assisted medical diagnosis, but they often generate factually inconsistent responses that deviate from established medical knowledge. Retrieval-Augmented Generation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Jinhong Wang , Tajamul Ashraf , Zongyan Han , Jorma Laaksonen , Rao Mohammad Anwer

Large Language Models (LLMs) have consistently showcased remarkable generalization capabilities when applied to various language tasks. Nonetheless, harnessing the full potential of LLMs for Radiology Report Generation (R2Gen) still…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zhanyu Wang , Lingqiao Liu , Lei Wang , Luping Zhou

In this study, we aim to initiate the development of Radiology Foundation Model, termed as RadFM. We consider the construction of foundational models from three perspectives, namely, dataset construction, model design, and thorough…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Chaoyi Wu , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Many clinical tasks require an understanding of specialized data, such as medical images and genomics, which is not typically found in general-purpose large multimodal models. Building upon Gemini's multimodal models, we develop several…

Among all the sub-sections in a typical radiology report, the Clinical Indications, Findings, and Impression often reflect important details about the health status of a patient. The information included in Impression is also often covered…

The rapid growth of medical imaging has fueled the development of Foundation Models (FMs) to reduce the growing, unsustainable workload on radiologists. While recent FMs have shown the power of large-scale pre-training to CT and MRI…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Antoine Saporta , Baptiste Callard , Corentin Dancette , Julien Khlaut , Charles Corbière , Leo Butsanets , Amaury Prat , Pierre Manceron

Radiology Report Generation (RRG) has advanced considerably with the development of multimodal generative models. Despite the progress, the field still faces significant challenges in evaluation, as existing metrics lack robustness and…

Computation and Language · Computer Science 2025-05-20 Kun Zhao , Chenghao Xiao , Sixing Yan , Haoteng Tang , William K. Cheung , Noura Al Moubayed , Liang Zhan , Chenghua Lin