English
Related papers

Related papers: Radiology Report Generation with a Learned Knowled…

200 papers

Gathering manually annotated images for the purpose of training a predictive model is far more challenging in the medical domain than for natural images as it requires the expertise of qualified radiologists. We therefore propose to take…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Aydan Gasimova , Giovanni Montana , Daniel Rueckert

Automating radiology report generation can ease the reporting workload for radiologists. However, existing works focus mainly on the chest area due to the limited availability of public datasets for other regions. Besides, they often rely…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Qi Chen , Yutong Xie , Biao Wu , Xiaomin Chen , James Ang , Minh-Son To , Xiaojun Chang , Qi Wu

The impression section of a radiology report summarizes important radiology findings and plays a critical role in communicating these findings to physicians. However, the preparation of these summaries is time-consuming and error-prone for…

Automatic radiology report generation is essential to computer-aided diagnosis. Through the success of image captioning, medical report generation has been achievable. However, the lack of annotated disease labels is still the bottleneck of…

Computation and Language · Computer Science 2022-06-22 Jun Li , Shibo Li , Ying Hu , Huiren Tao

Radiology report generation is critical for efficiency but current models lack the structured reasoning of experts, hindering clinical trust and explainability by failing to link visual findings to precise anatomical locations. This paper…

Artificial Intelligence · Computer Science 2026-03-03 Peiyuan Jing , Kinhei Lee , Zhenxuan Zhang , Huichi Zhou , Zhengqing Yuan , Zhifan Gao , Lei Zhu , Giorgos Papanastasiou , Yingying Fang , Guang Yang

Writing radiology reports from medical images requires a high level of domain expertise. It is time-consuming even for trained radiologists and can be error-prone for inexperienced radiologists. It would be appealing to automate this task…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yuzhe Lu , Sungmin Hong , Yash Shah , Panpan Xu

Radiology report generation (RRG) for diagnostic images, such as chest X-rays, plays a pivotal role in both clinical practice and AI. Traditional free-text reports suffer from redundancy and inconsistent language, complicating the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yingshu Li , Yunyi Liu , Zhanyu Wang , Xinyu Liang , Lingqiao Liu , Lei Wang , Luping Zhou

Radiology reports are crucial for planning treatment strategies and facilitating effective doctor-patient communication. However, the manual creation of these reports places a significant burden on radiologists. While automatic radiology…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Qiguang Miao , Kang Liu , Zhuoqi Ma , Yunan Li , Xiaolu Kang , Ruixuan Liu , Tianyi Liu , Kun Xie , Zhicheng Jiao

Conversational AI tools that can generate and discuss clinically correct radiology reports for a given medical image have the potential to transform radiology. Such a human-in-the-loop radiology assistant could facilitate a collaborative…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Chantal Pellegrini , Ege Özsoy , Benjamin Busam , Nassir Navab , Matthias Keicher

Medical imaging is crucial for diagnosing, monitoring, and treating medical conditions. The medical reports of radiology images are the primary medium through which medical professionals attest their findings, but their writing is time…

Computation and Language · Computer Science 2025-01-07 Iustin Sîrbu , Iulia-Renata Sîrbu , Jasmina Bogojeska , Traian Rebedea

The chest X-Ray (CXR) is the one of the most common clinical exam used to diagnose thoracic diseases and abnormalities. The volume of CXR scans generated daily in hospitals is huge. Therefore, an automated diagnosis system able to save the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Shuai Zhang , Xiaoyan Xin , Yang Wang , Yachong Guo , Qiuqiao Hao , Xianfeng Yang , Jun Wang , Jian Zhang , Bing Zhang , Wei Wang

Automatic radiology reporting has great clinical potential to relieve radiologists from heavy workloads and improve diagnosis interpretation. Recently, researchers have enhanced data-driven neural networks with medical knowledge graphs to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Mingjie Li , Bingqian Lin , Zicong Chen , Haokun Lin , Xiaodan Liang , Xiaojun Chang

Multimodal Large Language Models (MLLMs) have shown strong potential for radiology report generation, yet their clinical translation is hindered by architectural heterogeneity and the prevalence of factual hallucinations. Standard…

Machine Learning · Computer Science 2026-01-13 Kun Zhao , Siyuan Dai , Pan Wang , Jifeng Song , Hui Ji , Chenghua Lin , Liang Zhan , Haoteng Tang

Automatic radiology report generation is booming due to its huge application potential for the healthcare industry. However, existing computer vision and natural language processing approaches to tackle this problem are limited in two…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Fudan Zheng , Mengfei Li , Ying Wang , Weijiang Yu , Ruixuan Wang , Zhiguang Chen , Nong Xiao , Yutong Lu

The development of AI-based methods to analyze radiology reports could lead to significant advances in medical diagnosis, from improving diagnostic accuracy to enhancing efficiency and reducing workload. However, the lack of…

Computation and Language · Computer Science 2025-08-14 Yuyan Ge , Kwan Ho Ryan Chan , Pablo Messina , René Vidal

Radiology report generation (RRG) aims to describe automatically a radiology image with human-like language and could potentially support the work of radiologists, reducing the burden of manual reporting. Previous approaches often adopt an…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Jun Wang , Abhir Bhalerao , Yulan He

Generating radiology reports automatically reduces the workload of radiologists and helps the diagnoses of specific diseases. Many existing methods take this task as modality transfer process. However, since the key information related to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yitian Tao , Liyan Ma , Jing Yu , Han Zhang

Medical report generation from X-ray images is a challenging task, particularly in an unpaired setting where paired image-report data is unavailable for training. To address this challenge, we propose a novel model that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Radiology Report Generation (RRG) has advanced considerably with the development of multimodal generative models. Despite the progress, the field still faces significant challenges in evaluation, as existing metrics lack robustness and…

Computation and Language · Computer Science 2025-05-20 Kun Zhao , Chenghao Xiao , Sixing Yan , Haoteng Tang , William K. Cheung , Noura Al Moubayed , Liang Zhan , Chenghua Lin

We propose a two-stage multimodal framework that enhances disease classification and region-aware radiology report generation from chest X-rays, leveraging the MIMIC-Eye dataset. In the first stage, we introduce a gaze-guided contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Tanjim Islam Riju , Shuchismita Anwar , Saman Sarker Joy , Farig Sadeque , Swakkhar Shatabda