English
Related papers

Related papers: GIT-CXR: End-to-End Transformer for Chest X-Ray Re…

200 papers

The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tiancheng Gu , Dongnan Liu , Zhiyuan Li , Weidong Cai

Automated medical report generation has become increasingly important in medical analysis. It can produce computer-aided diagnosis descriptions and thus significantly alleviate the doctors' work. Inspired by the huge success of neural…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Keqiang Fan , Xiaohao Cai , Mahesan Niranjan

Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. However, existing report generation…

Computation and Language · Computer Science 2021-04-14 Yasuhide Miura , Yuhao Zhang , Emily Bao Tsai , Curtis P. Langlotz , Dan Jurafsky

We present a novel framework for explainable labeling and interpretation of medical images. Medical images require specialized professionals for interpretation, and are explained (typically) via elaborate textual reports. Different from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-17 Dwarikanath Mahapatra

The complexity of stacked imaging and the massive number of radiographs make writing radiology reports complex and inefficient. Even highly experienced radiologists struggle to maintain accuracy and consistency in interpreting radiographs…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jianfei Xu , Thanet Markchom , Huizhi Liang

With the emergence of vision language models in the medical imaging domain, numerous studies have focused on two dominant research activities: (1) report generation from Chest X-rays (CXR), and (2) synthetic scan generation from text or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Santosh Sanjeev , Fadillah Adamsyah Maani , Arsen Abzhanov , Vijay Ram Papineni , Ibrahim Almakky , Bartłomiej W. Papież , Mohammad Yaqub

Automated radiology report generation aims to generate radiology reports that contain rich, fine-grained descriptions of radiology imaging. Compared with image captioning in the natural image domain, medical images are very similar to each…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yuhao Wang

Radiology report generation represents a significant application within medical AI, and has achieved impressive results. Concurrently, large language models (LLMs) have demonstrated remarkable performance across various domains. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Haifeng Zhao , Yufei Zhang , Leilei Ma , Shuo Xu , Dengdi Sun

Recent advances in deep learning have enabled researchers to explore tasks at the intersection of computer vision and natural language processing, such as image captioning, visual question answering, visual dialogue, and visual language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sonit Singh

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Radiology reports are an instrumental part of modern medicine, informing key clinical decisions such as diagnosis and treatment. The worldwide shortage of radiologists, however, restricts access to expert care and imposes heavy workloads,…

To effectively train medical students to become qualified radiologists, a large number of X-ray images collected from patients with diverse medical conditions are needed. However, due to data privacy concerns, such images are typically…

Image and Video Processing · Electrical Eng. & Systems 2020-06-19 Xingyi Yang , Nandiraju Gireesh , Eric Xing , Pengtao Xie

Synthetic medical data generation has opened up new possibilities in the healthcare domain, offering a powerful tool for simulating clinical scenarios, enhancing diagnostic and treatment quality, gaining granular medical knowledge, and…

Image and Video Processing · Electrical Eng. & Systems 2024-05-01 Hyungyung Lee , Da Young Lee , Wonjae Kim , Jin-Hwa Kim , Tackeun Kim , Jihang Kim , Leonard Sunwoo , Edward Choi

Radiology report generation (RRG) models typically focus on individual exams, often overlooking the integration of historical visual or textual data, which is crucial for patient follow-ups. Traditional methods usually struggle with long…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Tengfei Liu , Jiapu Wang , Yongli Hu , Mingjie Li , Junfei Yi , Xiaojun Chang , Junbin Gao , Baocai Yin

Chest X-Ray (CXR) images are commonly used for clinical screening and diagnosis. Automatically writing reports for these images can considerably lighten the workload of radiologists for summarizing descriptive findings and conclusive…

Computation and Language · Computer Science 2020-07-24 Baoyu Jing , Zeya Wang , Eric Xing

Radiology report generation from chest X-rays is an important task in artificial intelligence with the potential to greatly reduce radiologists' workload and shorten patient wait times. Despite recent advances, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Puzhen Wu , Hexin Dong , Yi Lin , Yihao Ding , Yifan Peng

Medical caption prediction which can be regarded as a task of medical report generation (MRG), requires the automatic generation of coherent and accurate captions for the given medical images. However, the scarcity of labelled medical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Bang Yang , Asif Raza , Yuexian Zou , Tong Zhang

A radiology report comprises presentation-style vocabulary, which ensures clarity and organization, and factual vocabulary, which provides accurate and objective descriptions based on observable findings. While manually writing these…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Kang Liu , Zhuoqi Ma , Mengmeng Liu , Zhicheng Jiao , Xiaolu Kang , Qiguang Miao , Kun Xie

Vision-language pretraining has advanced image-text alignment, yet progress in radiology remains constrained by the heterogeneity of clinical reports, including abbreviations, impression-only notes, and stylistic variability. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Hanbin Ko , Gihun Cho , Inhyeok Baek , Donguk Kim , Joonbeom Koo , Changi Kim , Dongheon Lee , Chang Min Park

Despite the reduction in turn-around times in radiology reports with the use of speech recognition software, persistent communication errors can significantly impact the interpretation of the radiology report. Pre-filling a radiology report…

Computation and Language · Computer Science 2023-10-11 Qingqing Zhu , Tejas Sudharshan Mathai , Pritam Mukherjee , Yifan Peng , Ronald M. Summers , Zhiyong Lu