English
Related papers

Related papers: X-ray Made Simple: Lay Radiology Report Generation…

200 papers

Radiology Report Generation (RRG) aims to automatically generate diagnostic reports from radiology images. To achieve this, existing methods have leveraged the powerful cross-modal generation capabilities of Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Jiechao Gao , Chang Liu , Yuangang Li

Large language models (LLMs) have demonstrated remarkable capabilities in various domains, including radiology report generation. Previous approaches have attempted to utilize multimodal LLMs for this task, enhancing their performance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Wenjun Hou , Yi Cheng , Kaishuai Xu , Heng Li , Yan Hu , Wenjie Li , Jiang Liu

Frontier models have demonstrated remarkable capabilities in understanding and reasoning with natural-language text, but they still exhibit major competency gaps in multimodal understanding and reasoning especially in high-value verticals…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Qianchu Liu , Sheng Zhang , Guanghui Qin , Yu Gu , Ying Jin , Sam Preston , Yanbo Xu , Sid Kiblawi , Wen-wai Yim , Tim Ossowski , Tristan Naumann , Mu Wei , Hoifung Poon

Recent advances in radiology report generation (RRG) have been driven by large paired image-text datasets; however, progress in neuro-oncology has been limited due to a lack of open paired image-report datasets. Here, we introduce BTReport,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Juampablo E. Heras Rivera , Dickson T. Chen , Tianyi Ren , Daniel K. Low , Asma Ben Abacha , Alberto Santamaria-Pang , Mehmet Kurt

Automatic medical report generation (MRG) is of great research value as it has the potential to relieve radiologists from the heavy burden of report writing. Despite recent advancements, accurate MRG remains challenging due to the need for…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Haibo Jin , Haoxuan Che , Yi Lin , Hao Chen

Automatic medical report generation from chest X-ray images is one possibility for assisting doctors to reduce their workload. However, the different patterns and data distribution of normal and abnormal cases can bias machine learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Philipp Harzig , Yan-Ying Chen , Francine Chen , Rainer Lienhart

A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at current examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination.…

Multimedia · Computer Science 2024-05-07 Zhichuan Wang , Kinhei Lee , Qiao Deng , Tiffany Y. So , Wan Hang Chiu , Yeung Yu Hui , Bingjing Zhou , Edward S. Hui

Medical imaging is widely used in clinical practice for diagnosis and treatment. Report-writing can be error-prone for unexperienced physicians, and time- consuming and tedious for experienced physicians. To address these issues, we study…

Computation and Language · Computer Science 2019-01-09 Baoyu Jing , Pengtao Xie , Eric Xing

Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. However, existing report generation…

Computation and Language · Computer Science 2021-04-14 Yasuhide Miura , Yuhao Zhang , Emily Bao Tsai , Curtis P. Langlotz , Dan Jurafsky

Ultrasound (US) report generation is a challenging task due to the variability of US images, operator dependence, and the need for standardized text. Unlike X-ray and CT, US imaging lacks consistent datasets, making automation difficult. In…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Peixuan Ge , Tongkun Su , Faqin Lv , Baoliang Zhao , Peng Zhang , Chi Hong Wong , Liang Yao , Yu Sun , Zenan Wang , Pak Kin Wong , Ying Hu

Medical imaging plays a pivotal role in diagnosis and treatment in clinical practice. Inspired by the significant progress in automatic image captioning, various deep learning (DL)-based methods have been proposed to generate radiology…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Yixin Wang , Zihao Lin , Zhe Xu , Haoyu Dong , Jiang Tian , Jie Luo , Zhongchao Shi , Yang Zhang , Jianping Fan , Zhiqiang He

Generating radiology reports is time-consuming and requires extensive expertise in practice. Therefore, reliable automatic radiology report generation is highly desired to alleviate the workload. Although deep learning techniques have been…

Image and Video Processing · Electrical Eng. & Systems 2019-07-24 Jianbo Yuan , Haofu Liao , Rui Luo , Jiebo Luo

Automated radiology report generation (R2Gen) has advanced significantly, introducing challenges in accurate evaluation due to its complexity. Traditional metrics often fall short by relying on rigid word-matching or focusing only on…

Computation and Language · Computer Science 2025-02-14 Yunyi Liu , Yingshu Li , Zhanyu Wang , Xinyu Liang , Lingqiao Liu , Lei Wang , Luping Zhou

Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources, therefore becoming an important topic in the medical image analysis field. It is a challenging task, as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xinyi Wang , Grazziela Figueredo , Ruizhe Li , Wei Emma Zhang , Weitong Chen , Xin Chen

The integration of artificial intelligence in healthcare has opened new horizons for improving medical diagnostics and patient care. However, challenges persist in developing systems capable of generating accurate and contextually relevant…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Marco Salmè , Rosa Sicilia , Paolo Soda , Valerio Guarrasi

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a…

Information Retrieval · Computer Science 2025-04-30 Hasan Md Tusfiqur Alam , Devansh Srivastav , Md Abdul Kadir , Daniel Sonntag

Automated radiology report generation aims to generate radiology reports that contain rich, fine-grained descriptions of radiology imaging. Compared with image captioning in the natural image domain, medical images are very similar to each…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yuhao Wang

Mammography report generation is a critical yet underexplored task in medical AI, characterized by challenges such as multiview image reasoning, high-resolution visual cues, and unstructured radiologic language. In this work, we introduce…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Nak-Jun Sung , Donghyun Lee , Bo Hwa Choi , Chae Jung Park

To reduce doctors' workload, deep-learning-based automatic medical report generation has recently attracted more and more research efforts, where attention mechanisms and reinforcement learning are integrated with the classic…

Computation and Language · Computer Science 2020-11-17 Wenting Xu , Chang Qi , Zhenghua Xu , Thomas Lukasiewicz

Given the rapidly expanding capabilities of generative AI models for radiology, there is a need for robust metrics that can accurately measure the quality of AI-generated radiology reports across diverse hospitals. We develop…