English
Related papers

Related papers: Radiology Report Generation with a Learned Knowled…

200 papers

Automating report generation for medical imaging promises to reduce workload and assist diagnosis in clinical practice. Recent work has shown that deep learning models can successfully caption natural images. However, learning from medical…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring , Ling Shao

Medical imaging plays a crucial role in diagnosis, with radiology reports serving as vital documentation. Automating report generation has emerged as a critical need to alleviate the workload of radiologists. While machine learning has…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Ibrahim Ethem Hamamci , Sezgin Er , Bjoern Menze

Joint embeddings between medical imaging modalities and associated radiology reports have the potential to offer significant benefits to the clinical community, ranging from cross-domain retrieval to conditional generation of reports to the…

Machine Learning · Computer Science 2018-11-28 Tzu-Ming Harry Hsu , Wei-Hung Weng , Willie Boag , Matthew McDermott , Peter Szolovits

Radiology reports are a rich resource for advancing deep learning applications in medicine by leveraging the large volume of data continuously being updated, integrated, and shared. However, there are significant challenges as well, largely…

Information Retrieval · Computer Science 2017-11-21 Imon Banerjee , Sriraman Madhavan , Roger Eric Goldman , Daniel L. Rubin

Radiology Report Generation (RRG) aims to automatically generate diagnostic reports from radiology images. To achieve this, existing methods have leveraged the powerful cross-modal generation capabilities of Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Jiechao Gao , Chang Liu , Yuangang Li

Vision-Language Models (VLMs) have demonstrated remarkable success in natural language generation, excelling at instruction following and structured output generation. Knowledge graphs play a crucial role in radiology, serving as valuable…

Computation and Language · Computer Science 2025-05-26 Abdullah Abdullah , Seong Tae Kim

Generative models have revolutionized Artificial Intelligence (AI), particularly in multimodal applications. However, adapting these models to the medical domain poses unique challenges due to the complexity of medical data and the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Daniele Molino , Francesco di Feola , Linlin Shen , Paolo Soda , Valerio Guarrasi

Increasing demands on medical imaging departments are taking a toll on the radiologist's ability to deliver timely and accurate reports. Recent technological advances in artificial intelligence have demonstrated great potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Phillip Sloan , Philip Clatworthy , Edwin Simpson , Majid Mirmehdi

Medical imaging plays a pivotal role in diagnosis and treatment in clinical practice. Inspired by the significant progress in automatic image captioning, various deep learning (DL)-based methods have been proposed to generate radiology…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Yixin Wang , Zihao Lin , Zhe Xu , Haoyu Dong , Jiang Tian , Jie Luo , Zhongchao Shi , Yang Zhang , Jianping Fan , Zhiqiang He

A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at current examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination.…

Multimedia · Computer Science 2024-05-07 Zhichuan Wang , Kinhei Lee , Qiao Deng , Tiffany Y. So , Wan Hang Chiu , Yeung Yu Hui , Bingjing Zhou , Edward S. Hui

The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tiancheng Gu , Dongnan Liu , Zhiyuan Li , Weidong Cai

Large language models (LLMs) have demonstrated remarkable capabilities in various domains, including radiology report generation. Previous approaches have attempted to utilize multimodal LLMs for this task, enhancing their performance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Wenjun Hou , Yi Cheng , Kaishuai Xu , Heng Li , Yan Hu , Wenjie Li , Jiang Liu

The impression is crucial for the referring physicians to grasp key information since it is concluded from the findings and reasoning of radiologists. To alleviate the workload of radiologists and reduce repetitive human labor in impression…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jinpeng Hu , Zhihong Chen , Yang Liu , Xiang Wan , Tsung-Hui Chang

The objective of Radiology Report Generation (RRG) is to automatically generate coherent textual analyses of diseases based on radiological images, thereby alleviating the workload of radiologists. Current AI-based methods for RRG primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Tiancheng Gu , Kaicheng Yang , Xiang An , Ziyong Feng , Dongnan Liu , Weidong Cai

Ultrasound (US) report generation is a challenging task due to the variability of US images, operator dependence, and the need for standardized text. Unlike X-ray and CT, US imaging lacks consistent datasets, making automation difficult. In…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Peixuan Ge , Tongkun Su , Faqin Lv , Baoliang Zhao , Peng Zhang , Chi Hong Wong , Liang Yao , Yu Sun , Zenan Wang , Pak Kin Wong , Ying Hu

Harnessing the robust capabilities of Large Language Models (LLMs) for narrative generation, logical reasoning, and common-sense knowledge integration, this study delves into utilizing LLMs to enhance automated radiology report generation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yingshu Li , Zhanyu Wang , Yunyi Liu , Lei Wang , Lingqiao Liu , Luping Zhou

Automatic report generation has arisen as a significant research area in computer-aided diagnosis, aiming to alleviate the burden on clinicians by generating reports automatically based on medical images. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jun Li , Tongkun Su , Baoliang Zhao , Faqin Lv , Qiong Wang , Nassir Navab , Ying Hu , Zhongliang Jiang

Radiology report generation aims to automatically provide clinically meaningful descriptions of radiology images such as MRI and X-ray. Although great success has been achieved in natural scene image captioning tasks, radiology report…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Jun Wang , Lixing Zhu , Abhir Bhalerao , Yulan He

Radiology reporting generative AI holds significant potential to alleviate clinical workloads and streamline medical care. However, achieving high clinical accuracy is challenging, as radiological images often feature subtle lesions and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yijian Gao , Dominic Marshall , Xiaodan Xing , Junzhi Ning , Giorgos Papanastasiou , Guang Yang , Matthieu Komorowski

Advancements in generative Artificial Intelligence (AI) hold great promise for automating radiology workflows, yet challenges in interpretability and reliability hinder clinical adoption. This paper presents an automated radiology report…