English
Related papers

Related papers: Cross-modal Memory Networks for Radiology Report G…

200 papers

Medical report generation task, which targets to produce long and coherent descriptions of medical images, has attracted growing research interests recently. Different from the general image captioning tasks, medical report generation is…

Computation and Language · Computer Science 2023-04-12 Fenglin Liu , Shen Ge , Yuexian Zou , Xian Wu

Automatically generating medical reports for retinal images is one of the promising ways to help ophthalmologists reduce their workload and improve work efficiency. In this work, we propose a new context-driven encoding network to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jia-Hong Huang , Ting-Wei Wu , Chao-Han Huck Yang , Marcel Worring

Automated radiology report generation aims to expedite the tedious and error-prone reporting process for radiologists. While recent works have made progress, learning to align medical images and textual findings remains challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yaxiong Chen , Chuang Du , Chunlei Li , Jingliang Hu , Yilei Shi , Shengwu Xiong , Xiao Xiang Zhu , Lichao Mou

Radiology report generation (RRG) aims to automatically generate free-text descriptions from clinical radiographs, e.g., chest X-Ray images. RRG plays an essential role in promoting clinical automation and presents significant help to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Chang Liu , Yuanhe Tian , Yan Song

Chest X-ray is one of the most popular medical imaging modalities due to its accessibility and effectiveness. However, there is a chronic shortage of well-trained radiologists who can interpret these images and diagnose the patient's…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Otabek Nazarov , Mohammad Yaqub , Karthik Nandakumar

Automated Radiology report generation (RRG) aims at producing detailed descriptions of medical images, reducing radiologists' workload and improving access to high-quality diagnostic services. Existing encoder-decoder models only rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Quang Vinh Nguyen , Minh Duc Nguyen , Thanh Hoang Son Vo , Hyung-Jeong Yang , Soo-Hyung Kim

Automating radiology report generation can ease the reporting workload for radiologists. However, existing works focus mainly on the chest area due to the limited availability of public datasets for other regions. Besides, they often rely…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Qi Chen , Yutong Xie , Biao Wu , Xiaomin Chen , James Ang , Minh-Son To , Xiaojun Chang , Qi Wu

Generative models have revolutionized Artificial Intelligence (AI), particularly in multimodal applications. However, adapting these models to the medical domain poses unique challenges due to the complexity of medical data and the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Daniele Molino , Francesco di Feola , Linlin Shen , Paolo Soda , Valerio Guarrasi

Cross-modality image estimation involves the generation of images of one medical imaging modality from that of another modality. Convolutional neural networks (CNNs) have been shown to be useful in identifying, characterising and extracting…

Image and Video Processing · Electrical Eng. & Systems 2021-06-07 Azin Shokraei Fard , David C. Reutens , Viktor Vegh

Recent advances in deep learning have enabled researchers to explore tasks at the intersection of computer vision and natural language processing, such as image captioning, visual question answering, visual dialogue, and visual language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sonit Singh

Radiology reports are detailed text descriptions of the content of medical scans. Each report describes the presence/absence and location of relevant clinical findings, commonly including comparison with prior exams of the same patient to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Francesco Dalla Serra , Chaoyang Wang , Fani Deligianni , Jeffrey Dalton , Alison Q O'Neil

Automating radiology report generation can significantly reduce the workload of radiologists and enhance the accuracy, consistency, and efficiency of clinical documentation.We propose a novel cross-modal framework that uses MedCLIP as both…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Qianhao Han , Junyi Liu , Zengchang Qin , Zheng Zheng

Radiology Report Generation (RRG) is essential for computer-aided diagnosis and medication guidance, which can relieve the heavy burden of radiologists by automatically generating the corresponding radiology reports according to the given…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Weixing Chen , Yang Liu , Ce Wang , Jiarui Zhu , Guanbin Li , Cheng-Lin Liu , Liang Lin

Automatic medical image report generation has drawn growing attention due to its potential to alleviate radiologists' workload. Existing work on report generation often trains encoder-decoder networks to generate complete reports. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Jianmo Ni , Chun-Nan Hsu , Amilcare Gentili , Julian McAuley

Automatic generation of ophthalmic reports using data-driven neural networks has great potential in clinical practice. When writing a report, ophthalmologists make inferences with prior clinical knowledge. This knowledge has been neglected…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Mingjie Li , Wenjia Cai , Karin Verspoor , Shirui Pan , Xiaodan Liang , Xiaojun Chang

Automated generation of clinically accurate radiology reports can improve patient care. Previous report generation methods that rely on image captioning models often generate incoherent and incorrect text due to their lack of relevant…

Radiology report generation (RRG) is commonly formulated as a single-path generation task, where a multimodal large language model (MLLM) produces one decoded report as the final output. While recent progress has largely been driven by…

Computation and Language · Computer Science 2026-05-29 Xi Zhang , Yingshu Li , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho

In response to the worldwide COVID-19 pandemic, advanced automated technologies have emerged as valuable tools to aid healthcare professionals in managing an increased workload by improving radiology report generation and prognostic…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Zhusi Zhong , Jie Li , John Sollee , Scott Collins , Harrison Bai , Paul Zhang , Terrence Healey , Michael Atalay , Xinbo Gao , Zhicheng Jiao

Synthesized medical images have several important applications, e.g., as an intermedium in cross-modality image registration and as supplementary training samples to boost the generalization capability of a classifier. Especially,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Zizhao Zhang , Lin Yang , Yefeng Zheng

Automatic radiology report generation is critical in clinics which can relieve experienced radiologists from the heavy workload and remind inexperienced radiologists of misdiagnosis or missed diagnose. Existing approaches mainly formulate…

Image and Video Processing · Electrical Eng. & Systems 2022-11-08 Shuxin Yang , Xian Wu , Shen Ge , Shaohua Kevin Zhou , Li Xiao