English
Related papers

Related papers: Knowledge Matters: Radiology Report Generation wit…

200 papers

Medical imaging plays a pivotal role in diagnosis and treatment in clinical practice. Inspired by the significant progress in automatic image captioning, various deep learning (DL)-based methods have been proposed to generate radiology…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Yixin Wang , Zihao Lin , Zhe Xu , Haoyu Dong , Jiang Tian , Jie Luo , Zhongchao Shi , Yang Zhang , Jianping Fan , Zhiqiang He

Radiology reporting generative AI holds significant potential to alleviate clinical workloads and streamline medical care. However, achieving high clinical accuracy is challenging, as radiological images often feature subtle lesions and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yijian Gao , Dominic Marshall , Xiaodan Xing , Junzhi Ning , Giorgos Papanastasiou , Guang Yang , Matthieu Komorowski

Medical imaging is frequently used in clinical practice and trials for diagnosis and treatment. Writing imaging reports is time-consuming and can be error-prone for inexperienced radiologists. Therefore, automatically generating radiology…

Computation and Language · Computer Science 2022-04-29 Zhihong Chen , Yan Song , Tsung-Hui Chang , Xiang Wan

Automatic radiology report generation is challenging as medical images or reports are usually similar to each other due to the common content of anatomy. This makes a model hard to capture the uniqueness of individual images and is prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Bhanu Prakash Voutharoja , Lei Wang , Luping Zhou

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Medical report generation is a critical task in healthcare that involves the automatic creation of detailed and accurate descriptions from medical images. Traditionally, this task has been approached as a sequence generation problem,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yijian Fan , Zhenbang Yang , Rui Liu , Mingjie Li , Xiaojun Chang

Automatically generated reports from medical images promise to improve the workflow of radiologists. Existing methods consider an image-to-report modeling task by directly generating a fully-fledged report from an image. However, this…

Beyond the common difficulties faced in the natural image captioning, medical report generation specifically requires the model to describe a medical image with a fine-grained and semantic-coherence paragraph that should satisfy both…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Mingjie Li , Fuyu Wang , Xiaojun Chang , Xiaodan Liang

In clinical scenarios, multi-specialist consultation could significantly benefit the diagnosis, especially for intricate cases. This inspires us to explore a "multi-expert joint diagnosis" mechanism to upgrade the existing "single expert"…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Zhanyu Wang , Lingqiao Liu , Lei Wang , Luping Zhou

Knowledge Graph (KG) plays a crucial role in Medical Report Generation (MRG) because it reveals the relations among diseases and thus can be utilized to guide the generation process. However, constructing a comprehensive KG is…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yixin Wang , Zihao Lin , Haoyu Dong

Radiology report generation aims to automatically provide clinically meaningful descriptions of radiology images such as MRI and X-ray. Although great success has been achieved in natural scene image captioning tasks, radiology report…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Jun Wang , Lixing Zhu , Abhir Bhalerao , Yulan He

The automatic generation of radiology reports given medical radiographs has significant potential to operationally and improve clinical patient care. A number of prior works have focused on this problem, employing advanced methods from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Guanxiong Liu , Tzu-Ming Harry Hsu , Matthew McDermott , Willie Boag , Wei-Hung Weng , Peter Szolovits , Marzyeh Ghassemi

Decision support tools that rely on supervised learning require large amounts of expert annotations. Using past radiological reports obtained from hospital archiving systems has many advantages as training data above manual single-class…

Machine Learning · Computer Science 2021-05-21 Aydan Gasimova

Radiology Report Generation (RRG) aims to produce accurate and coherent diagnostics from medical images. Although large vision language models (LVLM) improve report fluency and accuracy, they exhibit hallucinations, generating plausible yet…

Computation and Language · Computer Science 2026-02-05 Ruixiao Yang , Yuanhe Tian , Xu Yang , Huiqi Li , Yan Song

Radiology report generation (RRG) has attracted significant attention due to its potential to reduce the workload of radiologists. Current RRG approaches are still unsatisfactory against clinical standards. This paper introduces a novel RRG…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Zijian Zhou , Miaojing Shi , Meng Wei , Oluwatosin Alabi , Zijie Yue , Tom Vercauteren

Harnessing the robust capabilities of Large Language Models (LLMs) for narrative generation, logical reasoning, and common-sense knowledge integration, this study delves into utilizing LLMs to enhance automated radiology report generation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yingshu Li , Zhanyu Wang , Yunyi Liu , Lei Wang , Lingqiao Liu , Luping Zhou

The increasing prevalence of retinal diseases poses a significant challenge to the healthcare system, as the demand for ophthalmologists surpasses the available workforce. This imbalance creates a bottleneck in diagnosis and treatment,…

Image and Video Processing · Electrical Eng. & Systems 2024-08-15 Jia-Hong Huang

Among all the sub-sections in a typical radiology report, the Clinical Indications, Findings, and Impression often reflect important details about the health status of a patient. The information included in Impression is also often covered…

Radiology reports are detailed text descriptions of the content of medical scans. Each report describes the presence/absence and location of relevant clinical findings, commonly including comparison with prior exams of the same patient to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Francesco Dalla Serra , Chaoyang Wang , Fani Deligianni , Jeffrey Dalton , Alison Q O'Neil

This paper explores the task of radiology report generation, which aims at generating free-text descriptions for a set of radiographs. One significant challenge of this task is how to correctly maintain the consistency between the images…

Computation and Language · Computer Science 2023-06-13 Wenjun Hou , Kaishuai Xu , Yi Cheng , Wenjie Li , Jiang Liu