English
Related papers

Related papers: Replace and Report: NLP Assisted Radiology Report …

200 papers

Radiology report generation represents a significant application within medical AI, and has achieved impressive results. Concurrently, large language models (LLMs) have demonstrated remarkable performance across various domains. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Haifeng Zhao , Yufei Zhang , Leilei Ma , Shuo Xu , Dengdi Sun

Multimodal models trained on large natural image-text pair datasets have exhibited astounding abilities in generating high-quality images. Medical imaging data is fundamentally different to natural images, and the language used to…

Harnessing the robust capabilities of Large Language Models (LLMs) for narrative generation, logical reasoning, and common-sense knowledge integration, this study delves into utilizing LLMs to enhance automated radiology report generation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yingshu Li , Zhanyu Wang , Yunyi Liu , Lei Wang , Lingqiao Liu , Luping Zhou

Evaluating radiology reports is a challenging problem as factual correctness is extremely important due to the need for accurate medical communication about medical images. Existing automatic evaluation metrics either suffer from failing to…

Evaluating long-context radiology report generation is challenging. NLG metrics fail to capture clinical correctness, while LLM-based metrics often lack generalizability. Clinical accuracy metrics are more relevant but are sensitive to…

Computation and Language · Computer Science 2025-05-26 Ibrahim Ethem Hamamci , Sezgin Er , Suprosanna Shit , Hadrien Reynaud , Bernhard Kainz , Bjoern Menze

Automatically generating medical reports for retinal images is one of the promising ways to help ophthalmologists reduce their workload and improve work efficiency. In this work, we propose a new context-driven encoding network to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jia-Hong Huang , Ting-Wei Wu , Chao-Han Huck Yang , Marcel Worring

Radiology reports are invaluable for clinical decision-making and hold great potential for automated analysis when structured into machine-readable formats. These reports often contain uncertainty, which we categorize into two distinct…

Computation and Language · Computer Science 2026-03-02 Paloma Rabaey , Jong Hak Moon , Jung-Oh Lee , Min Gwan Kim , Hangyul Yoon , Thomas Demeester , Edward Choi

Medical report generation is one of the most challenging tasks in medical image analysis. Although existing approaches have achieved promising results, they either require a predefined template database in order to retrieve sentences or…

Computation and Language · Computer Science 2021-06-14 Xingyi Yang , Muchao Ye , Quanzeng You , Fenglong Ma

Chest X-ray is one of the most popular medical imaging modalities due to its accessibility and effectiveness. However, there is a chronic shortage of well-trained radiologists who can interpret these images and diagnose the patient's…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Otabek Nazarov , Mohammad Yaqub , Karthik Nandakumar

Radiology plays a pivotal role in modern medicine due to its non-invasive diagnostic capabilities. However, the manual generation of unstructured medical reports is time consuming and prone to errors. It creates a significant bottleneck in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Md. Rakibul Islam , Md. Zahid Hossain , Mustofa Ahmed , Most. Sharmin Sultana Samu

Automated radiology report generation aims at automatically generating a detailed description of medical images, which can greatly alleviate the workload of radiologists and provide better medical services to remote areas. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yuhao Wang , Kai Wang , Xiaohong Liu , Tianrun Gao , Jingyue Zhang , Guangyu Wang

This study investigates the integration of diverse patient data sources into multimodal language models for automated chest X-ray (CXR) report generation. Traditionally, CXR report generation relies solely on CXR images and limited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Aaron Nicolson , Shengyao Zhuang , Jason Dowling , Bevan Koopman

Vision-language pretraining has been shown to produce high-quality visual encoders which transfer efficiently to downstream computer vision tasks. Contrastive learning approaches have increasingly been adopted for medical vision language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Keegan Quigley , Miriam Cha , Josh Barua , Geeticka Chauhan , Seth Berkowitz , Steven Horng , Polina Golland

The Impression section of a radiology report summarizes crucial radiology findings in natural language and plays a central role in communicating these findings to physicians. However, the process of generating impressions by summarizing…

Computation and Language · Computer Science 2018-10-10 Yuhao Zhang , Daisy Yi Ding , Tianpei Qian , Christopher D. Manning , Curtis P. Langlotz

Anatomical abnormality detection and report generation of chest X-ray (CXR) are two essential tasks in clinical practice. The former aims at localizing and characterizing cardiopulmonary radiological findings in CXRs, while the latter…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Jinghan Sun , Dong Wei , Zhe Xu , Donghuan Lu , Hong Liu , Hong Wang , Sotirios A. Tsaftaris , Steven McDonagh , Yefeng Zheng , Liansheng Wang

Despite the progress of radiology report generation (RRG), existing works face two challenges: 1) The performances in clinical efficacy are unsatisfactory, especially for lesion attributes description; 2) the generated text lacks…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Haibo Jin , Haoxuan Che , Sunan He , Hao Chen

Radiology reporting is a complex task requiring detailed medical image understanding and precise language generation, for which generative multimodal models offer a promising solution. However, to impact clinical practice, models must…

There is growing interest in applying AI to radiology report generation, particularly for chest X-rays (CXRs). This paper investigates whether incorporating pixel-level information through segmentation masks can improve fine-grained image…

The increasing prevalence of retinal diseases poses a significant challenge to the healthcare system, as the demand for ophthalmologists surpasses the available workforce. This imbalance creates a bottleneck in diagnosis and treatment,…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Jia-Hong Huang

Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-31 Jiayu Lei , Xiaoman Zhang , Chaoyi Wu , Lisong Dai , Ya Zhang , Yanyong Zhang , Yanfeng Wang , Weidi Xie , Yuehua Li