English
Related papers

Related papers: Radiology Report Generation with Layer-Wise Anatom…

200 papers

Medical report generation demands automatic creation of coherent and precise descriptions for medical images. However, the scarcity of labelled medical image-report pairs poses formidable challenges in developing large-scale neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shibin Wu , Bang Yang , Zhiyu Ye , Haoqian Wang , Hairong Zheng , Tong Zhang

Radiology Report Generation (R2Gen) demonstrates how Multi-modal Large Language Models (MLLMs) can automate the creation of accurate and coherent radiological reports. Existing methods often hallucinate details in text-based reports that…

Computation and Language · Computer Science 2024-07-19 Manav Nitin Kapadnis , Sohan Patnaik , Abhilash Nandy , Sourjyadip Ray , Pawan Goyal , Debdoot Sheet

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art (SOTA) methods has been a challenge due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Saurav Sengupta , Donald E. Brown

We propose and demonstrate a novel machine learning algorithm that assesses pulmonary edema severity from chest radiographs. While large publicly available datasets of chest radiographs and free-text radiology reports exist, only limited…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Geeticka Chauhan , Ruizhi Liao , William Wells , Jacob Andreas , Xin Wang , Seth Berkowitz , Steven Horng , Peter Szolovits , Polina Golland

Existing deep learning models for chest radiology often neglect patient metadata, limiting diagnostic accuracy and fairness. To bridge this gap, we introduce MetaCheX, a novel multimodal framework that integrates chest X-ray images with…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Nathan He , Cody Chen

Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. These systems have achieved promising…

Computation and Language · Computer Science 2022-10-25 Jean-Benoit Delbrouck , Pierre Chambon , Christian Bluethgen , Emily Tsai , Omar Almusa , Curtis P. Langlotz

Vision-language models (VLM) have markedly advanced AI-driven interpretation and reporting of complex medical imaging, such as computed tomography (CT). Yet, existing methods largely relegate clinicians to passive observers of final…

With the emergence of vision language models in the medical imaging domain, numerous studies have focused on two dominant research activities: (1) report generation from Chest X-rays (CXR), and (2) synthetic scan generation from text or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Santosh Sanjeev , Fadillah Adamsyah Maani , Arsen Abzhanov , Vijay Ram Papineni , Ibrahim Almakky , Bartłomiej W. Papież , Mohammad Yaqub

Multimodal Large Language Models (MLLMs) have shown strong potential for radiology report generation, yet their clinical translation is hindered by architectural heterogeneity and the prevalence of factual hallucinations. Standard…

Machine Learning · Computer Science 2026-01-13 Kun Zhao , Siyuan Dai , Pan Wang , Jifeng Song , Hui Ji , Chenghua Lin , Liang Zhan , Haoteng Tang

The world faces a shortage of radiologists, leading to longer treatment times and increased stress, negatively impacting patient safety and workforce morale. Integrating artificial intelligence to interpret radiographic images and generate…

Image and Video Processing · Electrical Eng. & Systems 2024-06-19 Marijn Borghouts

We present a novel approach to Chest X-ray (CXR) Visual Question Answering (VQA), addressing both single-image image-difference questions. Single-image questions focus on abnormalities within a specific CXR ("What abnormalities are seen in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Francesco Dalla Serra , Patrick Schrempf , Chaoyang Wang , Zaiqiao Meng , Fani Deligianni , Alison Q. O'Neil

Radiologists play a crucial role in translating medical images into actionable reports. However, the field faces staffing shortages and increasing workloads. While automated approaches using vision-language models (VLMs) show promise as…

Radiology report generation (RRG) aims to describe automatically a radiology image with human-like language and could potentially support the work of radiologists, reducing the burden of manual reporting. Previous approaches often adopt an…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Jun Wang , Abhir Bhalerao , Yulan He

The widespread use of chest X-rays (CXRs), coupled with a shortage of radiologists, has driven growing interest in automated CXR analysis and AI-assisted reporting. While existing vision-language models (VLMs) show promise in specific tasks…

Automated CT report generation plays a crucial role in improving diagnostic accuracy and clinical workflow efficiency. However, existing methods lack interpretability and impede patient-clinician understanding, while their static nature…

Image and Video Processing · Electrical Eng. & Systems 2025-03-06 Yannian Gu , Wenhui Lei , Hanyu Chen , Xiaofan Zhang , Shaoting Zhang

The extraction of structured clinical information from free-text radiology reports in the form of radiology graphs has been demonstrated to be a valuable approach for evaluating the clinical correctness of report-generation methods.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yiheng Xiong , Jingsong Liu , Kamilia Zaripova , Sahand Sharifzadeh , Matthias Keicher , Nassir Navab

Radiology reports are critical for clinical decision-making but often lack a standardized format, limiting both human interpretability and machine learning (ML) applications. While large language models (LLMs) have shown strong capabilities…

Computation and Language · Computer Science 2025-07-15 Johannes Moll , Louisa Fay , Asfandyar Azhar , Sophie Ostmeier , Tim Lueth , Sergios Gatidis , Curtis Langlotz , Jean-Benoit Delbrouck

Automatic radiology report generation is essential to computer-aided diagnosis. Through the success of image captioning, medical report generation has been achievable. However, the lack of annotated disease labels is still the bottleneck of…

Computation and Language · Computer Science 2022-06-22 Jun Li , Shibo Li , Ying Hu , Huiren Tao

Radiology report generation aims to automatically generate a clinically accurate and coherent paragraph from the X-ray image, which could relieve radiologists from the heavy burden of report writing. Although various image caption methods…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Zhongzhen Huang , Xiaofan Zhang , Shaoting Zhang

Recently large vision-language models have shown potential when interpreting complex images and generating natural language descriptions using advanced reasoning. Medicine's inherently multimodal nature incorporating scans and text-based…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Naman Sharma