English
Related papers

Related papers: Clinically Accurate Chest X-Ray Report Generation

200 papers

Radiology report generation (RRG) is commonly formulated as a single-path generation task, where a multimodal large language model (MLLM) produces one decoded report as the final output. While recent progress has largely been driven by…

Computation and Language · Computer Science 2026-05-29 Xi Zhang , Yingshu Li , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho

We propose a new automated evaluation metric for machine-generated radiology reports using the successful COMET architecture adapted for the radiology domain. We train and publish four medically-oriented model checkpoints, including one…

Computation and Language · Computer Science 2023-11-29 Amos Calamida , Farhad Nooralahzadeh , Morteza Rohanian , Koji Fujimoto , Mizuho Nishio , Michael Krauthammer

Traumatic brain injuries present significant diagnostic challenges in emergency medicine, where the timely interpretation of medical images is crucial for patient outcomes. In this paper, we propose a novel AI-based approach for automatic…

Image and Video Processing · Electrical Eng. & Systems 2025-10-10 Riadh Bouslimi , Houda Trabelsi , Wahiba Ben Abdssalem Karaa , Hana Hedhli

Automated radiographic report generation is a challenging cross-domain task that aims to automatically generate accurate and semantic-coherence reports to describe medical images. Despite the recent progress in this field, there are still…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zhanyu Wang , Mingkang Tang , Lei Wang , Xiu Li , Luping Zhou

Evaluating radiology reports is a challenging problem as factual correctness is extremely important due to the need for accurate medical communication about medical images. Existing automatic evaluation metrics either suffer from failing to…

We present a novel approach to Chest X-ray (CXR) Visual Question Answering (VQA), addressing both single-image image-difference questions. Single-image questions focus on abnormalities within a specific CXR ("What abnormalities are seen in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Francesco Dalla Serra , Patrick Schrempf , Chaoyang Wang , Zaiqiao Meng , Fani Deligianni , Alison Q. O'Neil

Clinical practice frequently uses medical imaging for diagnosis and treatment. A significant challenge for automatic radiology report generation is that the radiology reports are long narratives consisting of multiple sentences for both…

Computation and Language · Computer Science 2023-07-03 Kaveri Kale , pushpak Bhattacharyya , Kshitij Jadhav

Automated Radiology report generation (RRG) aims at producing detailed descriptions of medical images, reducing radiologists' workload and improving access to high-quality diagnostic services. Existing encoder-decoder models only rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Quang Vinh Nguyen , Minh Duc Nguyen , Thanh Hoang Son Vo , Hyung-Jeong Yang , Soo-Hyung Kim

When pneumonia is not found on a chest X-ray, should the report describe this negative observation or omit it? We argue that this question cannot be answered from the X-ray alone and requires a pragmatic perspective, which captures the…

Computation and Language · Computer Science 2023-11-30 Dang Nguyen , Chacha Chen , He He , Chenhao Tan

Background: Ultrasound is one of the preferred choices for early screening of dense breast cancer. Clinically, doctors have to manually write the screening report which is time-consuming and laborious, and it is easy to miss and miswrite.…

Image and Video Processing · Electrical Eng. & Systems 2022-05-24 Shuang Ge , Qiongyu Ye , Wenquan Xie , Desheng Sun , Huabin Zhang , Xiaobo Zhou , Kehong Yuan

Recent advances in deep learning and natural language generation have significantly improved image captioning, enabling automated, human-like descriptions for visual content. In this work, we apply these captioning techniques to generate…

Computation and Language · Computer Science 2024-12-06 Amnon Bleich , Antje Linnemann , Bjoern H. Diem , Tim OF Conrad

In clinical radiology reports, doctors capture important information about the patient's health status. They convey their observations from raw medical imaging data about the inner structures of a patient. As such, formulating reports…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Constantin Seibold , Simon Reiß , Saquib Sarfraz , Matthias A. Fink , Victoria Mayer , Jan Sellner , Moon Sung Kim , Klaus H. Maier-Hein , Jens Kleesiek , Rainer Stiefelhagen

Automatic medical report generation (MRG) is of great research value as it has the potential to relieve radiologists from the heavy burden of report writing. Despite recent advancements, accurate MRG remains challenging due to the need for…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Haibo Jin , Haoxuan Che , Yi Lin , Hao Chen

Despite the progress of radiology report generation (RRG), existing works face two challenges: 1) The performances in clinical efficacy are unsatisfactory, especially for lesion attributes description; 2) the generated text lacks…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Haibo Jin , Haoxuan Che , Sunan He , Hao Chen

Automated diagnostic assistants in healthcare necessitate accurate AI models that can be trained with limited labeled data, can cope with severe class imbalances and can support simultaneous prediction of multiple disease conditions. To…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Deepta Rajan , Jayaraman J. Thiagarajan , Alexandros Karargyris , Satyananda Kashyap

Clinical systems operate in safety-critical environments and are not intended to function autonomously; however, they are currently designed to replicate clinicians' diagnoses rather than assist them in the diagnostic process. To enable…

Human-Computer Interaction · Computer Science 2025-04-07 Kailas Dayanandan , Brejesh Lall

Existing metrics often lack the granularity and interpretability to capture nuanced clinical differences between candidate and ground-truth radiology reports, resulting in suboptimal evaluation. We introduce a Clinically-grounded tabular…

Automatic radiology report generation is challenging as medical images or reports are usually similar to each other due to the common content of anatomy. This makes a model hard to capture the uniqueness of individual images and is prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Bhanu Prakash Voutharoja , Lei Wang , Luping Zhou

The latest breakthroughs in large vision-language models, such as Bard and GPT-4, have showcased extraordinary abilities in performing a wide range of tasks. Such models are trained on massive datasets comprising billions of public…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Omkar Thawakar , Abdelrahman Shaker , Sahal Shaji Mullappilly , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Jorma Laaksonen , Fahad Shahbaz Khan

Mammography report generation is a critical yet underexplored task in medical AI, characterized by challenges such as multiview image reasoning, high-resolution visual cues, and unstructured radiologic language. In this work, we introduce…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Nak-Jun Sung , Donghyun Lee , Bo Hwa Choi , Chae Jung Park