English
Related papers

Related papers: Image-aware Evaluation of Generated Medical Report…

200 papers

Automated medical report generation (MRG) holds great promise for reducing the heavy workload of radiologists. However, its clinical deployment is hindered by three major sources of uncertainty. First, visual uncertainty, caused by noisy or…

Artificial Intelligence · Computer Science 2026-01-23 Yuhang Gu , Xingyu Hu , Yuyu Fan , Xulin Yan , Longhuan Xu , Peng peng

Automated radiology report generation from chest X-ray (CXR) images has the potential to improve clinical efficiency and reduce radiologists' workload. However, most datasets, including the publicly available MIMIC-CXR and CheXpert Plus,…

Evaluating radiology reports is a challenging problem as factual correctness is extremely important due to the need for accurate medical communication about medical images. Existing automatic evaluation metrics either suffer from failing to…

Medical report generation is the task of automatically writing radiology reports for chest X-ray images. Manually composing these reports is a time-consuming process that is also prone to human errors. Generating medical reports can…

Computation and Language · Computer Science 2024-10-22 Abdullah , Ameer Hamza , Seong Tae Kim

Medical errors are a major public health concern and a leading cause of death worldwide. Many healthcare centers and hospitals use reporting systems where medical practitioners write a preliminary medical report and the report is later…

Information Retrieval · Computer Science 2020-05-01 Sean MacAvaney , Arman Cohan , Nazli Goharian , Ross Filice

Generative Artificial Intelligence (AI) can be used to automatically generate medical reports based on transcripts of medical consultations. The aim is to reduce the administrative burden that healthcare professionals face. The accuracy of…

Computation and Language · Computer Science 2024-01-09 Wouter Faber , Renske Eline Bootsma , Tom Huibers , Sandra van Dulmen , Sjaak Brinkkemper

Writing reports by analyzing medical images is error-prone for inexperienced practitioners and time consuming for experienced ones. In this work, we present RepsNet that adapts pre-trained vision and language models to interpret medical…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Ajay Kumar Tanwani , Joelle Barral , Daniel Freedman

Automatic radiology report generation is challenging as medical images or reports are usually similar to each other due to the common content of anatomy. This makes a model hard to capture the uniqueness of individual images and is prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Bhanu Prakash Voutharoja , Lei Wang , Luping Zhou

Radiology report generation aims at generating descriptive text from radiology images automatically, which may present an opportunity to improve radiology reporting and interpretation. A typical setting consists of training encoder-decoder…

Computation and Language · Computer Science 2021-09-28 An Yan , Zexue He , Xing Lu , Jiang Du , Eric Chang , Amilcare Gentili , Julian McAuley , Chun-Nan Hsu

In the generative AI era, where even critical medical tasks are increasingly automated, radiology report generation (RRG) continues to rely on suboptimal metrics for quality assessment. Developing domain-specific metrics has therefore been…

Computation and Language · Computer Science 2026-01-19 Vanshali Sharma , Andrea Mia Bejar , Gorkem Durak , Ulas Bagci

Radiology report generation (RRG) aims to automatically produce diagnostic reports from medical images, with the potential to enhance clinical workflows and reduce radiologists' workload. While recent approaches leveraging multimodal large…

Artificial Intelligence · Computer Science 2025-05-16 Ziruo Yi , Ting Xiao , Mark V. Albert

Evaluating image captions typically relies on reference captions, which are costly to obtain and exhibit significant diversity and subjectivity. While reference-free evaluation metrics have been proposed, most focus on cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Tianyu Cui , Jinbin Bai , Guo-Hua Wang , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Ye Shi

Oversight AI is an emerging concept in radiology where the AI forms a symbiosis with radiologists by continuously supporting radiologists in their decision-making. Recent advances in vision-language models sheds a light on the long-standing…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Sangjoon Park , Eun Sun Lee , Kyung Sook Shin , Jeong Eun Lee , Jong Chul Ye

Automatic extraction of medical conditions from free-text radiology reports is critical for supervising computer vision models to interpret medical images. In this work, we show that radiologists labeling reports significantly disagree with…

Image and Video Processing · Electrical Eng. & Systems 2021-03-16 Saahil Jain , Akshay Smit , Steven QH Truong , Chanh DT Nguyen , Minh-Thanh Huynh , Mudit Jain , Victoria A. Young , Andrew Y. Ng , Matthew P. Lungren , Pranav Rajpurkar

Radiology reports for the same patient examination may contain clinically meaningful discrepancies arising from interpretation differences, reporting variability, or evolving assessments. Systematic analysis of such discrepancies is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zhaoyi Sun , Minal Jagtiani , Wen-wai Yim , Fei Xia , Martin Gunn , Meliha Yetisgen , Asma Ben Abacha

Given the rapidly expanding capabilities of generative AI models for radiology, there is a need for robust metrics that can accurately measure the quality of AI-generated radiology reports across diverse hospitals. We develop…

Recent advancements in artificial intelligence have significantly improved the automatic generation of radiology reports. However, existing evaluation methods fail to reveal the models' understanding of radiological images and their…

Artificial Intelligence · Computer Science 2024-08-27 Xiaoman Zhang , Julián N. Acosta , Hong-Yu Zhou , Pranav Rajpurkar

Medical report generation is a critical task in healthcare that involves the automatic creation of detailed and accurate descriptions from medical images. Traditionally, this task has been approached as a sequence generation problem,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yijian Fan , Zhenbang Yang , Rui Liu , Mingjie Li , Xiaojun Chang

Radiology reports play a critical role in communicating medical findings to physicians. In each report, the impression section summarizes essential radiology findings. In clinical practice, writing impression is highly demanded yet…

Computation and Language · Computer Science 2021-12-21 Jinpeng Hu , Jianling Li , Zhihong Chen , Yaling Shen , Yan Song , Xiang Wan , Tsung-Hui Chang

Assessing the artness of AI-generated images continues to be a challenge within the realm of image generation. Most existing metrics cannot be used to perform instance-level and reference-free artness evaluation. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Junyu Chen , Jie An , Hanjia Lyu , Christopher Kanan , Jiebo Luo