English
Related papers

Related papers: Radiology-Aware Model-Based Evaluation Metric for …

200 papers

Automatic medical report generation has the potential to support clinical diagnosis, reduce the workload of radiologists, and demonstrate potential for enhancing diagnostic consistency. However, current evaluation metrics often fail to…

Computation and Language · Computer Science 2025-08-06 Zhenxuan Zhang , Kinhei Lee , Peiyuan Jing , Weihang Deng , Huichi Zhou , Zihao Jin , Jiahao Huang , Zhifan Gao , Dominic C Marshall , Yingying Fang , Guang Yang

In medical reporting, the accuracy of radiological reports, whether generated by humans or machine learning algorithms, is critical. We tackle a new task in this paper: image-conditioned autocorrection of inaccuracies within these reports.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Arnold Caleb Asiimwe , Dídac Surís , Pranav Rajpurkar , Carl Vondrick

There is growing interest in generating skeleton-based human motions from natural language descriptions. While most efforts have focused on developing better neural architectures for this task, there has been no significant work on…

Computation and Language · Computer Science 2023-09-20 Jordan Voas , Yili Wang , Qixing Huang , Raymond Mooney

Automatic radiology report generation is critical in clinics which can relieve experienced radiologists from the heavy workload and remind inexperienced radiologists of misdiagnosis or missed diagnose. Existing approaches mainly formulate…

Image and Video Processing · Electrical Eng. & Systems 2022-11-08 Shuxin Yang , Xian Wu , Shen Ge , Shaohua Kevin Zhou , Li Xiao

We introduce RadEval, a unified, open-source framework for evaluating radiology texts. RadEval consolidates a diverse range of metrics, from classic n-gram overlap (BLEU, ROUGE) and contextual measures (BERTScore) to clinical concept-based…

Existing metrics often lack the granularity and interpretability to capture nuanced clinical differences between candidate and ground-truth radiology reports, resulting in suboptimal evaluation. We introduce a Clinically-grounded tabular…

Extracting structured clinical information from free-text radiology reports can enable the use of radiology report information for a variety of critical healthcare applications. In our work, we present RadGraph, a dataset of entities and…

We present COMET, a neural framework for training multilingual machine translation evaluation models which obtains new state-of-the-art levels of correlation with human judgements. Our framework leverages recent breakthroughs in…

Computation and Language · Computer Science 2020-10-20 Ricardo Rei , Craig Stewart , Ana C Farinha , Alon Lavie

Automatic radiology report generation is essential to computer-aided diagnosis. Through the success of image captioning, medical report generation has been achievable. However, the lack of annotated disease labels is still the bottleneck of…

Computation and Language · Computer Science 2022-06-22 Jun Li , Shibo Li , Ying Hu , Huiren Tao

Radiology reports remain the primary mechanism by which imaging findings are communicated to clinical teams. However, much of the structured information behind these reports, including measurements, image evidence, prior comparisons, lesion…

Computation and Language · Computer Science 2026-05-26 Houman Kazemzadeh , Kamyar Naderi

Recent advances in deep learning have enabled researchers to explore tasks at the intersection of computer vision and natural language processing, such as image captioning, visual question answering, visual dialogue, and visual language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sonit Singh

With the emergence of large-scale vision-language models, realistic radiology reports may be generated using only medical images as input guided by simple prompts. However, their practical utility has been limited due to the factual errors…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 R. Mahmood , K. C. L. Wong , D. M. Reyes , N. D'Souza , L. Shi , J. Wu , P. Kaviani , M. Kalra , G. Wang , P. Yan , T. Syeda-Mahmood

Radiology reports contain a diverse and rich set of clinical abnormalities documented by radiologists during their interpretation of the images. Comprehensive semantic representations of radiological findings would enable a wide range of…

Computation and Language · Computer Science 2021-12-28 Wilson Lau , Kevin Lybarger , Martin L. Gunn , Meliha Yetisgen

Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-31 Jiayu Lei , Xiaoman Zhang , Chaoyi Wu , Lisong Dai , Ya Zhang , Yanyong Zhang , Yanfeng Wang , Weidi Xie , Yuehua Li

Radiology reports are highly technical documents aimed primarily at doctor-doctor communication. There has been an increasing interest in sharing those reports with patients, necessitating providing them patient-friendly simplifications of…

Computation and Language · Computer Science 2024-06-28 Ziyu Yang , Santhosh Cherian , Slobodan Vucetic

Obtaining automated preliminary read reports for common exams such as chest X-rays will expedite clinical workflows and improve operational efficiencies in hospitals. However, the quality of reports generated by current automated approaches…

Evaluating automatically generated text is generally hard due to the inherently subjective nature of many aspects of the output quality. This difficulty is compounded in automatic consultation note generation by differing opinions between…

Computation and Language · Computer Science 2022-11-18 Aleksandar Savkov , Francesco Moramarco , Alex Papadopoulos Korfiatis , Mark Perera , Anya Belz , Ehud Reiter

In recent years, machine learning models have rapidly become better at generating clinical consultation notes; yet, there is little work on how to properly evaluate the generated consultation notes to understand the impact they may have on…

Computation and Language · Computer Science 2022-04-04 Francesco Moramarco , Alex Papadopoulos Korfiatis , Mark Perera , Damir Juric , Jack Flann , Ehud Reiter , Anya Belz , Aleksandar Savkov

Medical imaging plays a pivotal role in diagnosis and treatment in clinical practice. Inspired by the significant progress in automatic image captioning, various deep learning (DL)-based methods have been proposed to generate radiology…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Yixin Wang , Zihao Lin , Zhe Xu , Haoyu Dong , Jiang Tian , Jie Luo , Zhongchao Shi , Yang Zhang , Jianping Fan , Zhiqiang He

Automatic extraction of medical conditions from free-text radiology reports is critical for supervising computer vision models to interpret medical images. In this work, we show that radiologists labeling reports significantly disagree with…

Image and Video Processing · Electrical Eng. & Systems 2021-03-16 Saahil Jain , Akshay Smit , Steven QH Truong , Chanh DT Nguyen , Minh-Thanh Huynh , Mudit Jain , Victoria A. Young , Andrew Y. Ng , Matthew P. Lungren , Pranav Rajpurkar