English
Related papers

Related papers: Multimodal Image-Text Matching Improves Retrieval-…

200 papers

With the emergence of large-scale vision-language models, realistic radiology reports may be generated using only medical images as input guided by simple prompts. However, their practical utility has been limited due to the factual errors…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 R. Mahmood , K. C. L. Wong , D. M. Reyes , N. D'Souza , L. Shi , J. Wu , P. Kaviani , M. Kalra , G. Wang , P. Yan , T. Syeda-Mahmood

We introduce a radiology-focused visual language model designed to generate radiology reports from chest X-rays. Building on previous findings that large language models (LLMs) can acquire multimodal capabilities when aligned with…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xi Zhang , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho

Radiology report generation (RRG) aims to describe automatically a radiology image with human-like language and could potentially support the work of radiologists, reducing the burden of manual reporting. Previous approaches often adopt an…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Jun Wang , Abhir Bhalerao , Yulan He

Radiology Report Generation (RRG) through Vision-Language Models (VLMs) promises to reduce documentation burden, improve reporting consistency, and accelerate clinical workflows. However, their clinical adoption remains limited by the lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Marco Salmè , Federico Siciliano , Fabrizio Silvestri , Paolo Soda , Rosa Sicilia , Valerio Guarrasi

Interpreting electrocardiograms (ECGs) and generating comprehensive reports remain challenging tasks in cardiology, often requiring specialized expertise and significant time investment. To address these critical issues, we propose…

Machine Learning · Computer Science 2024-09-16 Jialu Tang , Tong Xia , Yuan Lu , Cecilia Mascolo , Aaqib Saeed

To address these issues, we propose a novel Adaptive patch-word Matching (AdaMatch) model to correlate chest X-ray (CXR) image regions with words in medical reports and apply it to CXR-report generation to provide explainability for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Wenting Chen , Linlin Shen , Jingyang Lin , Jiebo Luo , Xiang Li , Yixuan Yuan

Radiologists face high burnout rates, partially due to the increasing volume of Chest X-rays (CXRs) requiring interpretation and reporting. Automated CXR report generation holds promise for reducing this burden and improving patient care.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Aaron Nicolson , Jason Dowling , Bevan Koopman

A key challenge in training neural networks for a given medical imaging task is often the difficulty of obtaining a sufficient number of manually labeled examples. In contrast, textual imaging reports, which are often readily available in…

Machine Learning · Computer Science 2022-01-31 Gongbo Liang , Connor Greenwell , Yu Zhang , Xiaoqin Wang , Ramakanth Kavuluru , Nathan Jacobs

Radiology report generation (RRG) aims to automatically generate free-text descriptions from clinical radiographs, e.g., chest X-Ray images. RRG plays an essential role in promoting clinical automation and presents significant help to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Chang Liu , Yuanhe Tian , Yan Song

Retrieving visual and textual information from medical literature and hospital records can enhance diagnostic accuracy for clinical image interpretation. However, multimodal retrieval-augmented diagnosis is highly challenging. We explore a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Nir Mazor , Tom Hope

Medical imaging plays a crucial role in diagnosis, with radiology reports serving as vital documentation. Automating report generation has emerged as a critical need to alleviate the workload of radiologists. While machine learning has…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Ibrahim Ethem Hamamci , Sezgin Er , Bjoern Menze

Advancements in generative Artificial Intelligence (AI) hold great promise for automating radiology workflows, yet challenges in interpretability and reliability hinder clinical adoption. This paper presents an automated radiology report…

AI-assisted report generation offers the opportunity to reduce radiologists' workload stemming from expanded screening guidelines, complex cases and workforce shortages, while maintaining diagnostic accuracy. In addition to describing…

There is growing interest in applying AI to radiology report generation, particularly for chest X-rays (CXRs). This paper investigates whether incorporating pixel-level information through segmentation masks can improve fine-grained image…

Chest X-ray (CXR) reporting follows a region-based clinical workflow in which radiologists inspect anatomical regions and integrate localized findings into a final report. However, existing resources for CXR report generation provide these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yichen Zhao , Zelin Peng , Fenghe Tang , Piao Yang , Yu Huang , Wei Shen

Radiology report generation (RRG) models typically focus on individual exams, often overlooking the integration of historical visual or textual data, which is crucial for patient follow-ups. Traditional methods usually struggle with long…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Tengfei Liu , Jiapu Wang , Yongli Hu , Mingjie Li , Junfei Yi , Xiaojun Chang , Junbin Gao , Baocai Yin

Automating radiology report generation can ease the reporting workload for radiologists. However, existing works focus mainly on the chest area due to the limited availability of public datasets for other regions. Besides, they often rely…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Qi Chen , Yutong Xie , Biao Wu , Xiaomin Chen , James Ang , Minh-Son To , Xiaojun Chang , Qi Wu

This paper explores training medical vision-language models (VLMs) -- where the visual and language inputs are embedded into a common space -- with a particular focus on scenarios where training data is limited, as is often the case in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Rhydian Windsor , Amir Jamaludin , Timor Kadir , Andrew Zisserman

A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at current examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination.…

Multimedia · Computer Science 2024-05-07 Zhichuan Wang , Kinhei Lee , Qiao Deng , Tiffany Y. So , Wan Hang Chiu , Yeung Yu Hui , Bingjing Zhou , Edward S. Hui

AI-driven models have shown great promise in detecting errors in radiology reports, yet the field lacks a unified benchmark for rigorous evaluation of error detection and further correction. To address this gap, we introduce CorBenchX, a…

Artificial Intelligence · Computer Science 2025-05-20 Jing Zou , Qingqiu Li , Chenyu Lian , Lihao Liu , Xiaohan Yan , Shujun Wang , Jing Qin
‹ Prev 1 3 4 5 6 7 10 Next ›