English
Related papers

Related papers: Resource-Efficient Medical Report Generation using…

200 papers

The increasing demand for medical imaging has surpassed the capacity of available radiologists, leading to diagnostic delays and potential misdiagnoses. Artificial intelligence (AI) techniques, particularly in automatic medical report…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Li Guo , Anas M. Tahir , Dong Zhang , Z. Jane Wang , Rabab K. Ward

Accurately interpreting medical images and writing radiology reports is a critical but challenging task in healthcare. Both human-written and AI-generated reports can contain errors, ranging from clinical inaccuracies to linguistic…

Computation and Language · Computer Science 2024-09-18 Vishwanatha M. Rao , Serena Zhang , Julian N. Acosta , Subathra Adithan , Pranav Rajpurkar

The latest breakthroughs in large vision-language models, such as Bard and GPT-4, have showcased extraordinary abilities in performing a wide range of tasks. Such models are trained on massive datasets comprising billions of public…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Omkar Thawakar , Abdelrahman Shaker , Sahal Shaji Mullappilly , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Jorma Laaksonen , Fahad Shahbaz Khan

X-ray image based medical report generation achieves significant progress in recent years with the help of the large language model, however, these models have not fully exploited the effective information in visual image regions, resulting…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Xiao Wang , Fuling Wang , Haowen Wang , Bo Jiang , Chuanfu Li , Yaowei Wang , Yonghong Tian , Jin Tang

Objective: Large language models (LLMs) are attracting increasing interest in healthcare. This commentary evaluates the potential of LLMs to improve clinical prediction models (CPMs) for diagnostic and prognostic tasks, with a focus on…

Computers and Society · Computer Science 2025-11-07 Yusuf Yildiz , Goran Nenadic , Meghna Jani , David A. Jenkins

Radiology report generation from chest X-rays is an important task in artificial intelligence with the potential to greatly reduce radiologists' workload and shorten patient wait times. Despite recent advances, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Puzhen Wu , Hexin Dong , Yi Lin , Yihao Ding , Yifan Peng

Large language models (LLMs) have shown impressive potential in helping with numerous medical challenges. Deploying LLMs in high-stakes applications such as medicine, however, brings in many concerns. One major area of concern relates to…

Computation and Language · Computer Science 2025-04-15 Hamed Fayyaz , Raphael Poulain , Rahmatollah Beheshti

The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tiancheng Gu , Dongnan Liu , Zhiyuan Li , Weidong Cai

Large language models (LLMs) are increasingly used to extract structured information from free-text clinical records, but prior work often focuses on single tasks, limited models, and English-language reports. We evaluated 15 open-weight…

Radiologists play a crucial role in translating medical images into actionable reports. However, the field faces staffing shortages and increasing workloads. While automated approaches using vision-language models (VLMs) show promise as…

Radiology Report Generation (RRG) through Vision-Language Models (VLMs) promises to reduce documentation burden, improve reporting consistency, and accelerate clinical workflows. However, their clinical adoption remains limited by the lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Marco Salmè , Federico Siciliano , Fabrizio Silvestri , Paolo Soda , Rosa Sicilia , Valerio Guarrasi

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Iryna Hartsock , Ghulam Rasool

Managing scan protocols in Computed Tomography (CT), which includes adjusting acquisition parameters or configuring reconstructions, as well as selecting postprocessing tools in a patient-specific manner, is time-consuming and requires…

Artificial Intelligence · Computer Science 2025-09-25 Xingjian Kang , Linda Vorberg , Andreas Maier , Alexander Katzmann , Oliver Taubmann

Automated radiographic report generation is a challenging cross-domain task that aims to automatically generate accurate and semantic-coherence reports to describe medical images. Despite the recent progress in this field, there are still…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zhanyu Wang , Mingkang Tang , Lei Wang , Xiu Li , Luping Zhou

Medical decision-making is a critical task, where errors can result in serious, potentially life-threatening consequences. While full automation remains challenging, hybrid frameworks that combine machine intelligence with human oversight…

Artificial Intelligence · Computer Science 2025-09-10 Debodeep Banerjee , Burcu Sayin , Stefano Teso , Andrea Passerini

Ultrasound (US) report generation is a challenging task due to the variability of US images, operator dependence, and the need for standardized text. Unlike X-ray and CT, US imaging lacks consistent datasets, making automation difficult. In…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Peixuan Ge , Tongkun Su , Faqin Lv , Baoliang Zhao , Peng Zhang , Chi Hong Wong , Liang Yao , Yu Sun , Zenan Wang , Pak Kin Wong , Ying Hu

With the increasing application of large language models (LLMs) in the medical domain, evaluating these models' performance using benchmark datasets has become crucial. This paper presents a comprehensive survey of various benchmark…

Beyond their primary diagnostic purpose, radiology reports have been an invaluable source of information in medical research. Given a corpus of radiology reports, researchers are often interested in identifying a subset of reports…

Computation and Language · Computer Science 2021-12-21 Tamara Katic , Martin Pavlovski , Danijela Sekulic , Slobodan Vucetic

Significant methodological strides have been made toward Chest X-ray (CXR) understanding via modern vision-language models (VLMs), demonstrating impressive Visual Question Answering (VQA) and CXR report generation abilities. However,…

Artificial Intelligence · Computer Science 2024-04-01 Seil Kang , Donghyun Kim , Junhyeok Kim , Hyo Kyung Lee , Seong Jae Hwang

Medical Report Generation (MRG) is a key part of modern medical diagnostics, as it automatically generates reports from radiological images to reduce radiologists' burden. However, reliable MRG models for lesion description face three main…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yucheng Song , Yifan Ge , Junhao Li , Zhining Liao , Zhifang Liao