English
Related papers

Related papers: Automated Radiology Report Generation Based on Top…

200 papers

Segmentation of infected areas in chest X-rays is pivotal for facilitating the accurate delineation of pulmonary structures and pathological anomalies. Recently, multi-modal language-guided image segmentation methods have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Shuchang Ye , Mingyuan Meng , Mingjian Li , Dagan Feng , Jinman Kim

Evaluating radiology reports is a challenging problem as factual correctness is extremely important due to the need for accurate medical communication about medical images. Existing automatic evaluation metrics either suffer from failing to…

Generating video descriptions in natural language (a.k.a. video captioning) is a more challenging task than image captioning as the videos are intrinsically more complicated than images in two aspects. First, videos cover a broader range of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Shizhe Chen , Jia Chen , Qin Jin

A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at current examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination.…

Multimedia · Computer Science 2024-05-07 Zhichuan Wang , Kinhei Lee , Qiao Deng , Tiffany Y. So , Wan Hang Chiu , Yeung Yu Hui , Bingjing Zhou , Edward S. Hui

Annually and globally, over three billion radiography examinations and computer tomography scans result in mostly unstructured radiology reports containing free text. Despite the potential benefits of structured reporting, its adoption is…

Computation and Language · Computer Science 2024-06-25 Daniel Reichenpfader , Jonas Knupp , André Sander , Kerstin Denecke

The automatic summarization of surgical videos is essential for enhancing procedural documentation, supporting surgical training, and facilitating post-operative analysis. This paper presents a novel method at the intersection of artificial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hugo Georgenthum , Cristian Cosentino , Fabrizio Marozzo , Pietro Liò

Radiology report generation (RRG) is commonly formulated as a single-path generation task, where a multimodal large language model (MLLM) produces one decoded report as the final output. While recent progress has largely been driven by…

Computation and Language · Computer Science 2026-05-29 Xi Zhang , Yingshu Li , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho

Radiology Report Generation (RRG) draws attention as a vision-and-language interaction of biomedical fields. Previous works inherited the ideology of traditional language generation tasks, aiming to generate paragraphs with high readability…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiao Song , Jiafan Liu , Yun Li , Yan Liu , Wenbin Lei , Ruxin Wang

With the emergence of vision language models in the medical imaging domain, numerous studies have focused on two dominant research activities: (1) report generation from Chest X-rays (CXR), and (2) synthetic scan generation from text or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Santosh Sanjeev , Fadillah Adamsyah Maani , Arsen Abzhanov , Vijay Ram Papineni , Ibrahim Almakky , Bartłomiej W. Papież , Mohammad Yaqub

Radiology report generation represents a significant application within medical AI, and has achieved impressive results. Concurrently, large language models (LLMs) have demonstrated remarkable performance across various domains. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Haifeng Zhao , Yufei Zhang , Leilei Ma , Shuo Xu , Dengdi Sun

Automatic structuring of electronic medical records is of high demand for clinical workflow solutions to facilitate extraction, storage, and querying of patient care information. However, developing a scalable solution is extremely…

Computation and Language · Computer Science 2020-10-13 Morteza Pourreza Shahri , Amir Tahmasebi , Bingyang Ye , Henghui Zhu , Javed Aslam , Timothy Ferris

The use of synthetic images in medical imaging Artificial Intelligence (AI) solutions has been shown to be beneficial in addressing the limited availability of diverse, unbiased, and representative data. Despite the extensive use of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Elay Dahan , Hedda Cohen Indelman , Angeles M. Perez-Agosto , Carmit Shiran , Gopal Avinash , Doron Shaked , Nati Daniel

Automatic medical report generation (MRG), which aims to produce detailed text reports from medical images, has emerged as a critical task in this domain. MRG systems can enhance radiological workflows by reducing the time and effort…

Image and Video Processing · Electrical Eng. & Systems 2024-10-14 Siyou Li , Beining Xu , Yihao Luo , Dong Nie , Le Zhang

Temporal Knowledge Graphs (TKGs) represent dynamic facts as timestamped relations between entities. TKG completion involves forecasting missing or future links, requiring models to reason over time-evolving structure. While LLMs show…

Machine Learning · Computer Science 2025-05-26 Ömer Faruk Akgül , Feiyu Zhu , Yuxin Yang , Rajgopal Kannan , Viktor Prasanna

Generating long and coherent reports to describe medical images poses challenges to bridging visual patterns with informative human linguistic descriptions. We propose a novel Hybrid Retrieval-Generation Reinforced Agent (HRGR-Agent) which…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Christy Y. Li , Xiaodan Liang , Zhiting Hu , Eric P. Xing

Artificial intelligence (AI) is reshaping modern healthcare by advancing disease diagnosis, treatment decision-making, and biomedical research. Among AI technologies, large language models (LLMs) have become especially impactful, enabling…

Artificial Intelligence · Computer Science 2025-11-18 Zhengda Wang , Daqian Shi , Jingyi Zhao , Xiaolei Diao , Xiongfeng Tang , Yanguo Qin

Safe deployment of Large Vision-Language Models (LVLMs) in radiology report generation requires not only accurate predictions but also clinically interpretable indicators of when outputs should be thoroughly reviewed, enabling selective…

The automatic clinical caption generation problem is referred to as proposed model combining the analysis of frontal chest X-Ray scans with structured patient information from the radiology records. We combine two language models, the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Alexander Selivanov , Oleg Y. Rogov , Daniil Chesakov , Artem Shelmanov , Irina Fedulova , Dmitry V. Dylov

The paper proposes a novel evaluation metric for automatic medical report generation from X-ray images, VLScore. It aims to overcome the limitations of existing evaluation methods, which either focus solely on textual similarities, ignoring…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Gefen Dawidowicz , Elad Hirsch , Ayellet Tal

Radiology reporting is a complex task requiring detailed medical image understanding and precise language generation, for which generative multimodal models offer a promising solution. However, to impact clinical practice, models must…