English
Related papers

Related papers: HERGen: Elevating Radiology Report Generation with…

200 papers

Conversational AI tools that can generate and discuss clinically correct radiology reports for a given medical image have the potential to transform radiology. Such a human-in-the-loop radiology assistant could facilitate a collaborative…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Chantal Pellegrini , Ege Özsoy , Benjamin Busam , Nassir Navab , Matthias Keicher

Existing deep learning methods for radiology report generation enhance diagnostic efficiency but often overlook physician-informed medical priors. This leads to a suboptimal alignment between the structured explanations and disease…

Tissues and Organs · Quantitative Biology 2026-04-13 Aishik Konwer , Moinak Bhattacharya , Prateek Prasanna

X-ray image-based medical report generation (MRG) is a pivotal area in artificial intelligence which can significantly reduce diagnostic burdens and patient wait times. Despite significant progress, we believe that the task has reached a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Xiao Wang , Fuling Wang , Yuehang Li , Qingchuan Ma , Shiao Wang , Bo Jiang , Chuanfu Li , Jin Tang

Medical errors are a major public health concern and a leading cause of death worldwide. Many healthcare centers and hospitals use reporting systems where medical practitioners write a preliminary medical report and the report is later…

Information Retrieval · Computer Science 2020-05-01 Sean MacAvaney , Arman Cohan , Nazli Goharian , Ross Filice

Automated radiology report generation aims at automatically generating a detailed description of medical images, which can greatly alleviate the workload of radiologists and provide better medical services to remote areas. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yuhao Wang , Kai Wang , Xiaohong Liu , Tianrun Gao , Jingyue Zhang , Guangyu Wang

Automated pathology report generation from Whole Slide Images (WSIs) faces two key challenges: (1) lack of semantic content in visual features and (2) inherent information redundancy in WSIs. To address these issues, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Ling Zhang , Boxiang Yun , Qingli Li , Yan Wang

Automatically generated radiology reports often receive high scores from existing evaluation metrics but fail to earn clinicians' trust. This gap reveals fundamental flaws in how current metrics assess the quality of generated reports. We…

Computation and Language · Computer Science 2025-10-02 Ruochen Li , Jun Li , Bailiang Jian , Kun Yuan , Youxiang Zhu

The scarcity of well-annotated diverse medical images is a major hurdle for developing reliable AI models in healthcare. Substantial technical advances have been made in generative foundation models for natural images. Here we develop…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yuanfeng Ji , Dan Lin , Xiyue Wang , Lu Zhang , Wenhui Zhou , Chongjian Ge , Ruihang Chu , Xiaoli Yang , Junhan Zhao , Junsong Chen , Xiangde Luo , Sen Yang , Jin Fang , Ping Luo , Ruijiang Li

Radiology reporting is a complex task requiring detailed medical image understanding and precise language generation, for which generative multimodal models offer a promising solution. However, to impact clinical practice, models must…

Deep learning in medical imaging often requires large-scale, high-quality data or initiation with suitably pre-trained weights. However, medical datasets are limited by data availability, domain-specific knowledge, and privacy concerns, and…

Image and Video Processing · Electrical Eng. & Systems 2023-12-12 Zelong Liu , Alexander Zhou , Arnold Yang , Alara Yilmaz , Maxwell Yoo , Mikey Sullivan , Catherine Zhang , James Grant , Daiqing Li , Zahi A. Fayad , Sean Huver , Timothy Deyer , Xueyan Mei

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

Among all the sub-sections in a typical radiology report, the Clinical Indications, Findings, and Impression often reflect important details about the health status of a patient. The information included in Impression is also often covered…

Previous research on radiology report generation has made significant progress in terms of increasing the clinical accuracy of generated reports. In this paper, we emphasize another crucial quality that it should possess, i.e., inter-report…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Wenjun Hou , Yi Cheng , Kaishuai Xu , Yan Hu , Wenjie Li , Jiang Liu

Ultrasound (US) report generation is a challenging task due to the variability of US images, operator dependence, and the need for standardized text. Unlike X-ray and CT, US imaging lacks consistent datasets, making automation difficult. In…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Peixuan Ge , Tongkun Su , Faqin Lv , Baoliang Zhao , Peng Zhang , Chi Hong Wong , Liang Yao , Yu Sun , Zenan Wang , Pak Kin Wong , Ying Hu

Reading and interpreting chest X-ray images is one of the most radiologist's routines. However, it still can be challenging, even for the most experienced ones. Therefore, we proposed a multi-model deep learning-based automated chest X-ray…

Image and Video Processing · Electrical Eng. & Systems 2024-01-31 Arief Purnama Muharram , Hollyana Puteri Haryono , Abassi Haji Juma , Ira Puspasari , Nugraha Priya Utama

Automated chest radiographs interpretation requires both accurate disease classification and detailed radiology report generation, presenting a significant challenge in the clinical workflow. Current approaches either focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Difei Gu , Yunhe Gao , Yang Zhou , Mu Zhou , Dimitris Metaxas

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Mammography report generation is a critical yet underexplored task in medical AI, characterized by challenges such as multiview image reasoning, high-resolution visual cues, and unstructured radiologic language. In this work, we introduce…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Nak-Jun Sung , Donghyun Lee , Bo Hwa Choi , Chae Jung Park

Recently, vision-language representation learning has made remarkable advancements in building up medical foundation models, holding immense potential for transforming the landscape of clinical research and medical care. The underlying…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Weijian Huang , Cheng Li , Hao Yang , Jiarun Liu , Yong Liang , Hairong Zheng , Shanshan Wang

BACKGROUND: Radiology reports are typically written in a free-text format, making clinical information difficult to extract and use. Recently the adoption of structured reporting (SR) has been recommended by various medical societies thanks…