English
Related papers

Related papers: HERGen: Elevating Radiology Report Generation with…

200 papers

Clinical practice frequently uses medical imaging for diagnosis and treatment. A significant challenge for automatic radiology report generation is that the radiology reports are long narratives consisting of multiple sentences for both…

Computation and Language · Computer Science 2023-07-03 Kaveri Kale , pushpak Bhattacharyya , Kshitij Jadhav

Deep generative models have significantly advanced medical imaging analysis by enhancing dataset size and quality. Beyond mere data augmentation, our research in this paper highlights an additional, significant capacity of deep generative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Xiaodan Xing , Junzhi Ning , Yang Nan , Guang Yang

The integration of multimodal Electronic Health Records (EHR) data has significantly advanced clinical predictive capabilities. Existing models, which utilize clinical notes and multivariate time-series EHR data, often fall short of…

Computation and Language · Computer Science 2025-02-27 Yinghao Zhu , Changyu Ren , Zixiang Wang , Xiaochen Zheng , Shiyun Xie , Junlan Feng , Xi Zhu , Zhoujun Li , Liantao Ma , Chengwei Pan

Automated radiology report generation holds immense potential to alleviate the heavy workload of radiologists. Despite the formidable vision-language capabilities of recent Multimodal Large Language Models (MLLMs), their clinical deployment…

Artificial Intelligence · Computer Science 2026-03-17 Tuoshi Qi , Shenshen Bu , Yingfei Xiang , Zhiming Dai

As medical imaging is central to diagnostic processes, automating the generation of radiology reports has become increasingly relevant to assist radiologists with their heavy workloads. Most current methods rely solely on global image…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Hamza Kalisch , Fabian Hörst , Jens Kleesiek , Ken Herrmann , Constantin Seibold

Large language models (LLMs) have demonstrated remarkable capabilities in various domains, including radiology report generation. Previous approaches have attempted to utilize multimodal LLMs for this task, enhancing their performance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Wenjun Hou , Yi Cheng , Kaishuai Xu , Heng Li , Yan Hu , Wenjie Li , Jiang Liu

In recent years, deep learning has been successfully adopted in a wide range of applications related to electronic health records (EHRs) such as representation learning and clinical event prediction. However, due to privacy constraints,…

Machine Learning · Computer Science 2023-09-04 Chang Lu , Chandan K. Reddy , Ping Wang , Dong Nie , Yue Ning

Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic…

Imbalanced token distributions naturally exist in text documents, leading neural language models to overfit on frequent tokens. The token imbalance may dampen the robustness of radiology report generators, as complex medical terms appear…

Computation and Language · Computer Science 2023-04-20 Yuexin Wu , I-Chan Huang , Xiaolei Huang

Electronic health records (EHR) contain extensive structured and unstructured data, including tabular information and free-text clinical notes. Querying relevant patient information often requires complex database operations, increasing the…

Information Retrieval · Computer Science 2025-11-27 Mengliang ZHang

Electronic health records (EHRs) are long, noisy, and often redundant, posing a major challenge for the clinicians who must navigate them. Large language models (LLMs) offer a promising solution for extracting and reasoning over this…

Computation and Language · Computer Science 2025-08-21 Skatje Myers , Dmitriy Dligach , Timothy A. Miller , Samantha Barr , Yanjun Gao , Matthew Churpek , Anoop Mayampurath , Majid Afshar

Routine clinical visits of a patient produce not only image data, but also non-image data containing clinical information regarding the patient, i.e., medical data is multi-modal in nature. Such heterogeneous modalities offer different and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sein Kim , Namkyeong Lee , Junseok Lee , Dongmin Hyun , Chanyoung Park

With the widespread application of electroencephalography (EEG) in neuroscience and clinical practice, efficiently retrieving and semantically interpreting large-scale, multi-source, heterogeneous EEG data has become a pressing challenge.…

Computation and Language · Computer Science 2025-10-14 Yi Wang , Haoran Luo , Lu Meng , Ziyu Jia , Xinliang Zhou , Qingsong Wen

Radiology Report Generation (RRG) aims to automatically generate diagnostic reports from radiology images. To achieve this, existing methods have leveraged the powerful cross-modal generation capabilities of Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Jiechao Gao , Chang Liu , Yuangang Li

The automatic generation of radiology reports given medical radiographs has significant potential to operationally and improve clinical patient care. A number of prior works have focused on this problem, employing advanced methods from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Guanxiong Liu , Tzu-Ming Harry Hsu , Matthew McDermott , Willie Boag , Wei-Hung Weng , Peter Szolovits , Marzyeh Ghassemi

Objective Renal cancer is a common malignancy and a major cause of cancer-related deaths. Computed tomography (CT) is central to early detection, staging, and treatment planning. However, the growing CT workload increases radiologists'…

Image and Video Processing · Electrical Eng. & Systems 2025-10-17 Renjie Liang , Zhengkang Fan , Jinqian Pan , Chenkun Sun , Bruce Daniel Steinberg , Russell Terry , Jie Xu

Automatic generation of radiology reports holds crucial clinical value, as it can alleviate substantial workload on radiologists and remind less experienced ones of potential anomalies. Despite the remarkable performance of various image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qingqiu Li , Jilan Xu , Runtian Yuan , Mohan Chen , Yuejie Zhang , Rui Feng , Xiaobo Zhang , Shang Gao

Automatic radiology report generation is booming due to its huge application potential for the healthcare industry. However, existing computer vision and natural language processing approaches to tackle this problem are limited in two…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Fudan Zheng , Mengfei Li , Ying Wang , Weijiang Yu , Ruixuan Wang , Zhiguang Chen , Nong Xiao , Yutong Lu

Medical report generation is crucial for clinical diagnosis and patient management, summarizing diagnoses and recommendations based on medical imaging. However, existing work often overlook the clinical pipeline involved in report writing,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xiaofei Huang , Wenting Chen , Jie Liu , Qisheng Lu , Xiaoling Luo , Linlin Shen

Remote sensing vision tasks require extensive labeled data across multiple, interconnected domains. However, current generative data augmentation frameworks are task-isolated, i.e., each vision task requires training an independent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Datao Tang , Hao Wang , Yudeng Xin , Hui Qiao , Dongsheng Jiang , Yin Li , Zhiheng Yu , Xiangyong Cao