English
Related papers

Related papers: Resource-Efficient Medical Report Generation using…

200 papers

Reading and interpreting chest X-ray images is one of the most radiologist's routines. However, it still can be challenging, even for the most experienced ones. Therefore, we proposed a multi-model deep learning-based automated chest X-ray…

Image and Video Processing · Electrical Eng. & Systems 2024-01-31 Arief Purnama Muharram , Hollyana Puteri Haryono , Abassi Haji Juma , Ira Puspasari , Nugraha Priya Utama

The integration of artificial intelligence in healthcare has opened new horizons for improving medical diagnostics and patient care. However, challenges persist in developing systems capable of generating accurate and contextually relevant…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Marco Salmè , Rosa Sicilia , Paolo Soda , Valerio Guarrasi

At the heart of radiological practice is the challenge of integrating complex imaging data with clinical information to produce actionable insights. Nuanced application of language is key for various activities, including managing requests,…

Large Language Models (LLMs) have revolutionised the field of Natural Language Processing (NLP) and have achieved state-of-the-art performance in practically every task in this field. However, the prevalent approach used in text generation,…

Computation and Language · Computer Science 2024-08-12 Nicolo Micheletti , Samuel Belkadi , Lifeng Han , Goran Nenadic

AI-assisted report generation offers the opportunity to reduce radiologists' workload stemming from expanded screening guidelines, complex cases and workforce shortages, while maintaining diagnostic accuracy. In addition to describing…

Clinically acquired brain MRIs and radiology reports are valuable but underutilized resources due to the challenges of manual analysis and data heterogeneity. We developed fine-tuned language models (LMs) to classify brain MRI reports as…

Medical Decision-Making (MDM) is a multi-faceted process that requires clinicians to assess complex multi-modal patient data patient, often collaboratively. Large Language Models (LLMs) promise to streamline this process by synthesizing…

Medical report generation is a critical task in healthcare that involves the automatic creation of detailed and accurate descriptions from medical images. Traditionally, this task has been approached as a sequence generation problem,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yijian Fan , Zhenbang Yang , Rui Liu , Mingjie Li , Xiaojun Chang

Recent advances in reasoning-enhanced large language models (LLMs) and multimodal LLMs (MLLMs) have significantly improved performance in complex tasks, yet medical AI models often overlook the structured reasoning processes inherent in…

Artificial Intelligence · Computer Science 2025-05-22 Ziqing Fan , Cheng Liang , Chaoyi Wu , Ya Zhang , Yanfeng Wang , Weidi Xie

This paper explores the task of radiology report generation, which aims at generating free-text descriptions for a set of radiographs. One significant challenge of this task is how to correctly maintain the consistency between the images…

Computation and Language · Computer Science 2023-06-13 Wenjun Hou , Kaishuai Xu , Yi Cheng , Wenjie Li , Jiang Liu

Efficient hospital management systems (HMS) are critical worldwide to address challenges such as overcrowding, limited resources, and poor availability of urgent health care. Existing methods often lack the ability to provide accurate,…

Computation and Language · Computer Science 2025-09-15 Abdulrahman Allam , Seif Ahmed , Ali Hamdi , Ammar Mohammed

The manual creation of the "Impression" section in radiology reports is a primary driver of radiologist burnout. To address this challenge, we propose a coarse-to-fine framework that leverages open-source large language models (LLMs) to…

Computation and Language · Computer Science 2025-09-30 Chengbo Sun , Hui Yi Leong , Lei Li

Radiology reports provide detailed descriptions of medical imaging integrated with patients' medical histories, while report writing is traditionally labor-intensive, increasing radiologists' workload and the risk of diagnostic errors.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fuying Wang , Shenghui Du , Lequan Yu

Radiology reporting is a complex task requiring detailed medical image understanding and precise language generation, for which generative multimodal models offer a promising solution. However, to impact clinical practice, models must…

Following the impressive development of LLMs, vision-language alignment in LLMs is actively being researched to enable multimodal reasoning and visual IO. This direction of research is particularly relevant to medical imaging because…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Suhyeon Lee , Won Jun Kim , Jinho Chang , Jong Chul Ye

The integration of multimodal Electronic Health Records (EHR) data has significantly improved clinical predictive capabilities. Leveraging clinical notes and multivariate time-series EHR, existing models often lack the medical context…

Artificial Intelligence · Computer Science 2024-02-13 Yinghao Zhu , Changyu Ren , Shiyun Xie , Shukai Liu , Hangyuan Ji , Zixiang Wang , Tao Sun , Long He , Zhoujun Li , Xi Zhu , Chengwei Pan

Purpose: This study aimed to develop an open-source multimodal large language model (CXR-LLAVA) for interpreting chest X-ray images (CXRs), leveraging recent advances in large language models (LLMs) to potentially replicate the image…

Computation and Language · Computer Science 2024-01-17 Seowoo Lee , Jiwon Youn , Hyungjin Kim , Mansu Kim , Soon Ho Yoon

Automatic radiology report generation is critical in clinics which can relieve experienced radiologists from the heavy workload and remind inexperienced radiologists of misdiagnosis or missed diagnose. Existing approaches mainly formulate…

Image and Video Processing · Electrical Eng. & Systems 2022-11-08 Shuxin Yang , Xian Wu , Shen Ge , Shaohua Kevin Zhou , Li Xiao

Large Language Models (LLMs) have swiftly emerged as vital resources for different applications in the biomedical and healthcare domains; however, these models encounter issues such as generating inaccurate information or hallucinations.…

Computation and Language · Computer Science 2024-05-06 Mingchen Li , Halil Kilicoglu , Hua Xu , Rui Zhang

Artificial intelligence (AI) is reshaping modern healthcare by advancing disease diagnosis, treatment decision-making, and biomedical research. Among AI technologies, large language models (LLMs) have become especially impactful, enabling…

Artificial Intelligence · Computer Science 2025-11-18 Zhengda Wang , Daqian Shi , Jingyi Zhao , Xiaolei Diao , Xiongfeng Tang , Yanguo Qin