English
Related papers

Related papers: Dia-LLaMA: Towards Large Language Model-driven CT …

200 papers

Conversational AI tools that can generate and discuss clinically correct radiology reports for a given medical image have the potential to transform radiology. Such a human-in-the-loop radiology assistant could facilitate a collaborative…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Chantal Pellegrini , Ege Özsoy , Benjamin Busam , Nassir Navab , Matthias Keicher

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

In the U.S. inpatient payment system, the Diagnosis-Related Group (DRG) is pivotal, but its assignment process is inefficient. The study introduces DRG-LLaMA, an advanced large language model (LLM) fine-tuned on clinical notes to enhance…

Artificial Intelligence · Computer Science 2023-10-02 Hanyin Wang , Chufan Gao , Christopher Dantona , Bryan Hull , Jimeng Sun

Despite significant advancements in adapting Large Language Models (LLMs) for radiology report generation (RRG), clinical adoption remains challenging due to difficulties in accurately mapping pathological and anatomical features to their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Qilong Xing , Zikai Song , Youjia Zhang , Na Feng , Junqing Yu , Wei Yang

Purpose: This study aims to use a large language model (LLM) to automate the generation of summaries from the CT simulation orders and evaluate its performance. Materials and Methods: A total of 607 CT simulation orders for patients were…

Radiology reports are critical for clinical decision-making but often lack a standardized format, limiting both human interpretability and machine learning (ML) applications. While large language models (LLMs) have shown strong capabilities…

Computation and Language · Computer Science 2025-07-15 Johannes Moll , Louisa Fay , Asfandyar Azhar , Sophie Ostmeier , Tim Lueth , Sergios Gatidis , Curtis Langlotz , Jean-Benoit Delbrouck

Inspired by the tremendous success of Large Language Models (LLMs), existing Radiology report generation methods attempt to leverage large models to achieve better performance. They usually adopt a Transformer to extract the visual features…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xiao Wang , Yuehang Li , Fuling Wang , Shiao Wang , Chuanfu Li , Bo Jiang

Large Language Models (LLMs) are increasingly applied to medical imaging tasks, including image interpretation and synthetic image generation. However, these models often produce hallucinations, which are confident but incorrect outputs…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Anindya Bijoy Das , Shahnewaz Karim Sakib , Shibbir Ahmed

Radiology Report Generation (R2Gen) demonstrates how Multi-modal Large Language Models (MLLMs) can automate the creation of accurate and coherent radiological reports. Existing methods often hallucinate details in text-based reports that…

Computation and Language · Computer Science 2024-07-19 Manav Nitin Kapadnis , Sohan Patnaik , Abhilash Nandy , Sourjyadip Ray , Pawan Goyal , Debdoot Sheet

Clinically acquired brain MRIs and radiology reports are valuable but underutilized resources due to the challenges of manual analysis and data heterogeneity. We developed fine-tuned language models (LMs) to classify brain MRI reports as…

Multimodal Large Language Models (MLLMs) have emerged as a promising way to automate Radiology Report Generation (RRG). In this work, we systematically investigate the design space of 3D MLLMs, including visual input representation,…

Image and Video Processing · Electrical Eng. & Systems 2025-09-23 Mohammed Baharoon , Jun Ma , Congyu Fang , Augustin Toma , Bo Wang

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Iryna Hartsock , Ghulam Rasool

In recent years, the field of radiology has increasingly harnessed the power of artificial intelligence (AI) to enhance diagnostic accuracy, streamline workflows, and improve patient care. Large language models (LLMs) have emerged as…

Computation and Language · Computer Science 2024-12-17 Yucheng Shi , Peng Shu , Zhengliang Liu , Zihao Wu , Quanzheng Li , Tianming Liu , Ninghao Liu , Xiang Li

Medical image analysis is essential in modern healthcare. Deep learning has redirected research focus toward complex medical multimodal tasks, including report generation and visual question answering. Traditional task-specific models often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yiming Shi , Shaoshuai Yang , Xun Zhu , Haoyu Wang , Xiangling Fu , Miao Li , Ji Wu

Large language models (LLMs) have recently demonstrated their potential in clinical applications, providing valuable medical knowledge and advice. For example, a large dialog LLM like ChatGPT has successfully passed part of the US medical…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Sheng Wang , Zihao Zhao , Xi Ouyang , Qian Wang , Dinggang Shen

Interpreting quantitative CT biomarkers, such as organ volume and tissue attenuation, requires large-scale healthy reference distributions. However, creating these is challenging because clinical datasets are often heavily enriched with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Christian Wachinger , Bernhard Renger , Christopher Späth , Jan Kirschke , Marcus Makowski

In practice, clinicians achieve a diagnosis by following a sequence of steps, such as laboratory exams, observations, or imaging. The pathways to reach diagnosis decisions are documented by guidelines authored by expert organizations, which…

Computation and Language · Computer Science 2024-09-25 Elisa Castagnari , Lillian Muyama , Adrien Coulet

Medical caption prediction which can be regarded as a task of medical report generation (MRG), requires the automatic generation of coherent and accurate captions for the given medical images. However, the scarcity of labelled medical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Bang Yang , Asif Raza , Yuexian Zou , Tong Zhang

Generating precise diagnostic reports from High-Resolution Computed Tomography (HRCT) is critical for clinical workflow, yet it remains a formidable challenge due to the high pathological diversity and spatial sparsity within 3D volumes.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yingying Fang , Huichi Zhou , KinHei Lee , Yijia Wang , Zhenxuan Zhang , Jiahao Huang , Guang Yang

The recent release of RadGenome-Chest CT has significantly advanced CT-based report generation. However, existing methods primarily focus on global features, making it challenging to capture region-specific details, which may cause certain…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Sunggu Kyung , Jinyoung Seo , Hyunseok Lim , Dongyeong Kim , Hyungbin Park , Jimin Sung , Jihyun Kim , Wooyoung Jo , Yoojin Nam , Namkug Kim