中文
相关论文

相关论文: Dia-LLaMA: Towards Large Language Model-driven CT …

200 篇论文

Conversational AI tools that can generate and discuss clinically correct radiology reports for a given medical image have the potential to transform radiology. Such a human-in-the-loop radiology assistant could facilitate a collaborative…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Chantal Pellegrini , Ege Özsoy , Benjamin Busam , Nassir Navab , Matthias Keicher

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

In the U.S. inpatient payment system, the Diagnosis-Related Group (DRG) is pivotal, but its assignment process is inefficient. The study introduces DRG-LLaMA, an advanced large language model (LLM) fine-tuned on clinical notes to enhance…

人工智能 · 计算机科学 2023-10-02 Hanyin Wang , Chufan Gao , Christopher Dantona , Bryan Hull , Jimeng Sun

Despite significant advancements in adapting Large Language Models (LLMs) for radiology report generation (RRG), clinical adoption remains challenging due to difficulties in accurately mapping pathological and anatomical features to their…

计算机视觉与模式识别 · 计算机科学 2025-08-22 Qilong Xing , Zikai Song , Youjia Zhang , Na Feng , Junqing Yu , Wei Yang

Purpose: This study aims to use a large language model (LLM) to automate the generation of summaries from the CT simulation orders and evaluate its performance. Materials and Methods: A total of 607 CT simulation orders for patients were…

Radiology reports are critical for clinical decision-making but often lack a standardized format, limiting both human interpretability and machine learning (ML) applications. While large language models (LLMs) have shown strong capabilities…

Inspired by the tremendous success of Large Language Models (LLMs), existing Radiology report generation methods attempt to leverage large models to achieve better performance. They usually adopt a Transformer to extract the visual features…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Xiao Wang , Yuehang Li , Fuling Wang , Shiao Wang , Chuanfu Li , Bo Jiang

Large Language Models (LLMs) are increasingly applied to medical imaging tasks, including image interpretation and synthetic image generation. However, these models often produce hallucinations, which are confident but incorrect outputs…

图像与视频处理 · 电气工程与系统科学 2025-08-12 Anindya Bijoy Das , Shahnewaz Karim Sakib , Shibbir Ahmed

Radiology Report Generation (R2Gen) demonstrates how Multi-modal Large Language Models (MLLMs) can automate the creation of accurate and coherent radiological reports. Existing methods often hallucinate details in text-based reports that…

计算与语言 · 计算机科学 2024-07-19 Manav Nitin Kapadnis , Sohan Patnaik , Abhilash Nandy , Sourjyadip Ray , Pawan Goyal , Debdoot Sheet

Clinically acquired brain MRIs and radiology reports are valuable but underutilized resources due to the challenges of manual analysis and data heterogeneity. We developed fine-tuned language models (LMs) to classify brain MRI reports as…

Multimodal Large Language Models (MLLMs) have emerged as a promising way to automate Radiology Report Generation (RRG). In this work, we systematically investigate the design space of 3D MLLMs, including visual input representation,…

图像与视频处理 · 电气工程与系统科学 2025-09-23 Mohammed Baharoon , Jun Ma , Congyu Fang , Augustin Toma , Bo Wang

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Iryna Hartsock , Ghulam Rasool

In recent years, the field of radiology has increasingly harnessed the power of artificial intelligence (AI) to enhance diagnostic accuracy, streamline workflows, and improve patient care. Large language models (LLMs) have emerged as…

计算与语言 · 计算机科学 2024-12-17 Yucheng Shi , Peng Shu , Zhengliang Liu , Zihao Wu , Quanzheng Li , Tianming Liu , Ninghao Liu , Xiang Li

Medical image analysis is essential in modern healthcare. Deep learning has redirected research focus toward complex medical multimodal tasks, including report generation and visual question answering. Traditional task-specific models often…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Yiming Shi , Shaoshuai Yang , Xun Zhu , Haoyu Wang , Xiangling Fu , Miao Li , Ji Wu

Large language models (LLMs) have recently demonstrated their potential in clinical applications, providing valuable medical knowledge and advice. For example, a large dialog LLM like ChatGPT has successfully passed part of the US medical…

计算机视觉与模式识别 · 计算机科学 2023-02-15 Sheng Wang , Zihao Zhao , Xi Ouyang , Qian Wang , Dinggang Shen

Interpreting quantitative CT biomarkers, such as organ volume and tissue attenuation, requires large-scale healthy reference distributions. However, creating these is challenging because clinical datasets are often heavily enriched with…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Christian Wachinger , Bernhard Renger , Christopher Späth , Jan Kirschke , Marcus Makowski

In practice, clinicians achieve a diagnosis by following a sequence of steps, such as laboratory exams, observations, or imaging. The pathways to reach diagnosis decisions are documented by guidelines authored by expert organizations, which…

计算与语言 · 计算机科学 2024-09-25 Elisa Castagnari , Lillian Muyama , Adrien Coulet

Medical caption prediction which can be regarded as a task of medical report generation (MRG), requires the automatic generation of coherent and accurate captions for the given medical images. However, the scarcity of labelled medical…

计算机视觉与模式识别 · 计算机科学 2023-06-12 Bang Yang , Asif Raza , Yuexian Zou , Tong Zhang

Generating precise diagnostic reports from High-Resolution Computed Tomography (HRCT) is critical for clinical workflow, yet it remains a formidable challenge due to the high pathological diversity and spatial sparsity within 3D volumes.…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yingying Fang , Huichi Zhou , KinHei Lee , Yijia Wang , Zhenxuan Zhang , Jiahao Huang , Guang Yang

The recent release of RadGenome-Chest CT has significantly advanced CT-based report generation. However, existing methods primarily focus on global features, making it challenging to capture region-specific details, which may cause certain…

图像与视频处理 · 电气工程与系统科学 2025-07-01 Sunggu Kyung , Jinyoung Seo , Hyunseok Lim , Dongyeong Kim , Hyungbin Park , Jimin Sung , Jihyun Kim , Wooyoung Jo , Yoojin Nam , Namkug Kim