中文
相关论文

相关论文: Dia-LLaMA: Towards Large Language Model-driven CT …

200 篇论文

Medical imaging plays a crucial role in diagnosis, with radiology reports serving as vital documentation. Automating report generation has emerged as a critical need to alleviate the workload of radiologists. While machine learning has…

图像与视频处理 · 电气工程与系统科学 2024-07-08 Ibrahim Ethem Hamamci , Sezgin Er , Bjoern Menze

Large Language Models (LLMs) are increasingly adopted across domains such as education, healthcare, and finance. In healthcare, LLMs support tasks including disease diagnosis, abnormality classification, and clinical decision-making. Among…

Brain CT report generation is significant to aid physicians in diagnosing cranial diseases. Recent studies concentrate on handling the consistency between visual and textual pathological features to improve the coherence of report. However,…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Chengxin Zheng , Junzhong Ji , Yanzhao Shi , Xiaodan Zhang , Liangqiong Qu

Medical image classifiers detect gastrointestinal diseases well, but they do not explain their decisions. Large language models can generate clinical text, yet they struggle with visual reasoning and often produce unstable or incorrect…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Md. Najib Hasan , Imran Ahmad , Sourav Basak Shuvo , Md. Mahadi Hasan Ankon , Sunanda Das , Nazmul Siddique , Hui Wang

Vision-language pretraining has advanced image-text alignment, yet progress in radiology remains constrained by the heterogeneity of clinical reports, including abbreviations, impression-only notes, and stylistic variability. Unlike…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Hanbin Ko , Gihun Cho , Inhyeok Baek , Donguk Kim , Joonbeom Koo , Changi Kim , Dongheon Lee , Chang Min Park

Radiology report generation (RRG) has attracted significant attention due to its potential to reduce the workload of radiologists. Current RRG approaches are still unsatisfactory against clinical standards. This paper introduces a novel RRG…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Zijian Zhou , Miaojing Shi , Meng Wei , Oluwatosin Alabi , Zijie Yue , Tom Vercauteren

The integration of Computer-Aided Diagnosis (CAD) with Large Language Models (LLMs) presents a promising frontier in clinical applications, notably in automating diagnostic processes akin to those performed by radiologists and providing…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Zihao Zhao , Sheng Wang , Jinchen Gu , Yitao Zhu , Lanzhuju Mei , Zixu Zhuang , Zhiming Cui , Qian Wang , Dinggang Shen

Purpose: This study aimed to develop an open-source multimodal large language model (CXR-LLAVA) for interpreting chest X-ray images (CXRs), leveraging recent advances in large language models (LLMs) to potentially replicate the image…

计算与语言 · 计算机科学 2024-01-17 Seowoo Lee , Jiwon Youn , Hyungjin Kim , Mansu Kim , Soon Ho Yoon

Structured data offers a sophisticated mechanism for the organization of information. Existing methodologies for the text-serialization of structured data in the context of large language models fail to adequately address the heterogeneity…

计算与语言 · 计算机科学 2024-02-20 YiQiu Guo , Yuchen Yang , Ya Zhang , Yu Wang , Yanfeng Wang

In clinics, a radiology report is crucial for guiding a patient's treatment. However, writing radiology reports is a heavy burden for radiologists. To this end, we present an automatic, multi-modal approach for report generation from a…

图像与视频处理 · 电气工程与系统科学 2022-06-02 Shuxin Yang , Xian Wu , Shen Ge , S. Kevin Zhou , Li Xiao

Automatic radiology reporting has great clinical potential to relieve radiologists from heavy workloads and improve diagnosis interpretation. Recently, researchers have enhanced data-driven neural networks with medical knowledge graphs to…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Mingjie Li , Bingqian Lin , Zicong Chen , Haokun Lin , Xiaodan Liang , Xiaojun Chang

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

图像与视频处理 · 电气工程与系统科学 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

General purpose Large Language Models (LLM) such as the Generative Pretrained Transformer (GPT) and Large Language Model Meta AI (LLaMA) have attracted much attention in recent years. There is strong evidence that these models can perform…

计算与语言 · 计算机科学 2024-04-25 Hossein Salami , Brandye Smith-Goettler , Vijay Yadav

Large Language Models (LLMs), like LLaMA, have exhibited remarkable performance across various tasks. Nevertheless, when deployed to specific domains such as law or medicine, the models still confront the challenge of a deficiency in…

计算与语言 · 计算机科学 2023-10-17 Quzhe Huang , Mingxu Tao , Chen Zhang , Zhenwei An , Cong Jiang , Zhibin Chen , Zirui Wu , Yansong Feng

Vision-Language Models (VLMs) are becoming increasingly popular in the medical domain, bridging the gap between medical images and clinical language. Existing VLMs demonstrate an impressive ability to comprehend medical images and text…

This paper presents an innovative exploration of the application potential of large language models (LLM) in addressing the challenging task of automatically generating behavior trees (BTs) for complex tasks. The conventional manual BT…

计算与语言 · 计算机科学 2024-01-17 Fu Li , Xueying Wang , Bin Li , Yunlong Wu , Yanzhen Wang , Xiaodong Yi

Medical Large Vision-Language Models (Med-LVLMs) have been widely adopted for medical report generation. Despite Med-LVLMs producing state-of-the-art performance, they exhibit a bias toward predicting all findings as normal, leading to…

多智能体系统 · 计算机科学 2025-05-27 Pengyu Wang , Shuchang Ye , Usman Naseem , Jinman Kim

Automated radiology report generation is key for reducing radiologist workload and improving diagnostic consistency, yet generating accurate reports for 3D medical imaging remains challenging. Existing vision-language models face two…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Pengcheng Shi , Minghui Zhang , Kehan Song , Jiaqi Liu , Yun Gu , Xinglin Zhang

Large language models (LLMs) have shown impressive potential in helping with numerous medical challenges. Deploying LLMs in high-stakes applications such as medicine, however, brings in many concerns. One major area of concern relates to…

计算与语言 · 计算机科学 2025-04-15 Hamed Fayyaz , Raphael Poulain , Rahmatollah Beheshti

Large language models (LLMs) are increasingly attracting the attention of healthcare professionals for their potential to assist in diagnostic assessments, which could alleviate the strain on the healthcare system caused by a high patient…

计算与语言 · 计算机科学 2025-01-03 Kaushik Roy , Harshul Surana , Darssan Eswaramoorthi , Yuxin Zi , Vedant Palit , Ritvik Garimella , Amit Sheth