中文
相关论文

相关论文: R2GenKG: Hierarchical Multi-modal Knowledge Graph …

200 篇论文

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Automating radiology report generation can ease the reporting workload for radiologists. However, existing works focus mainly on the chest area due to the limited availability of public datasets for other regions. Besides, they often rely…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Qi Chen , Yutong Xie , Biao Wu , Xiaomin Chen , James Ang , Minh-Son To , Xiaojun Chang , Qi Wu

Large Language Models (LLMs) are being adopted at an unprecedented rate, yet still face challenges in knowledge-intensive domains like biomedicine. Solutions such as pre-training and domain-specific fine-tuning add substantial computational…

Automated radiographic report generation is a challenging cross-domain task that aims to automatically generate accurate and semantic-coherence reports to describe medical images. Despite the recent progress in this field, there are still…

计算机视觉与模式识别 · 计算机科学 2022-08-23 Zhanyu Wang , Mingkang Tang , Lei Wang , Xiu Li , Luping Zhou

The integration of multimodal Electronic Health Records (EHR) data has significantly improved clinical predictive capabilities. Leveraging clinical notes and multivariate time-series EHR, existing models often lack the medical context…

人工智能 · 计算机科学 2024-02-13 Yinghao Zhu , Changyu Ren , Shiyun Xie , Shukai Liu , Hangyuan Ji , Zixiang Wang , Tao Sun , Long He , Zhoujun Li , Xi Zhu , Chengwei Pan

Artificial intelligence (AI) is reshaping modern healthcare by advancing disease diagnosis, treatment decision-making, and biomedical research. Among AI technologies, large language models (LLMs) have become especially impactful, enabling…

人工智能 · 计算机科学 2025-11-18 Zhengda Wang , Daqian Shi , Jingyi Zhao , Xiaolei Diao , Xiongfeng Tang , Yanguo Qin

Answering complex real-world questions in the medical domain often requires accurate retrieval from medical Textual Knowledge Graphs (medical TKGs), as the relational path information from TKGs could enhance the inference ability of Large…

计算与语言 · 计算机科学 2026-04-14 Jiatan Huang , Mingchen Li , Zonghai Yao , Dawei Li , Yuxin Zhang , Zhichao Yang , Yongkang Xiao , Feiyun Ouyang , Xiaohan Li , Shuo Han , Hong Yu

Large language models (LLMs) have significantly advanced the field of natural language generation. However, they frequently generate unverified outputs, which compromises their reliability in critical applications. In this study, we propose…

计算与语言 · 计算机科学 2025-02-18 Alexandru Lecu , Adrian Groza , Lezan Hawizy

Radiology report generation (RRG) has attracted significant attention due to its potential to reduce the workload of radiologists. Current RRG approaches are still unsatisfactory against clinical standards. This paper introduces a novel RRG…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Zijian Zhou , Miaojing Shi , Meng Wei , Oluwatosin Alabi , Zijie Yue , Tom Vercauteren

3D medical image analysis is of great importance in disease diagnosis and treatment. Recently, multimodal large language models (MLLMs) have exhibited robust perceptual capacity, strong cross-modal alignment, and promising generalizability.…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Yang Yu , Dunyuan Xu , Yaoqian Li , Xiaomeng Li , Jinpeng Li , Pheng-Ann Heng

Large language models (LLMs) have recently emerged as powerful tools, finding many medical applications. LLMs' ability to coalesce vast amounts of information from many sources to generate a response-a process similar to that of a human…

Medical report generation demands automatic creation of coherent and precise descriptions for medical images. However, the scarcity of labelled medical image-report pairs poses formidable challenges in developing large-scale neural networks…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Shibin Wu , Bang Yang , Zhiyu Ye , Haoqian Wang , Hairong Zheng , Tong Zhang

Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources, therefore becoming an important topic in the medical image analysis field. It is a challenging task, as…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Xinyi Wang , Grazziela Figueredo , Ruizhe Li , Wei Emma Zhang , Weitong Chen , Xin Chen

Our paper focuses on automating the generation of medical reports from chest X-ray image inputs, a critical yet time-consuming task for radiologists. Unlike existing medical re-port generation efforts that tend to produce human-readable…

计算与语言 · 计算机科学 2021-08-30 Hoang T. N. Nguyen , Dong Nie , Taivanbat Badamdorj , Yujie Liu , Yingying Zhu , Jason Truong , Li Cheng

Multimodal Large Language Models (MLLMs) have shown impressive performance in vision and text tasks. However, hallucination remains a major challenge, especially in fields like healthcare where details are critical. In this work, we show…

计算与语言 · 计算机科学 2025-02-24 Yun-Wei Chu , Kai Zhang , Christopher Malon , Martin Renqiang Min

In the realm of medical report generation (MRG), the integration of natural language processing has emerged as a vital tool to alleviate the workload of radiologists. Despite the impressive capabilities demonstrated by large vision language…

计算与语言 · 计算机科学 2026-01-23 Ruoqing Zhao , Runze Xia , Piji Li

Medical imaging is widely used in clinical practice for diagnosis and treatment. Report-writing can be error-prone for unexperienced physicians, and time- consuming and tedious for experienced physicians. To address these issues, we study…

计算与语言 · 计算机科学 2019-01-09 Baoyu Jing , Pengtao Xie , Eric Xing

Radiology Report Generation (RRG) aims to produce accurate and coherent diagnostics from medical images. Although large vision language models (LVLM) improve report fluency and accuracy, they exhibit hallucinations, generating plausible yet…

计算与语言 · 计算机科学 2026-02-05 Ruixiao Yang , Yuanhe Tian , Xu Yang , Huiqi Li , Yan Song

To effectively train medical students to become qualified radiologists, a large number of X-ray images collected from patients with diverse medical conditions are needed. However, due to data privacy concerns, such images are typically…

图像与视频处理 · 电气工程与系统科学 2020-06-19 Xingyi Yang , Nandiraju Gireesh , Eric Xing , Pengtao Xie

The vision-language modeling capability of multi-modal large language models has attracted wide attention from the community. However, in medical domain, radiology report generation using vision-language models still faces significant…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Yuhao Wang , Chao Hao , Yawen Cui , Xinqi Su , Weicheng Xie , Tao Tan , Zitong Yu