English
Related papers

Related papers: Enhanced Knowledge Injection for Radiology Report …

200 papers

This paper proposes a knowledge-enhanced disease diagnosis method based on a prompt learning framework. The method retrieves structured knowledge from external knowledge graphs related to clinical cases, encodes it, and injects it into the…

Computation and Language · Computer Science 2024-09-17 Zhang Zheng

Automating report generation for medical imaging promises to reduce workload and assist diagnosis in clinical practice. Recent work has shown that deep learning models can successfully caption natural images. However, learning from medical…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring , Ling Shao

Recent advances in automated radiology report generation from chest X-rays using deep learning algorithms have the potential to significantly reduce the arduous workload of radiologists. However, due to the inherent massive data bias in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Zeyi Hou , Zeqiang Wei , Ruixin Yan , Ning Lang , Xiuzhuang Zhou

The automatic generation of radiology reports given medical radiographs has significant potential to operationally and improve clinical patient care. A number of prior works have focused on this problem, employing advanced methods from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Guanxiong Liu , Tzu-Ming Harry Hsu , Matthew McDermott , Willie Boag , Wei-Hung Weng , Peter Szolovits , Marzyeh Ghassemi

Automatic generation of medical reports from X-ray images can assist radiologists to perform the time-consuming and yet important reporting task. Yet, achieving clinically accurate generated reports remains challenging. Modeling the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Sixing Yan , William K. Cheung , Keith Chiu , Terence M. Tong , Charles K. Cheung , Simon See

This paper introduces an innovative approach to Medical Vision-Language Pre-training (Med-VLP) area in the specialized context of radiograph representation learning. While conventional methods frequently merge textual annotations into…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Hanqi Jiang , Xixuan Hao , Yuzhou Huang , Chong Ma , Jiaxun Zhang , Yi Pan , Ruimao Zhang

Obtaining datasets labeled to facilitate model development is a challenge for most machine learning tasks. The difficulty is heightened for medical imaging, where data itself is limited in accessibility and labeling requires costly time and…

Computation and Language · Computer Science 2018-10-03 Nithya Attaluri , Ahmed Nasir , Carolynne Powe , Harold Racz , Ben Covington , Li Yao , Jordan Prosky , Eric Poblenz , Tobi Olatunji , Kevin Lyman

We propose a novel medical image classification method that integrates dual-model weight selection with self-knowledge distillation (SKD). In real-world medical settings, deploying large-scale models is often limited by computational…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ayaka Tsutsumi , Guang Li , Ren Togo , Takahiro Ogawa , Satoshi Kondo , Miki Haseyama

Previous research on radiology report generation has made significant progress in terms of increasing the clinical accuracy of generated reports. In this paper, we emphasize another crucial quality that it should possess, i.e., inter-report…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Wenjun Hou , Yi Cheng , Kaishuai Xu , Yan Hu , Wenjie Li , Jiang Liu

Medical diagnosis is the process of making a prediction of the disease a patient is likely to have, given a set of symptoms and observations. This requires extensive expert knowledge, in particular when covering a large variety of diseases.…

Artificial Intelligence · Computer Science 2022-04-29 Niclas Heilig , Jan Kirchhoff , Florian Stumpe , Joan Plepi , Lucie Flek , Heiko Paulheim

In this paper, we consider enhancing medical visual-language pre-training (VLP) with domain-specific knowledge, by exploiting the paired image-text reports from the radiological daily practice. In particular, we make the following…

Image and Video Processing · Electrical Eng. & Systems 2023-04-04 Chaoyi Wu , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Radiology report analysis provides valuable information that can aid with public health initiatives, and has been attracting increasing attention from the research community. In this work, we present a novel insight that the structure of a…

Computation and Language · Computer Science 2024-06-11 Yutong Han , Yan Yuan , Lili Mou

Medical report generation, which aims to automatically generate a long and coherent report of a given medical image, has been receiving growing research interests. Existing approaches mainly adopt a supervised manner and heavily rely on…

Machine Learning · Computer Science 2021-11-16 Fenglin Liu , Chenyu You , Xian Wu , Shen Ge , Sheng Wang , Xu Sun

Training vision-language models (VLMs) for medical report generation is often hindered by the scarcity of high-quality annotated data. This work evaluates the use of a weighted loss function to improve data efficiency. Compared to standard…

Computation and Language · Computer Science 2026-04-24 Alexander Weers , Daniel Rueckert , Martin J. Menten

A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at current examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination.…

Multimedia · Computer Science 2024-05-07 Zhichuan Wang , Kinhei Lee , Qiao Deng , Tiffany Y. So , Wan Hang Chiu , Yeung Yu Hui , Bingjing Zhou , Edward S. Hui

The objective of Radiology Report Generation (RRG) is to automatically generate coherent textual analyses of diseases based on radiological images, thereby alleviating the workload of radiologists. Current AI-based methods for RRG primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Tiancheng Gu , Kaicheng Yang , Xiang An , Ziyong Feng , Dongnan Liu , Weidong Cai

Distributed representations of medical concepts have been used to support downstream clinical tasks recently. Electronic Health Records (EHR) capture different aspects of patients' hospital encounters and serve as a rich source for…

Computation and Language · Computer Science 2020-01-07 Shaika Chowdhury , Chenwei Zhang , Philip S. Yu , Yuan Luo

We propose Retrieval Augmented Generation (RAG) as an approach for automated radiology report writing that leverages multimodally aligned embeddings from a contrastively pretrained vision language model for retrieval of relevant candidate…

Computation and Language · Computer Science 2023-05-08 Mercy Ranjit , Gopinath Ganapathy , Ranjit Manuel , Tanuja Ganu

Large Language Models (LLMs) have greatly contributed to the development of adaptive intelligent agents and are positioned as an important way to achieve Artificial General Intelligence (AGI). However, LLMs are prone to produce factually…

Computation and Language · Computer Science 2024-08-29 Weijian Xie , Xuefeng Liang , Yuhui Liu , Kaihua Ni , Hong Cheng , Zetian Hu

Evidence-based medicine (EBM) plays a crucial role in the application of large language models (LLMs) in healthcare, as it provides reliable support for medical decision-making processes. Although it benefits from current…

Computation and Language · Computer Science 2025-03-24 Chengfeng Dou , Ying Zhang , Zhi Jin , Wenpin Jiao , Haiyan Zhao , Yongqiang Zhao , Zhengwei Tao