中文
相关论文

相关论文: Activating Associative Disease-Aware Vision Token …

200 篇论文

Recent developments in the field of Natural Language Processing, especially language models such as the transformer have brought state-of-the-art results in language understanding and language generation. In this work, we investigate the…

计算与语言 · 计算机科学 2024-08-22 Sonit Singh

With the emergence of vision language models in the medical imaging domain, numerous studies have focused on two dominant research activities: (1) report generation from Chest X-rays (CXR), and (2) synthetic scan generation from text or…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Santosh Sanjeev , Fadillah Adamsyah Maani , Arsen Abzhanov , Vijay Ram Papineni , Ibrahim Almakky , Bartłomiej W. Papież , Mohammad Yaqub

Obtaining automated preliminary read reports for common exams such as chest X-rays will expedite clinical workflows and improve operational efficiencies in hospitals. However, the quality of reports generated by current automated approaches…

Radiology Report Generation (RRG) is a critical step toward automating healthcare workflows, facilitating accurate patient assessments, and reducing the workload of medical professionals. Despite recent progress in Large Medical…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Sarosij Bose , Ravi K. Rajendran , Biplob Debnath , Konstantinos Karydis , Amit K. Roy-Chowdhury , Srimat Chakradhar

Self-supervised learning provides an opportunity to explore unlabeled chest X-rays and their associated free-text reports accumulated in clinical routine without manual supervision. This paper proposes a Joint Image Text Representation…

机器学习 · 计算机科学 2021-09-07 Zhanghexuan Ji , Mohammad Abuzar Shaikh , Dana Moukheiber , Sargur Srihari , Yifan Peng , Mingchen Gao

Automatic medical image report generation has drawn growing attention due to its potential to alleviate radiologists' workload. Existing work on report generation often trains encoder-decoder networks to generate complete reports. However,…

计算机视觉与模式识别 · 计算机科学 2020-10-07 Jianmo Ni , Chun-Nan Hsu , Amilcare Gentili , Julian McAuley

Radiologists face high burnout rates, partially due to the increasing volume of Chest X-rays (CXRs) requiring interpretation and reporting. Automated CXR report generation holds promise for reducing this burden and improving patient care.…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Aaron Nicolson , Jason Dowling , Bevan Koopman

The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario,…

计算机视觉与模式识别 · 计算机科学 2023-11-13 Tiancheng Gu , Dongnan Liu , Zhiyuan Li , Weidong Cai

In clinical radiology reports, doctors capture important information about the patient's health status. They convey their observations from raw medical imaging data about the inner structures of a patient. As such, formulating reports…

Radiology Report Generation (R2Gen) demonstrates how Multi-modal Large Language Models (MLLMs) can automate the creation of accurate and coherent radiological reports. Existing methods often hallucinate details in text-based reports that…

计算与语言 · 计算机科学 2024-07-19 Manav Nitin Kapadnis , Sohan Patnaik , Abhilash Nandy , Sourjyadip Ray , Pawan Goyal , Debdoot Sheet

Automatic radiology report generation has been an attracting research problem towards computer-aided diagnosis to alleviate the workload of doctors in recent years. Deep learning techniques for natural image captioning are successfully…

计算机视觉与模式识别 · 计算机科学 2020-02-20 Yixiao Zhang , Xiaosong Wang , Ziyue Xu , Qihang Yu , Alan Yuille , Daguang Xu

Synthetic medical data generation has opened up new possibilities in the healthcare domain, offering a powerful tool for simulating clinical scenarios, enhancing diagnostic and treatment quality, gaining granular medical knowledge, and…

图像与视频处理 · 电气工程与系统科学 2024-05-01 Hyungyung Lee , Da Young Lee , Wonjae Kim , Jin-Hwa Kim , Tackeun Kim , Jihang Kim , Leonard Sunwoo , Edward Choi

Radiology report generation aims to automatically provide clinically meaningful descriptions of radiology images such as MRI and X-ray. Although great success has been achieved in natural scene image captioning tasks, radiology report…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Jun Wang , Lixing Zhu , Abhir Bhalerao , Yulan He

Vision-Language Models (VLMs) have significantly advanced automated Radiology Report Generation (RRG). However, existing methods implicitly assume high-quality inputs, overlooking the noise and artifacts prevalent in real-world clinical…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Hongze Zhu , Chen Hu , Jiaxuan Jiang , Hong Liu , Yawen Huang , Ming Hu , Tianyu Wang , Zhijian Wu , Yefeng Zheng

This paper explores training medical vision-language models (VLMs) -- where the visual and language inputs are embedded into a common space -- with a particular focus on scenarios where training data is limited, as is often the case in…

计算机视觉与模式识别 · 计算机科学 2023-04-03 Rhydian Windsor , Amir Jamaludin , Timor Kadir , Andrew Zisserman

Joint image-text embedding extracted from medical images and associated contextual reports is the bedrock for most biomedical vision-and-language (V+L) tasks, including medical visual question answering, clinical image-text retrieval,…

计算机视觉与模式识别 · 计算机科学 2020-09-04 Yikuan Li , Hanyin Wang , Yuan Luo

Automated radiology report generation is essential in clinical practice. However, diagnosing radiological images typically requires physicians 5-10 minutes, resulting in a waste of valuable healthcare resources. Existing studies have not…

多媒体 · 计算机科学 2025-09-16 Jing Xiao , Hongfei Liu , Ruiqi Dong , Jimin Liu , Haoyong Yu

Automating medical reports for retinal images requires a sophisticated blend of visual pattern recognition and deep clinical knowledge. Current Large Vision-Language Models (LVLMs) often struggle in specialized medical fields where data is…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Nagur Shareef Shaik , Teja Krishna Cherukuri , Dong Hye Ye

The development of medical science greatly depends on the increased utilization of machine learning algorithms. By incorporating machine learning, the medical imaging field can significantly improve in terms of the speed and accuracy of the…

图像与视频处理 · 电气工程与系统科学 2024-09-01 Angona Biswas , MD Abdullah Al Nasim , Md Shahin Ali , Ismail Hossain , Md Azim Ullah , Sajedul Talukder

Automated radiology report generation is key for reducing radiologist workload and improving diagnostic consistency, yet generating accurate reports for 3D medical imaging remains challenging. Existing vision-language models face two…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Pengcheng Shi , Minghui Zhang , Kehan Song , Jiaqi Liu , Yun Gu , Xinglin Zhang