中文
相关论文

相关论文: Multimodal Image-Text Matching Improves Retrieval-…

200 篇论文

The scarcity of well-annotated diverse medical images is a major hurdle for developing reliable AI models in healthcare. Substantial technical advances have been made in generative foundation models for natural images. Here we develop…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Yuanfeng Ji , Dan Lin , Xiyue Wang , Lu Zhang , Wenhui Zhou , Chongjian Ge , Ruihang Chu , Xiaoli Yang , Junhan Zhao , Junsong Chen , Xiangde Luo , Sen Yang , Jin Fang , Ping Luo , Ruijiang Li

Radiology Report Generation (R2Gen) demonstrates how Multi-modal Large Language Models (MLLMs) can automate the creation of accurate and coherent radiological reports. Existing methods often hallucinate details in text-based reports that…

计算与语言 · 计算机科学 2024-07-19 Manav Nitin Kapadnis , Sohan Patnaik , Abhilash Nandy , Sourjyadip Ray , Pawan Goyal , Debdoot Sheet

Automated radiology report generation from chest X-ray (CXR) images has the potential to improve clinical efficiency and reduce radiologists' workload. However, most datasets, including the publicly available MIMIC-CXR and CheXpert Plus,…

Automated radiology report generation has the potential to improve radiology reporting and alleviate the workload of radiologists. However, the medical report generation task poses unique challenges due to the limited availability of…

计算与语言 · 计算机科学 2023-12-27 Ruoqing Zhao , Xi Wang , Hongliang Dai , Pan Gao , Piji Li

Medical imaging is frequently used in clinical practice and trials for diagnosis and treatment. Writing imaging reports is time-consuming and can be error-prone for inexperienced radiologists. Therefore, automatically generating radiology…

计算与语言 · 计算机科学 2022-04-29 Zhihong Chen , Yan Song , Tsung-Hui Chang , Xiang Wan

Medical image analysis is crucial in modern radiological diagnostics, especially given the exponential growth in medical imaging data. The demand for automated report generation systems has become increasingly urgent. While prior research…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Hao Chen , Wei Zhao , Yingli Li , Tianyang Zhong , Yisong Wang , Youlan Shang , Lei Guo , Junwei Han , Tianming Liu , Jun Liu , Tuo Zhang

Large-scale generative models have demonstrated impressive capabilities in producing visually compelling images, with increasing applications in medical imaging. However, they continue to grapple with hallucination challenges and the…

图像与视频处理 · 电气工程与系统科学 2024-10-24 Anees Ur Rehman Hashmi , Ibrahim Almakky , Mohammad Areeb Qazi , Santosh Sanjeev , Vijay Ram Papineni , Jagalpathy Jagdish , Mohammad Yaqub

Latent Diffusion Models have shown remarkable results in text-guided image synthesis in recent years. In the domain of natural (RGB) images, recent works have shown that such models can be adapted to various vision-language downstream tasks…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Konstantinos Vilouras , Ilias Stogiannidis , Junyu Yan , Alison Q. O'Neil , Sotirios A. Tsaftaris

Interpreting chest X-rays is inherently challenging due to the overlap between anatomical structures and the subtle presentation of many clinically significant pathologies, making accurate diagnosis time-consuming even for experienced…

人工智能 · 计算机科学 2026-04-17 Shantam Srivastava , Mahesh Bhosale , David Doermann , Mingchen Gao

Retrieval-augmented learning based on radiology reports has emerged as a promising direction to improve performance on long-tail medical imaging tasks, such as rare disease detection in chest X-rays. Most existing methods rely on comparing…

机器学习 · 计算机科学 2025-08-28 Felix Nützel , Mischa Dombrowski , Bernhard Kainz

Vision-language models have proven to be of great benefit for medical image analysis since they learn rich semantics from both images and reports. Prior efforts have focused on better alignment of image and text representations to enhance…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Yixiong Chen , Shawn Xu , Andrew Sellergren , Yossi Matias , Avinatan Hassidim , Shravya Shetty , Daniel Golden , Alan Yuille , Lin Yang

Synthetic medical data generation has opened up new possibilities in the healthcare domain, offering a powerful tool for simulating clinical scenarios, enhancing diagnostic and treatment quality, gaining granular medical knowledge, and…

图像与视频处理 · 电气工程与系统科学 2024-05-01 Hyungyung Lee , Da Young Lee , Wonjae Kim , Jin-Hwa Kim , Tackeun Kim , Jihang Kim , Leonard Sunwoo , Edward Choi

Vision-Language Models (VLMs) have significantly advanced automated Radiology Report Generation (RRG). However, existing methods implicitly assume high-quality inputs, overlooking the noise and artifacts prevalent in real-world clinical…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Hongze Zhu , Chen Hu , Jiaxuan Jiang , Hong Liu , Yawen Huang , Ming Hu , Tianyu Wang , Zhijian Wu , Yefeng Zheng

Joint embeddings between medical imaging modalities and associated radiology reports have the potential to offer significant benefits to the clinical community, ranging from cross-domain retrieval to conditional generation of reports to the…

机器学习 · 计算机科学 2018-11-28 Tzu-Ming Harry Hsu , Wei-Hung Weng , Willie Boag , Matthew McDermott , Peter Szolovits

Automatic extraction of medical conditions from free-text radiology reports is critical for supervising computer vision models to interpret medical images. In this work, we show that radiologists labeling reports significantly disagree with…

Automated radiology report generation holds significant potential to reduce radiologists' workload and enhance diagnostic accuracy. However, generating precise and clinically meaningful reports from chest radiographs remains challenging due…

图像与视频处理 · 电气工程与系统科学 2026-05-20 Md. Zihad Bin Jahangir , Muhammad Ashad Kabir , Sumaiya Akter , Israt Jahan , Minh Chau

Recently, chest X-ray report generation, which aims to automatically generate descriptions of given chest X-ray images, has received growing research interests. The key challenge of chest X-ray report generation is to accurately capture and…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Fenglin Liu , Changchang Yin , Xian Wu , Shen Ge , Yuexian Zou , Ping Zhang , Yuexian Zou , Xu Sun

Radiologists highly desire fully automated versatile AI for medical imaging interpretation. However, the lack of extensively annotated large-scale multi-disease datasets has hindered the achievement of this goal. In this paper, we explore…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Weiwei Cao , Jianpeng Zhang , Yingda Xia , Tony C. W. Mok , Zi Li , Xianghua Ye , Le Lu , Jian Zheng , Yuxing Tang , Ling Zhang

Generating radiology reports automatically reduces the workload of radiologists and helps the diagnoses of specific diseases. Many existing methods take this task as modality transfer process. However, since the key information related to…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Yitian Tao , Liyan Ma , Jing Yu , Han Zhang

With the emergence of large-scale vision language models (VLM), it is now possible to produce realistic-looking radiology reports for chest X-ray images. However, their clinical translation has been hampered by the factual errors and…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Razi Mahmood , Diego Machado-Reyes , Joy Wu , Parisa Kaviani , Ken C. L. Wong , Niharika D'Souza , Mannudeep Kalra , Ge Wang , Pingkun Yan , Tanveer Syeda-Mahmood