中文
相关论文

相关论文: Intensive Vision-guided Network for Radiology Repo…

200 篇论文

Automatically generating medical reports for retinal images is one of the promising ways to help ophthalmologists reduce their workload and improve work efficiency. In this work, we propose a new context-driven encoding network to…

计算机视觉与模式识别 · 计算机科学 2021-06-01 Jia-Hong Huang , Ting-Wei Wu , Chao-Han Huck Yang , Marcel Worring

Radiology report generation (RRG) has gained increasing research attention because of its huge potential to mitigate medical resource shortages and aid the process of disease decision making by radiologists. Recent advancements in RRG are…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Jun Wang , Abhir Bhalerao , Terry Yin , Simon See , Yulan He

The integration of visual encoders and large language models (LLMs) has driven recent progress in multimodal large language models (MLLMs). However, the scarcity of high-quality instruction-tuning data for vision-language tasks remains a…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Bin Wang , Fan Wu , Xiao Han , Jiahui Peng , Huaping Zhong , Pan Zhang , Xiaoyi Dong , Weijia Li , Wei Li , Jiaqi Wang , Conghui He

The automatic generation of radiology reports given medical radiographs has significant potential to operationally and improve clinical patient care. A number of prior works have focused on this problem, employing advanced methods from…

计算机视觉与模式识别 · 计算机科学 2019-07-30 Guanxiong Liu , Tzu-Ming Harry Hsu , Matthew McDermott , Willie Boag , Wei-Hung Weng , Peter Szolovits , Marzyeh Ghassemi

Radiology report generation (RRG) has emerged as a promising approach to alleviate radiologists' workload and reduce human errors by automatically generating diagnostic reports from medical images. A key challenge in RRG is achieving…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Yucheng Chen , Yang Yu , Yufei Shi , Conghao Xiong , Xulei Yang , Si Yong Yeo

Vision-Language Models (VLMs) have demonstrated remarkable success in natural language generation, excelling at instruction following and structured output generation. Knowledge graphs play a crucial role in radiology, serving as valuable…

计算与语言 · 计算机科学 2025-05-26 Abdullah Abdullah , Seong Tae Kim

Medical vision-language models (VLMs) achieve strong performance in diagnostic reporting and image-text alignment, yet their underlying reasoning mechanisms remain fundamentally correlational, exhibiting reliance on superficial statistical…

机器学习 · 计算机科学 2026-01-27 Weiqin Yang , Haowen Xue , Qingyi Peng , Hexuan Hu , Qian Huang , Tingbo Zhang

Infrared and visible dual-modality tasks such as semantic segmentation and object detection can achieve robust performance even in extreme scenes by fusing complementary information. Most current methods design task-specific frameworks,…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Fangcen Liu , Chenqiang Gao , Fang Chen , Pengcheng Li , Junjie Guo , Deyu Meng

Medical imaging is frequently used in clinical practice and trials for diagnosis and treatment. Writing imaging reports is time-consuming and can be error-prone for inexperienced radiologists. Therefore, automatically generating radiology…

计算与语言 · 计算机科学 2022-04-29 Zhihong Chen , Yan Song , Tsung-Hui Chang , Xiang Wan

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

机器学习 · 计算机科学 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

Endoscopic procedures such as esophagogastroduodenoscopy (EGD) and colonoscopy play a critical role in diagnosing and managing gastrointestinal (GI) disorders. However, the documentation burden associated with these procedures place…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Evandros Kaklamanos , Kristjana Kristinsdottir , Jonathan Huang , Dustin Carlson , Rajesh Keswani , John Pandolfino , Mozziyar Etemadi

Radiology plays a pivotal role in modern medicine due to its non-invasive diagnostic capabilities. However, the manual generation of unstructured medical reports is time consuming and prone to errors. It creates a significant bottleneck in…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Md. Rakibul Islam , Md. Zahid Hossain , Mustofa Ahmed , Most. Sharmin Sultana Samu

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Iryna Hartsock , Ghulam Rasool

Large vision-language models (LVMs) hold a great promise for automating medical report generation, potentially reducing the burden of manual reporting. State-of-the-art (SOTA) research fine-tunes general LVMs with medical data to align…

计算与语言 · 计算机科学 2025-04-07 Hao Wang , Shuchang Ye , Jinghao Lin , Usman Naseem , Jinman Kim

Computed tomography (CT) report generation is crucial to assist radiologists in interpreting CT volumes, which can be time-consuming and labor-intensive. Existing methods primarily only consider the global features of the entire volume,…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Zhixuan Chen , Yequan Bie , Haibo Jin , Hao Chen

Automatic generation of ophthalmic reports using data-driven neural networks has great potential in clinical practice. When writing a report, ophthalmologists make inferences with prior clinical knowledge. This knowledge has been neglected…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Mingjie Li , Wenjia Cai , Karin Verspoor , Shirui Pan , Xiaodan Liang , Xiaojun Chang

Drafting radiology reports is a complex task requiring flexibility, where radiologists tail content to available information and particular clinical demands. However, most current radiology report generation (RRG) models are constrained to…

计算与语言 · 计算机科学 2024-12-17 Zhuhao Wang , Yihua Sun , Zihan Li , Xuan Yang , Fang Chen , Hongen Liao

Computer-aided diagnosis (CADx) has become vital in medical imaging, but automated systems often struggle to replicate the nuanced process of clinical interpretation. Expert diagnosis requires a comprehensive analysis of how abnormalities…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Tran Bao Sam , Hung Vu , Dao Trung Kien , Tran Dat Dang , Van Ha Tang , Steven Truong

Medical report generation from imaging data remains a challenging task in clinical practice. While large language models (LLMs) show great promise in addressing this challenge, their effective integration with medical imaging data still…

计算机视觉与模式识别 · 计算机科学 2025-06-19 Chunlei Li , Jingyang Hou , Yilei Shi , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

Recent advancements in artificial intelligence have significantly improved the automatic generation of radiology reports. However, existing evaluation methods fail to reveal the models' understanding of radiological images and their…

人工智能 · 计算机科学 2024-08-27 Xiaoman Zhang , Julián N. Acosta , Hong-Yu Zhou , Pranav Rajpurkar