English
Related papers

Related papers: Intensive Vision-guided Network for Radiology Repo…

200 papers

Automatically generating medical reports for retinal images is one of the promising ways to help ophthalmologists reduce their workload and improve work efficiency. In this work, we propose a new context-driven encoding network to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jia-Hong Huang , Ting-Wei Wu , Chao-Han Huck Yang , Marcel Worring

Radiology report generation (RRG) has gained increasing research attention because of its huge potential to mitigate medical resource shortages and aid the process of disease decision making by radiologists. Recent advancements in RRG are…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jun Wang , Abhir Bhalerao , Terry Yin , Simon See , Yulan He

The integration of visual encoders and large language models (LLMs) has driven recent progress in multimodal large language models (MLLMs). However, the scarcity of high-quality instruction-tuning data for vision-language tasks remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Bin Wang , Fan Wu , Xiao Han , Jiahui Peng , Huaping Zhong , Pan Zhang , Xiaoyi Dong , Weijia Li , Wei Li , Jiaqi Wang , Conghui He

The automatic generation of radiology reports given medical radiographs has significant potential to operationally and improve clinical patient care. A number of prior works have focused on this problem, employing advanced methods from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Guanxiong Liu , Tzu-Ming Harry Hsu , Matthew McDermott , Willie Boag , Wei-Hung Weng , Peter Szolovits , Marzyeh Ghassemi

Radiology report generation (RRG) has emerged as a promising approach to alleviate radiologists' workload and reduce human errors by automatically generating diagnostic reports from medical images. A key challenge in RRG is achieving…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Yucheng Chen , Yang Yu , Yufei Shi , Conghao Xiong , Xulei Yang , Si Yong Yeo

Vision-Language Models (VLMs) have demonstrated remarkable success in natural language generation, excelling at instruction following and structured output generation. Knowledge graphs play a crucial role in radiology, serving as valuable…

Computation and Language · Computer Science 2025-05-26 Abdullah Abdullah , Seong Tae Kim

Medical vision-language models (VLMs) achieve strong performance in diagnostic reporting and image-text alignment, yet their underlying reasoning mechanisms remain fundamentally correlational, exhibiting reliance on superficial statistical…

Machine Learning · Computer Science 2026-01-27 Weiqin Yang , Haowen Xue , Qingyi Peng , Hexuan Hu , Qian Huang , Tingbo Zhang

Infrared and visible dual-modality tasks such as semantic segmentation and object detection can achieve robust performance even in extreme scenes by fusing complementary information. Most current methods design task-specific frameworks,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Fangcen Liu , Chenqiang Gao , Fang Chen , Pengcheng Li , Junjie Guo , Deyu Meng

Medical imaging is frequently used in clinical practice and trials for diagnosis and treatment. Writing imaging reports is time-consuming and can be error-prone for inexperienced radiologists. Therefore, automatically generating radiology…

Computation and Language · Computer Science 2022-04-29 Zhihong Chen , Yan Song , Tsung-Hui Chang , Xiang Wan

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

Endoscopic procedures such as esophagogastroduodenoscopy (EGD) and colonoscopy play a critical role in diagnosing and managing gastrointestinal (GI) disorders. However, the documentation burden associated with these procedures place…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Evandros Kaklamanos , Kristjana Kristinsdottir , Jonathan Huang , Dustin Carlson , Rajesh Keswani , John Pandolfino , Mozziyar Etemadi

Radiology plays a pivotal role in modern medicine due to its non-invasive diagnostic capabilities. However, the manual generation of unstructured medical reports is time consuming and prone to errors. It creates a significant bottleneck in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Md. Rakibul Islam , Md. Zahid Hossain , Mustofa Ahmed , Most. Sharmin Sultana Samu

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Iryna Hartsock , Ghulam Rasool

Large vision-language models (LVMs) hold a great promise for automating medical report generation, potentially reducing the burden of manual reporting. State-of-the-art (SOTA) research fine-tunes general LVMs with medical data to align…

Computation and Language · Computer Science 2025-04-07 Hao Wang , Shuchang Ye , Jinghao Lin , Usman Naseem , Jinman Kim

Computed tomography (CT) report generation is crucial to assist radiologists in interpreting CT volumes, which can be time-consuming and labor-intensive. Existing methods primarily only consider the global features of the entire volume,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Zhixuan Chen , Yequan Bie , Haibo Jin , Hao Chen

Automatic generation of ophthalmic reports using data-driven neural networks has great potential in clinical practice. When writing a report, ophthalmologists make inferences with prior clinical knowledge. This knowledge has been neglected…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Mingjie Li , Wenjia Cai , Karin Verspoor , Shirui Pan , Xiaodan Liang , Xiaojun Chang

Drafting radiology reports is a complex task requiring flexibility, where radiologists tail content to available information and particular clinical demands. However, most current radiology report generation (RRG) models are constrained to…

Computation and Language · Computer Science 2024-12-17 Zhuhao Wang , Yihua Sun , Zihan Li , Xuan Yang , Fang Chen , Hongen Liao

Computer-aided diagnosis (CADx) has become vital in medical imaging, but automated systems often struggle to replicate the nuanced process of clinical interpretation. Expert diagnosis requires a comprehensive analysis of how abnormalities…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Tran Bao Sam , Hung Vu , Dao Trung Kien , Tran Dat Dang , Van Ha Tang , Steven Truong

Medical report generation from imaging data remains a challenging task in clinical practice. While large language models (LLMs) show great promise in addressing this challenge, their effective integration with medical imaging data still…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Chunlei Li , Jingyang Hou , Yilei Shi , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

Recent advancements in artificial intelligence have significantly improved the automatic generation of radiology reports. However, existing evaluation methods fail to reveal the models' understanding of radiological images and their…

Artificial Intelligence · Computer Science 2024-08-27 Xiaoman Zhang , Julián N. Acosta , Hong-Yu Zhou , Pranav Rajpurkar