English
Related papers

Related papers: LLM-driven Multimodal Target Volume Contouring in …

200 papers

Medical report generation from imaging data remains a challenging task in clinical practice. While large language models (LLMs) show great promise in addressing this challenge, their effective integration with medical imaging data still…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Chunlei Li , Jingyang Hou , Yilei Shi , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

The high incidence and mortality rates associated with respiratory diseases underscores the importance of early screening. Machine learning models can automate clinical consultations and auscultation, offering vital support in this area.…

Machine Learning · Computer Science 2024-10-10 Yuwei Zhang , Tong Xia , Aaqib Saeed , Cecilia Mascolo

Writing radiology reports from medical images requires a high level of domain expertise. It is time-consuming even for trained radiologists and can be error-prone for inexperienced radiologists. It would be appealing to automate this task…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yuzhe Lu , Sungmin Hong , Yash Shah , Panpan Xu

Multidisciplinary tumour boards (MDTBs) play a central role in oncology decision-making but require manual processes and structuring large volumes of heterogeneous clinical information, resulting in a substantial documentation burden. In…

Computation and Language · Computer Science 2026-01-28 Luis Lorenzo , Marcos Montana-Mendez , Sergio Figueiras , Miguel Boubeta , Cristobal Bernardo-Castineira

Deep learning has demonstrated remarkable success in medical image segmentation and computer-aided diagnosis. In particular, numerous advanced methods have achieved state-of-the-art performance in brain tumor segmentation from MRI scans.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xiaoyu Shi , Rahul Kumar Jain , Yinhao Li , Ruibo Hou , Jingliang Cheng , Jie Bai , Guohua Zhao , Lanfen Lin , Rui Xu , Yen-wei Chen

Large language models (LLMs) have shown remarkable progress in encoding clinical knowledge and responding to complex medical queries with appropriate clinical reasoning. However, their applicability in subspecialist or complex medical…

The early detection of glottic carcinoma is critical for improving patient outcomes, as it enables timely intervention, preserves vocal function, and significantly reduces the risk of tumor progression and metastasis. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Zhaohui Jin , Yi Shuai , Yongcheng Li , Lingcong Cai , Yun Li , Huifen Liu , Xiaomao Fan

Automated interpretation of chest X-rays (CXR) is a critical task with the potential to significantly improve clinical workflow and patient care. While recent advances in multimodal foundation models have shown promise, effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Alexander Davis , Rafael Souza , Jia-Hao Lim

Breast cancer remains the most commonly diagnosed malignancy among women in the developed world. Early detection through mammography screening plays a pivotal role in reducing mortality rates. While computer-aided diagnosis (CAD) systems…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

Large Vision-Language Models (LVLMs) are capable of handling diverse data types such as imaging, text, and physiological signals, and can be applied in various fields. In the medical field, LVLMs have a high potential to offer substantial…

Lung cancer remains one of the most prevalent and fatal diseases worldwide, demanding accurate and timely diagnosis and treatment. Recent advancements in large AI models have significantly enhanced medical image understanding and clinical…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Jiachen Zhong , Yiting Wang , Di Zhu , Ziwei Wang

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

Artificial Intelligence · Computer Science 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Large language models (LLMs) have demonstrated immense capabilities in understanding textual data and are increasingly being adopted to help researchers accelerate scientific discovery through knowledge extraction (information retrieval),…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Robinson Umeike , Neil Getty , Fangfang Xia , Rick Stevens

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

Recent advances in artificial intelligence, particularly large language models LLMs, have shown promising capabilities in transforming rare disease research. This survey paper explores the integration of LLMs in the analysis of rare…

Computation and Language · Computer Science 2025-05-26 Valentina Carbonari , Pierangelo Veltri , Pietro Hiram Guzzi

With the advancement of Large Language Model (LLM) for natural language processing, this paper presents an intriguing finding: a frozen pre-trained LLM layer can process visual tokens for medical image segmentation tasks. Specifically, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Fenghe Tang , Wenxin Ma , Zhiyang He , Xiaodong Tao , Zihang Jiang , S. Kevin Zhou

This study presents a multimodal AI framework designed for precisely classifying medical diagnostic images. Utilizing publicly available datasets, the proposed system compares the strengths of convolutional neural networks (CNNs) and…

Image and Video Processing · Electrical Eng. & Systems 2025-06-04 Shibbir Ahmed , Shahnewaz Karim Sakib , Anindya Bijoy Das

In the era of large language models (LLMs) and artificial general intelligence (AGI), computer audition must evolve beyond traditional paradigms to fully leverage the capabilities of foundation models, towards more comprehensive…

The rapid evolution of artificial intelligence, especially in large language models (LLMs), has significantly impacted various domains, including healthcare. In chest X-ray (CXR) analysis, previous studies have employed LLMs, but with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jonggwon Park , Soobum Kim , Byungmu Yoon , Jihun Hyun , Kyoyun Choi

Large Language Models (LLMs) have rapidly evolved from text-based systems to multimodal platforms, significantly impacting various sectors including healthcare. This comprehensive review explores the progression of LLMs to Multimodal Large…