English
Related papers

Related papers: Insight: A Multi-Modal Diagnostic Pipeline using L…

200 papers

In recent years, large language models (LLMs) have demonstrated remarkable potential across various medical applications. Building on this foundation, multimodal large language models (MLLMs) integrate LLMs with visual models to process…

Computation and Language · Computer Science 2025-03-11 Xiaoyi Liang , Mouxiao Bian , Moxin Chen , Lihao Liu , Junjun He , Jie Xu , Lin Li

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Artificial Intelligence · Computer Science 2025-08-06 Mahtab Bigverdi , Wisdom Ikezogwo , Kevin Zhang , Hyewon Jeong , Mingyu Lu , Sungjae Cho , Linda Shapiro , Ranjay Krishna

The potential of Multimodal Large Language Models (MLLMs) in domain of medical imaging raise the demands of systematic and rigorous evaluation frameworks that are aligned with the real-world medical imaging practice. Existing practices that…

Computation and Language · Computer Science 2026-04-16 Zhijie Bao , Fangke Chen , Licheng Bao , Chenhui Zhang , Wei Chen , Jiajie Peng , Zhongyu Wei

Automatic disease diagnosis has become increasingly valuable in clinical practice. The advent of large language models (LLMs) has catalyzed a paradigm shift in artificial intelligence, with growing evidence supporting the efficacy of LLMs…

Medical Large Vision-Language Models (Med-LVLMs) demonstrate significant potential in healthcare, but their reliance on general medical data and coarse-grained global visual understanding limits them in intelligent ophthalmic diagnosis.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Sijing Li , Tianwei Lin , Lingshuai Lin , Wenqiao Zhang , Jiang Liu , Xiaoda Yang , Juncheng Li , Yucheng He , Xiaohui Song , Jun Xiao , Yueting Zhuang , Beng Chin Ooi

Diabetic retinopathy (DR) is a leading cause of blindness worldwide, and AI systems can expand access to fundus photography screening. Current FDA-cleared systems primarily provide binary referral outputs, where this minimal output may…

Artificial Intelligence · Computer Science 2025-09-17 Nadim Barakat , William Lotter

Accurate diagnosis of skin diseases remains a significant challenge due to the complex and diverse visual features present in dermatoscopic images, often compounded by a lack of interpretability in existing purely visual diagnostic models.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Kexin Yu , Zihan Xu , Jialei Xie , Carter Adams

Vision-threatening eye diseases pose a major global health burden, with timely diagnosis limited by workforce shortages and restricted access to specialized care. While multimodal large language models (MLLMs) show promise for medical image…

Colonoscopic polyp diagnosis is pivotal for early colorectal cancer detection, yet traditional automated reporting suffers from inconsistencies and hallucinations due to the scarcity of high-quality multimodal medical data. To bridge this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Tianyu Zhou , Junyi Tang , Zehui Li , Dahong Qian , Suncheng Xiang

This study aimed to enhance disease classification accuracy from retinal fundus images by integrating fine-grained image features and global textual context using a novel multimodal deep learning architecture. Existing multimodal large…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Jason Jordan , Mohammadreza Akbari Lor , Peter Koulen , Mei-Ling Shyu , Shu-Ching Chen

With the development of natural language processing techniques(NLP), automatic diagnosis of eye diseases using ophthalmology electronic medical records (OEMR) has become possible. It aims to evaluate the condition of both eyes of a patient…

Computation and Language · Computer Science 2023-01-12 Xu Ye , Meng Xiao , Zhiyuan Ning , Weiwei Dai , Wenjuan Cui , Yi Du , Yuanchun Zhou

Depression remains widely underdiagnosed and undertreated because stigma and subjective symptom ratings hinder reliable screening. To address this challenge, we propose a coarse-to-fine, multi-stage framework that leverages large language…

Artificial Intelligence · Computer Science 2026-04-14 Shiyu Teng , Jiaqing Liu , Hao Sun , Yu Li , Shurong Chai , Ruibo Hou , Tomoko Tateyama , Lanfen Lin , Yen-Wei Chen

The advancement of general medical Multimodal Large Language Models (MLLMs) has shown great potential for building conversational assistants to support clinical diagnosis. However, their adaptation to highly specialized domains such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xuanzhao Dong , Wenhui Zhu , Xiwen Chen , Hao Wang , Xin Li , Yujian Xiong , Jiajun Cheng , Jingjing Wang , Xiaobing Yu , Haiyu Wu , Shao Tang , Zhipeng Wang , Langechuan Liu , Shan Lin , Oana Dumitrascu , Yalin Wang

Preventable or undiagnosed visual impairment and blindness affect billion of people worldwide. Automated multi-disease detection models offer great potential to address this problem via clinical decision support in diagnosis. In this work,…

Image and Video Processing · Electrical Eng. & Systems 2021-03-30 Dominik Müller , Iñaki Soto-Rey , Frank Kramer

Background: Patient recruitment in clinical trials is hindered by complex eligibility criteria and labor-intensive chart reviews. Prior research using text-only models have struggled to address this problem in a reliable and scalable way…

Computation and Language · Computer Science 2025-03-20 Anatole Callies , Quentin Bodinier , Philippe Ravaud , Kourosh Davarpanah

Recent advancements in Large Language Models (LLMs) have demonstrated significant promise in clinical diagnosis. However, current models struggle to emulate the iterative, diagnostic hypothesis-driven reasoning of real clinical scenarios.…

Computation and Language · Computer Science 2026-01-06 Qipeng Wang , Rui Sheng , Yafei Li , Huamin Qu , Yushi Sun , Min Zhu

Ophthalmic image segmentation serves as a critical foundation for ocular disease diagnosis. Although fully convolutional neural networks (CNNs) are commonly employed for segmentation, they are constrained by inductive biases and face…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Zunjie Xiao , Xiaoqing Zhang , Risa Higashita , Jiang Liu

In recent years, pre-trained large language models (LLMs) have achieved tremendous success in the field of Natural Language Processing (NLP). Prior studies have primarily focused on general and generic domains, with relatively less research…

The prevalence of vision-threatening eye diseases is a significant global burden, with many cases remaining undiagnosed or diagnosed too late for effective treatment. Large vision-language models (LVLMs) have the potential to assist in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Zhenyue Qin , Yu Yin , Dylan Campbell , Xuansheng Wu , Ke Zou , Yih-Chung Tham , Ninghao Liu , Xiuzhen Zhang , Qingyu Chen
‹ Prev 1 2 3 10 Next ›