English
Related papers

Related papers: FusionFM: Fusing Eye-specific Foundational Models …

200 papers

Purpose: This study introduces the first adaptation of RETFound for joint optic disc (OD) and optic cup (OC) segmentation. RETFound is a well-known foundation model developed for fundus camera and optical coherence tomography images, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zhenyi Zhao , Muthu Rama Krishnan Mookiah , Emanuele Trucco

Retinal imaging is fast, non-invasive, and widely available, offering quantifiable structural and vascular signals for ophthalmic and systemic health assessment. This accessibility creates an opportunity to study how quantitative retinal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zhonghua Wang , Lie Ju , Sijia Li , Wei Feng , Sijin Zhou , Ming Hu , Jianhao Xiong , Xiaoying Tang , Yifan Peng , Mingquan Lin , Yaodong Ding , Yong Zeng , Wenbin Wei , Li Dong , Zongyuan Ge

Vision Foundation Models (VFMs) have become the cornerstone of modern computer vision, offering robust representations across a wide array of tasks. While recent advances allow these models to handle varying input sizes during training,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Bocheng Zou , Mu Cai , Mark Stanley , Dingfu Lu , Yong Jae Lee

Previous foundation models for fundus images were pre-trained with limited disease categories and knowledge base. Here we introduce a knowledge-rich vision-language model (RetiZero) that leverages knowledge from more than 400 fundus…

Artificial intelligence (AI) is vital in ophthalmology, tackling tasks like diagnosis, classification, and visual question answering (VQA). However, existing AI models in this domain often require extensive annotation and are task-specific,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Danli Shi , Weiyi Zhang , Xiaolan Chen , Yexin Liu , Jiancheng Yang , Siyu Huang , Yih Chung Tham , Yingfeng Zheng , Mingguang He

Medical foundation models, pre-trained with large-scale clinical data, demonstrate strong performance in diverse clinically relevant applications. RETFound, trained on nearly one million retinal images, exemplifies this approach in…

Foundation models (FMs) have shown transformative potential in radiology by performing diverse, complex tasks across imaging modalities. Here, we developed CT-FM, a large-scale 3D image-based pre-trained model designed explicitly for…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Suraj Pai , Ibrahim Hadzic , Dennis Bontempi , Keno Bressem , Benjamin H. Kann , Andriy Fedorov , Raymond H. Mak , Hugo J. W. L. Aerts

The joint interpretation of multi-modal and multi-view fundus images is critical for retinopathy prevention, as different views can show the complete 3D eyeball field and different modalities can provide complementary lesion areas. Compared…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yonghao Huang , Leiting Chen , Chuan Zhou

In order to improve model accuracy, generalization, and class imbalance issues, this work offers a strong methodology for classifying endoscopic images. We suggest a hybrid feature extraction method that combines convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Bidisha Chakraborty , Shree Mitra

Recent advancements in ophthalmology foundation models such as RetFound have demonstrated remarkable diagnostic capabilities but require massive datasets for effective pre-training, creating significant barriers for development and…

Image and Video Processing · Electrical Eng. & Systems 2025-03-25 Qingshan Hou , Meng Wang , Peng Cao , Zou Ke , Xiaoli Liu , Huazhu Fu , Osmar R. Zaiane

Visual impairment represents a major global health challenge, with multimodal imaging providing complementary information that is essential for accurate ophthalmic diagnosis. This comprehensive survey systematically reviews the latest…

Image and Video Processing · Electrical Eng. & Systems 2025-08-07 Xiaoling Luo , Ruli Zheng , Qiaojian Zheng , Zibo Du , Shuo Yang , Meidan Ding , Qihao Xu , Chengliang Liu , Linlin Shen

Glaucoma is a chronic neurodegenerative condition that can lead to blindness. Early detection and curing are very important in stopping the disease from getting worse for glaucoma patients. The 2D fundus images and optical coherence…

Image and Video Processing · Electrical Eng. & Systems 2023-11-15 Wenyun Li , Chi-Man Pun

Machine fault diagnosis (FD) is a critical task for predictive maintenance, enabling early fault detection and preventing unexpected failures. Despite its importance, existing FD models are operation-specific with limited generalization…

Machine Learning · Computer Science 2025-11-06 Emadeldeen Eldele , Mohamed Ragab , Xu Qing , Edward , Zhenghua Chen , Min Wu , Xiaoli Li , Jay Lee

Diabetic retinopathy is the leading cause of vision loss in working-age adults worldwide, yet under-resourced regions lack ophthalmologists. Current state-of-the-art deep learning systems struggle at these institutions due to limited…

Image and Video Processing · Electrical Eng. & Systems 2025-04-23 Gajan Mohan Raj , Michael G. Morley , Mohammad Eslami

Current multispectral object detection methods often retain extraneous background or noise during feature fusion, limiting perceptual performance. To address this, we propose an innovative feature fusion framework based on cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jifeng Shen , Haibo Zhan , Xin Zuo , Heng Fan , Xiaohui Yuan , Jun Li , Wankou Yang

Ultrasound is widely used in obstetric care due to its safety, accessibility, and real-time imaging. However, interpretation remains operator-dependent and susceptible to noise and artifacts. Deep learning models have shown strong…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Leya Barrientos , Yuexi Du , Nicha C. Dvornek

While foundation models (FMs) offer strong potential for AI-based dementia diagnosis, their integration into federated learning (FL) systems remains underexplored. In this benchmarking study, we systematically evaluate the impact of key…

Accurate diagnosis of glaucoma is challenging, as early-stage changes are subtle and often lack clear structural or appearance cues. Most existing approaches rely on a single modality, such as fundus or optical coherence tomography (OCT),…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhiwei Wang , Yuxing Li , Meilu Zhu , Defeng He , Edmund Y. Lam

Multimodal Large Language Models (MLLMs) have made significant progress in bridging visual perception with high-level textual reasoning. However, they face a fundamental contradiction: while excelling at complex semantic understanding,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yifei She , Huangxuan Wu

The rapid development of Vision Foundation Models (VFMs), particularly Vision Transformers (ViT) and Segment Anything Model (SAM), has sparked significant advances in the field of medical image analysis. These models have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-02-24 Pengchen Liang , Bin Pu , Haishan Huang , Yiwei Li , Hualiang Wang , Weibo Ma , Qing Chang