English
Related papers

Related papers: UrFound: Towards Universal Retinal Foundation Mode…

200 papers

Vision foundation models have attracted significant attention for their ability to leverage large-scale unlabeled visual data. This advantage is particularly important in remote sensing, where data acquisition is costly and annotation often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hyobin Park , Minseok Seo , Dong-Geol Choi

Artificial Intelligence in medicine is traditionally limited by the lack of massive training datasets. Foundation models, pre-trained models that can be adapted to downstream tasks with small datasets, could alleviate this problem.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Justin Engelmann , Miguel O. Bernabeu

Machine learning models of vastly different modalities and architectures are being trained to predict the behavior of molecules, materials, and proteins. However, it remains unclear whether they learn similar internal representations of…

Machine Learning · Computer Science 2025-12-04 Sathya Edamadaka , Soojung Yang , Ju Li , Rafael Gómez-Bombarelli

The rise of imaging techniques such as optical coherence tomography (OCT) and advances in deep learning (DL) have enabled clinicians and researchers to streamline retinal disease staging. A popular DL approach is self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Ronald Fecso , José Morano , Ursula Schmidt-Erfurth , Hrvoje Bogunović

Automated diagnosis based on color fundus photography is essential for large-scale glaucoma screening. However, existing deep learning models are typically data-driven and lack explicit integration of retinal anatomical knowledge, which…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yuzhuo Zhou , Chi Liu , Sheng Shen , Zongyuan Ge , Fengshi Jing , Shiran Zhang , Yu Jiang , Anli Wang , Wenjian Liu , Feilong Yang , Tianqing Zhu , Xiaotong Han

Retinal lesions play a vital role in the accurate classification of retinal abnormalities. Many researchers have proposed deep lesion-aware screening systems that analyze and grade the progression of retinopathy. However, to the best of our…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Taimur Hassan , Muhammad Usman Akram , Naoufel Werghi

Image fusion aims to integrate complementary information from multiple source images to produce a more informative and visually consistent representation, benefiting both human perception and downstream vision tasks. Despite recent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xingyuan Li , Songcheng Du , Yang Zou , HaoYuan Xu , Zhiying Jiang , Jinyuan Liu

Ultra-widefield (UWF) imaging is a promising modality that captures a larger retinal field of view compared to traditional fundus photography. Previous studies showed that deep learning (DL) models are effective for detecting retinal…

Image and Video Processing · Electrical Eng. & Systems 2022-03-14 Justin Engelmann , Alice D. McTrusty , Ian J. C. MacCormick , Emma Pead , Amos Storkey , Miguel O. Bernabeu

Current retinal foundation models remain constrained by curated research datasets that lack authentic clinical context, and require extensive task-specific optimization for each application, limiting their deployment efficiency in…

Spectral imaging data acquired via multispectral and hyperspectral cameras can have hundreds of channels, where each channel records the reflectance at a specific wavelength and bandwidth. Time and resource constraints limit our ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 William Michael Laprade , Jesper Cairo Westergaard , Svend Christensen , Mads Nielsen , Anders Bjorholm Dahl

Fundus imaging such as CFP, OCT and UWF is crucial for the early detection of retinal anomalies and diseases. Fundus image understanding, due to its knowledge-intensive nature, poses a challenging vision-language task. An emerging approach…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Yuchuan Deng , Qijie Wei , Kaiheng Qian , Jiazhen Liu , Zijie Xin , Bangxiang Lan , Jingyu Liu , Jianfeng Dong , Xirong Li

Visual impairment represents a major global health challenge, with multimodal imaging providing complementary information that is essential for accurate ophthalmic diagnosis. This comprehensive survey systematically reviews the latest…

Image and Video Processing · Electrical Eng. & Systems 2025-08-07 Xiaoling Luo , Ruli Zheng , Qiaojian Zheng , Zibo Du , Shuo Yang , Meidan Ding , Qihao Xu , Chengliang Liu , Linlin Shen

Despite significant strides in medical foundation models, the ultrasound domain lacks a comprehensive solution capable of bridging low-level Ultrasound Grounded Perception (e.g., segmentation, localization) and high-level Ultrasound…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Dengbo Chen , Ziwei Zhao , Kexin Zhang , Shishuang Zhao , Junjie Hou , Yaqian Wang , Nianxi Liao , Anlan Sun , Fei Gao , Jia Ding , Yuhang Liu , Dong Wang

The emergence of deepfake technologies has become a matter of social concern as they pose threats to individual privacy and public security. It is now of great significance to develop reliable deepfake detectors. However, with numerous face…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Liang Shi , Jie Zhang , Shiguang Shan

Vision Foundation Models (VFMs) have become the cornerstone of modern computer vision, offering robust representations across a wide array of tasks. While recent advances allow these models to handle varying input sizes during training,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Bocheng Zou , Mu Cai , Mark Stanley , Dingfu Lu , Yong Jae Lee

This work explores the effectiveness of masked image modelling for learning representations of retinal OCT images. To this end, we leverage Masked Autoencoders (MAE), a simple and scalable method for self-supervised learning, to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Theodoros Pissas , Pablo Márquez-Neila , Sebastian Wolf , Martin Zinkernagel , Raphael Sznitman

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

Deep learning-based methods have achieved encouraging performances in the field of magnetic resonance (MR) image reconstruction. Nevertheless, to properly learn a powerful and robust model, these methods generally require large quantities…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Ruoyou Wu , Cheng Li , Juan Zou , Qiegen Liu , Hairong Zheng , Shanshan Wang

In ophthalmological imaging, multiple imaging systems, such as color fundus, infrared, fluorescein angiography, optical coherence tomography (OCT) or OCT angiography, are often involved to make a diagnosis of retinal disease. Multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Aline Sindel , Bettina Hohberger , Andreas Maier , Vincent Christlein

Large vision foundation models have been widely adopted for retinal disease classification without systematic evidence justifying their parameter requirements. In the present work we address two critical questions: First, are large…

Image and Video Processing · Electrical Eng. & Systems 2025-12-01 David Isztl , Tahm Spitznagel , Gabor Mark Somfai , Rui Santos