English
Related papers

Related papers: When Do Domain-Specific Foundation Models Justify …

200 papers

Vision-transformers (ViTs) and large-scale convolution-neural-networks (CNNs) have reshaped computer vision through pretrained feature representations that enable strong transfer learning for diverse tasks. However, their efficiency as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alon Kaya , Igal Bilik , Inna Stainvas

Large pretrained transformers are increasingly being developed as generalised foundation models which can underpin powerful task-specific artificial intelligence models. Histopathology foundation models show great promise across many tasks,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Jack Breen , Katie Allen , Kieran Zucker , Lucy Godson , Nicolas M. Orsi , Nishant Ravikumar

Retinal imaging is fast, non-invasive, and widely available, offering quantifiable structural and vascular signals for ophthalmic and systemic health assessment. This accessibility creates an opportunity to study how quantitative retinal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zhonghua Wang , Lie Ju , Sijia Li , Wei Feng , Sijin Zhou , Ming Hu , Jianhao Xiong , Xiaoying Tang , Yifan Peng , Mingquan Lin , Yaodong Ding , Yong Zeng , Wenbin Wei , Li Dong , Zongyuan Ge

Deep learning-based models are developed to automatically detect if a retina image is `referable' in diabetic retinopathy (DR) screening. However, their classification accuracy degrades as the input images distributionally shift from their…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Jay Nandy , Wynne Hsu , Mong Li Lee

Foundation models provide robust embeddings for diverse tasks, including medical imaging. We evaluate embeddings from seven general and medical-specific foundation models (e.g., DenseNet121, BiomedCLIP, MedImageInsight, Rad-DINO,…

Towards automated retinal screening, this paper makes an endeavor to simultaneously achieve pixel-level retinal lesion segmentation and image-level disease classification. Such a multi-task approach is crucial for accurate and clinically…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Qijie Wei , Xirong Li , Weihong Yu , Xiao Zhang , Yongpeng Zhang , Bojie Hu , Bin Mo , Di Gong , Ning Chen , Dayong Ding , Youxin Chen

Purpose To develop a computer based method for the automated assessment of image quality in the context of diabetic retinopathy (DR) to guide the photographer. Methods A deep learning framework was trained to grade the images automatically.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-08 Sajib Kumar Saha , Basura Fernando , Jorge Cuadros , Di Xiao , Yogesan Kanagasingam

Despite the revolutionary impact of AI and the development of locally trained algorithms, achieving widespread generalized learning from multi-modal data in medical AI remains a significant challenge. This gap hinders the practical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Fatema-E Jannat , Sina Gholami , Minhaj Nur Alam , Hamed Tabkhi

The rapid growth of medical imaging has fueled the development of Foundation Models (FMs) to reduce the growing, unsustainable workload on radiologists. While recent FMs have shown the power of large-scale pre-training to CT and MRI…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Antoine Saporta , Baptiste Callard , Corentin Dancette , Julien Khlaut , Charles Corbière , Leo Butsanets , Amaury Prat , Pierre Manceron

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Diabetic retinopathy (DR) is a leading cause of blindness worldwide and a common complication of diabetes. As two different imaging tools for DR grading, color fundus photography (CFP) and infrared fundus photography (IFP) are…

Image and Video Processing · Electrical Eng. & Systems 2024-11-04 Fan Xiao , Junlin Hou , Ruiwei Zhao , Rui Feng , Haidong Zou , Lina Lu , Yi Xu , Juzhao Zhang

Diabetic retinopathy (DR) is a leading cause of vision impairment worldwide, and automated grading systems play a crucial role in large-scale screening programs. However, deep learning models often exhibit degraded performance when deployed…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Afshan Hashmi

Current retinal foundation models remain constrained by curated research datasets that lack authentic clinical context, and require extensive task-specific optimization for each application, limiting their deployment efficiency in…

Existing X-ray based pre-trained vision models are usually conducted on a relatively small-scale dataset (less than 500k samples) with limited resolution (e.g., 224 $\times$ 224). However, the key to the success of self-supervised…

Image and Video Processing · Electrical Eng. & Systems 2024-04-30 Xiao Wang , Yuehang Li , Wentao Wu , Jiandong Jin , Yao Rong , Bo Jiang , Chuanfu Li , Jin Tang

Retinal foundation models have significantly advanced retinal image analysis by leveraging self-supervised learning to reduce dependence on labeled data while achieving strong generalization. Many recent approaches enhance retinal image…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Yeonkyung Lee , Woojung Han , Youngjun Jun , Hyeonmin Kim , Jungkyung Cho , Seong Jae Hwang

Ophthalmic images may contain identical-looking pathologies that can cause failure in automated techniques to distinguish different retinal degenerative diseases. Additionally, reliance on large annotated datasets and lack of knowledge…

Image and Video Processing · Electrical Eng. & Systems 2022-08-02 Sharif Amit Kamran , Khondker Fariha Hossain , Alireza Tavakkoli , Stewart Lee Zuckerbrod , Salah A. Baker

Recent advancements in foundation models, typically trained with self-supervised learning on large-scale and diverse datasets, have shown great potential in medical image analysis. However, due to the significant spatial heterogeneity of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Lingxiao Luo , Xuanzhong Chen , Bingda Tang , Xinsheng Chen , Rong Han , Chengpeng Hu , Yujiang Li , Ting Chen

The ultra-wide optical coherence tomography angiography (OCTA) has become an important imaging modality in diabetic retinopathy (DR) diagnosis. However, there are few researches focusing on automatic DR analysis using ultra-wide OCTA. In…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Junlin Hou , Fan Xiao , Jilan Xu , Yuejie Zhang , Haidong Zou , Rui Feng

It is feasible to recognize the presence and seriousness of eye disease by investigating the progressions in retinal biological structure. Fundus examination is a diagnostic procedure to examine the biological structure and anomaly of the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Amit Bhati , Neha Gour , Pritee Khanna , Aparajita Ojha

Annotated training data insufficiency remains to be one of the challenges of applying deep learning in medical data classification problems. Transfer learning from an already trained deep convolutional network can be used to reduce the cost…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Misgina Tsighe Hagos , Shri Kant