English
Related papers

Related papers: PRETI: Patient-Aware Retinal Foundation Model via …

200 papers

Foundation vision-language models are currently transforming computer vision, and are on the rise in medical imaging fueled by their very promising generalization capabilities. However, the initial attempts to transfer this new paradigm to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Julio Silva-Rodríguez , Hadi Chakor , Riadh Kobbi , Jose Dolz , Ismail Ben Ayed

Deep learning models have made significant advances in histological prediction tasks in recent years. However, for adaptation in clinical practice, their lack of robustness to varying conditions such as staining, scanner, hospital, and…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 David Jacob Drexlin , Jonas Dippel , Julius Hense , Niklas Prenißl , Grégoire Montavon , Frederick Klauschen , Klaus-Robert Müller

We introduce SLIMP (Skin Lesion Image-Metadata Pre-training) for learning rich representations of skin lesions through a novel nested contrastive learning approach that captures complex relationships between images and metadata. Melanoma…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Dionysis Christopoulos , Sotiris Spanos , Eirini Baltzi , Valsamis Ntouskos , Konstantinos Karantzalos

Pre-training strategies based on self-supervised learning (SSL) have proven to be effective pretext tasks for many downstream tasks in computer vision. Due to the significant disparity between medical and natural images, the application of…

Foundation models have recently attracted significant attention for their impressive generalizability across diverse downstream tasks. However, these models are demonstrated to exhibit great limitations in representing high-frequency…

Image and Video Processing · Electrical Eng. & Systems 2025-04-18 Yuetan Chu , Yilan Zhang , Zhongyi Han , Changchun Yang , Longxi Zhou , Gongning Luo , Chao Huang , Xin Gao

Purpose: To investigate whether a vision-language foundation model can enhance undersampled MRI reconstruction by providing high-level contextual information beyond conventional priors. Methods: We proposed a semantic distribution-guided…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Ruimin Feng , Xingxin He , Ronald Mercer , Zachary Stewart , Fang Liu

Preventable or undiagnosed visual impairment and blindness affect billion of people worldwide. Automated multi-disease detection models offer great potential to address this problem via clinical decision support in diagnosis. In this work,…

Image and Video Processing · Electrical Eng. & Systems 2021-03-30 Dominik Müller , Iñaki Soto-Rey , Frank Kramer

Recent progress in Medical Artificial Intelligence (AI) has delivered systems that can reach clinical expert level performance. However, such systems tend to demonstrate sub-optimal "out-of-distribution" performance when evaluated in…

Longitudinal imaging is able to capture both static anatomical structures and dynamic changes in disease progression toward earlier and better patient-specific pathology management. However, conventional approaches rarely take advantage of…

Explainable Artificial Intelligence (AI) in the form of an interpretable and semiautomatic approach to stage grading ocular pathologies such as Diabetic retinopathy, Hypertensive retinopathy, and other retinopathies on the backdrop of major…

Image and Video Processing · Electrical Eng. & Systems 2022-12-15 Ayushi Raj Bhatt , Rajkumar Vaghashiya , Meghna Kulkarni , Dr Prakash Kamaraj

Multi-sequence Magnetic Resonance Imaging (MRI) offers remarkable versatility, enabling the distinct visualization of different tissue types. Nevertheless, the inherent heterogeneity among MRI sequences poses significant challenges to the…

Contrastive learning based vision-language joint pre-training has emerged as a successful representation learning strategy. In this paper, we present a prototype representation learning framework incorporating both global and local…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Pujin Cheng , Li Lin , Junyan Lyu , Yijin Huang , Wenhan Luo , Xiaoying Tang

Diabetic retinopathy (DR), affecting millions globally with projections indicating a significant rise, poses a severe blindness risk and strains healthcare systems. Diagnostic complexity arises from visual symptom overlap with conditions…

Image and Video Processing · Electrical Eng. & Systems 2026-01-14 Susmita Kar , A S M Ahsanul Sarkar Akib , Abdul Hasib , Samin Yaser , Anas Bin Azim

Medical image registration is a fundamental task in medical image analysis, aiming to establish spatial correspondences between paired images. However, existing unsupervised deformable registration methods rely solely on intensity-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Hao Xu , Tengfei Xue , Jianan Fan , Dongnan Liu , Yuqian Chen , Fan Zhang , Carl-Fredrik Westin , Ron Kikinis , Lauren J. O'Donnell , Weidong Cai

Retinal template matching and registration is an important challenge in teleophthalmology with low-cost imaging devices. However, the images from such devices generally have a small field of view (FOV) and image quality degradations, making…

Image and Video Processing · Electrical Eng. & Systems 2018-11-30 Chen Gong , N. Benjamin Erichson , John P. Kelly , Laura Trutoiu , Brian T. Schowengerdt , Steven L. Brunton , Eric J. Seibel

This work presents a novel label-efficient selfsupervised representation learning-based approach for classifying diabetic retinopathy (DR) images in cross-domain settings. Most of the existing DR image classification methods are based on…

Image and Video Processing · Electrical Eng. & Systems 2023-04-25 Ekta Gupta , Varun Gupta , Muskaan Chopra , Prakash Chandra Chhipa , Marcus Liwicki

The research community has witnessed the powerful potential of self-supervised Masked Image Modeling (MIM), which enables the models capable of learning visual representation from unlabeled data. In this paper, to incorporate both the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Wenxuan Wang , Jing Wang , Chen Chen , Jianbo Jiao , Yuanxiu Cai , Shanshan Song , Jiangyun Li

Interpretability is crucial to enhance trust in machine learning models for medical diagnostics. However, most state-of-the-art image classifiers based on neural networks are not interpretable. As a result, clinicians often resort to known…

The retina provides a unique, noninvasive window into Alzheimer's disease (AD) and dementia, capturing early structural changes through morphometric features, while systemic and lifestyle risk factors reflect well-established contributors…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Seowung Leem , Lin Gu , Chenyu You , Kuang Gong , Ruogu Fang

Diagnosing and treating skin diseases require advanced visual skills across domains and the ability to synthesize information from multiple imaging modalities. While current deep learning models excel at specific tasks like skin cancer…