English
Related papers

Related papers: PRETI: Patient-Aware Retinal Foundation Model via …

200 papers

Foundation models pretrained on large-scale datasets via self-supervised learning demonstrate exceptional versatility across various tasks. Due to the heterogeneity and hard-to-collect medical data, this approach is especially beneficial…

Computational Engineering, Finance, and Science · Computer Science 2024-03-05 Yanwu Yang , Chenfei Ye , Guinan Su , Ziyao Zhang , Zhikai Chang , Hairui Chen , Piu Chan , Yue Yu , Ting Ma

Retinal vascular diseases affect the well-being of human body and sometimes provide vital signs of otherwise undetected bodily damage. Recently, deep learning techniques have been successfully applied for detection of diabetic retinopathy…

Machine Learning · Computer Science 2022-01-05 Guan Wang , Yusuke Kikuchi , Jinglin Yi , Qiong Zou , Rui Zhou , Xin Guo

Integrating deep learning into medical imaging is poised to greatly advance diagnostic methods but it faces challenges with generalizability. Foundation models, based on self-supervised learning, address these issues and improve data…

We consider the problem of predicting how the likelihood of an outcome of interest for a patient changes over time as we observe more of the patient data. To solve this problem, we propose a supervised contrastive learning framework that…

Machine Learning · Computer Science 2024-04-16 Shahriar Noroozizadeh , Jeremy C. Weiss , George H. Chen

3D to 2D retinal vessel segmentation is a challenging problem in Optical Coherence Tomography Angiography (OCTA) images. Accurate retinal vessel segmentation is important for the diagnosis and prevention of ophthalmic diseases. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-12-17 Zhuojie Wu , Zijian Wang , Wenxuan Zou , Fan Ji , Hao Dang , Wanting Zhou , Muyi Sun

Emerging high-quality face restoration (FR) methods often utilize pre-trained GAN models (\textit{i.e.}, StyleGAN2) as GAN Prior. However, these methods usually struggle to balance realness and fidelity when facing various degradation…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yinhuai Wang , Yujie Hu , Jian Zhang

Magnetic resonance imaging (MRI) requires long acquisition times, raising costs, reducing accessibility, and making scans more susceptible to motion artifacts. Diffusion probabilistic models that learn data-driven priors can potentially…

Image and Video Processing · Electrical Eng. & Systems 2025-12-16 Rohan Sanda , Asad Aali , Andrew Johnston , Eduardo Reis , Gordon Wetzstein , Sara Fridovich-Keil

Retinal image matching plays a crucial role in monitoring disease progression and treatment response. However, datasets with matched keypoints between temporally separated pairs of images are not available in abundance to train…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Sahar Almahfouz Nasser , Nihar Gupte , Amit Sethi

Major retinal layer segmentation methods from OCT images assume that the retina is flattened in advance, and thus cannot always deal with retinas that have changes in retinal structure due to ophthalmopathy and/or curvature due to myopia.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-03 Tsubasa Konno , Takahiro Ninomiya , Kanta Miura , Koichi Ito , Noriko Himori , Parmanand Sharma , Toru Nakazawa , Takafumi Aoki

When deep learning models are sequentially trained on new data, they tend to abruptly lose performance on previously learned tasks, a critical failure known as catastrophic forgetting. This challenge severely limits the deployment of AI in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Paraskevi-Antonia Theofilou , Anuhya Thota , Stefanos Kollias , Mamatha Thota

The identification and quantification of markers in medical images is critical for diagnosis, prognosis, and disease management. Supervised machine learning enables the detection and exploitation of findings that are known a priori after…

We introduce a pretraining technique called Selfie, which stands for SELFie supervised Image Embedding. Selfie generalizes the concept of masked language modeling of BERT (Devlin et al., 2019) to continuous data, such as images, by making…

Machine Learning · Computer Science 2019-07-30 Trieu H. Trinh , Minh-Thang Luong , Quoc V. Le

To make sense of their surroundings, intelligent systems must transform complex sensory inputs to structured codes that are reduced to task-relevant information such as object category. Biological agents achieve this in a largely autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Robin Weiler , Matthias Brucklacher , Cyriel M. A. Pennartz , Sander M. Bohté

Computational pathology needs whole-slide image (WSI) foundation models that transfer across diverse clinical tasks, yet current approaches remain largely slide-centric, often depend on private data and expensive paired-report supervision,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Yousef Kotp , Vincent Quoc-Huy Trinh , Christopher Pal , Mahdi S. Hosseini

Neuroimaging data, particularly from techniques like MRI or PET, offer rich but complex information about brain structure and activity. To manage this complexity, latent representation models - such as Autoencoders, Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 C. Vázquez-García , F. J. Martínez-Murcia , F. Segovia Román , Juan M. Górriz

Large vision foundation models have been widely adopted for retinal disease classification without systematic evidence justifying their parameter requirements. In the present work we address two critical questions: First, are large…

Image and Video Processing · Electrical Eng. & Systems 2025-12-01 David Isztl , Tahm Spitznagel , Gabor Mark Somfai , Rui Santos

Discriminative learning, restorative learning, and adversarial learning have proven beneficial for self-supervised learning schemes in computer vision and medical imaging. Existing efforts, however, omit their synergistic effects on each…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Fatemeh Haghighi , Mohammad Reza Hosseinzadeh Taher , Michael B. Gotway , Jianming Liang

The joint interpretation of multi-modal and multi-view fundus images is critical for retinopathy prevention, as different views can show the complete 3D eyeball field and different modalities can provide complementary lesion areas. Compared…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yonghao Huang , Leiting Chen , Chuan Zhou

Lesion appearance is a crucial clue for medical providers to distinguish referable diabetic retinopathy (rDR) from non-referable DR. Most existing large-scale DR datasets contain only image-level labels rather than pixel-based annotations.…

Image and Video Processing · Electrical Eng. & Systems 2022-10-13 Wenhui Zhu , Peijie Qiu , Natasha Lepore , Oana M. Dumitrascu , Yalin Wang

Annotating medical images for disease detection is often tedious and expensive. Moreover, the available training samples for a given task are generally scarce and imbalanced. These conditions are not conducive for learning effective deep…

Image and Video Processing · Electrical Eng. & Systems 2023-01-24 Fouzia Altaf , Syed M. S. Islam , Naeem K. Janjua , Naveed Akhtar