中文
相关论文

相关论文: MM-Retinal: Knowledge-Enhanced Foundational Pretra…

200 篇论文

Foundation models have become a promising paradigm for advancing medical image analysis, particularly for segmentation tasks where downstream applications often emerge sequentially. Existing fine-tuning strategies, however, remain limited:…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Yiwen Ye , Yicheng Wu , Xiangde Luo , He Zhang , Ziyang Chen , Ting Dang , Yanning Zhang , Yong Xia

Retinal diseases remain among the leading preventable causes of visual impairment worldwide. Automated screening based on fundus image analysis has the potential to expand access to early detection, particularly in underserved populations.…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Ali Akram

Recent advancements in ophthalmology foundation models such as RetFound have demonstrated remarkable diagnostic capabilities but require massive datasets for effective pre-training, creating significant barriers for development and…

图像与视频处理 · 电气工程与系统科学 2025-03-25 Qingshan Hou , Meng Wang , Peng Cao , Zou Ke , Xiaoli Liu , Huazhu Fu , Osmar R. Zaiane

In this paper, we present a semi-supervised fine-tuning approach designed to improve the performance of pre-trained foundation models on downstream tasks with limited labeled data. By leveraging content-style decomposition within an…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Mariia Drozdova , Vitaliy Kinakh , Yury Belousov , Erica Lastufka , Slava Voloshynovskiy

High-quality fundus images provide essential anatomical information for clinical screening and ophthalmic disease diagnosis. Yet, due to hardware limitations, operational variability, and patient compliance, fundus images often suffer from…

The automatic diagnosis of various retinal diseases from fundus images is important to support clinical decision-making. However, developing such automatic solutions is challenging due to the requirement of a large amount of human-annotated…

计算机视觉与模式识别 · 计算机科学 2020-07-23 Xiaomeng Li , Mengyu Jia , Md Tauhidul Islam , Lequan Yu , Lei Xing

Fundus photography and Optical Coherence Tomography Angiography (OCT-A) are two commonly used modalities in ophthalmic imaging. With the development of deep learning algorithms, fundus image processing, especially retinal vessel…

图像与视频处理 · 电气工程与系统科学 2019-11-07 Weilin Fu , Lennart Husvogt , Stefan Ploner James G. Fujimoto Andreas Maier

Pretrained language models are promising particularly for low-resource languages as they only require unlabelled data. However, training existing models requires huge amounts of compute, while pretrained cross-lingual models often…

计算与语言 · 计算机科学 2020-06-05 Julian Martin Eisenschlos , Sebastian Ruder , Piotr Czapla , Marcin Kardas , Sylvain Gugger , Jeremy Howard

The use of fundus images for the early screening of eye diseases is of great clinical importance. Due to its powerful performance, deep learning is becoming more and more popular in related applications, such as lesion segmentation,…

图像与视频处理 · 电气工程与系统科学 2021-01-26 Tao Li , Wang Bo , Chunyu Hu , Hong Kang , Hanruo Liu , Kai Wang , Huazhu Fu

Current color fundus image registration approaches are limited, among other things, by the lack of labeled data, which is even more significant in the medical domain, motivating the use of unsupervised learning. Therefore, in this work, we…

计算机视觉与模式识别 · 计算机科学 2026-03-12 David Rivas-Villar , Álvaro S. Hervella , José Rouco , Jorge Novo

Retinal lesions play a vital role in the accurate classification of retinal abnormalities. Many researchers have proposed deep lesion-aware screening systems that analyze and grade the progression of retinopathy. However, to the best of our…

计算机视觉与模式识别 · 计算机科学 2020-08-17 Taimur Hassan , Muhammad Usman Akram , Naoufel Werghi

Automatic diabetic retinopathy (DR) grading based on fundus photography has been widely explored to benefit the routine screening and early treatment. Existing researches generally focus on single-field fundus images, which have limited…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Junlin Hou , Jilan Xu , Fan Xiao , Rui-Wei Zhao , Yuejie Zhang , Haidong Zou , Lina Lu , Wenwen Xue , Rui Feng

Multimodal large language models (MLLMs) demonstrate significant potential in the field of medical diagnosis. However, they face critical challenges in specialized domains such as ophthalmology, particularly the fragmentation of annotation…

人工智能 · 计算机科学 2025-07-24 Xinyao Liu , Diping Song

Recent Multimodal Large Language Models (MLLMs) exhibit impressive abilities to perceive images and follow open-ended instructions. The capabilities of MLLMs depend on two crucial factors: the model architecture to facilitate the feature…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Tianyu Yu , Jinyi Hu , Yuan Yao , Haoye Zhang , Yue Zhao , Chongyi Wang , Shan Wang , Yinxv Pan , Jiao Xue , Dahai Li , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun

Synthesizing images of the eye fundus is a challenging task that has been previously approached by formulating complex models of the anatomy of the eye. New images can then be generated by sampling a suitable parameter space. In this work,…

计算机视觉与模式识别 · 计算机科学 2017-02-01 Pedro Costa , Adrian Galdran , Maria Inês Meyer , Michael David Abràmoff , Meindert Niemeijer , Ana Maria Mendonça , Aurélio Campilho

Retinal vessel segmentation is a fundamental step in screening, diagnosis, and treatment of various cardiovascular and ophthalmic diseases. Robustness is one of the most critical requirements for practical utilization, since the test images…

图像与视频处理 · 电气工程与系统科学 2021-09-29 Xu Sun , Huihui Fang , Yehui Yang , Dongwei Zhu , Lei Wang , Junwei Liu , Yanwu Xu

Deep learning based image enhancement models have largely improved the readability of fundus images in order to decrease the uncertainty of clinical observations and the risk of misdiagnosis. However, due to the difficulty of acquiring…

图像与视频处理 · 电气工程与系统科学 2023-02-24 Erjian Guo , Huazhu Fu , Luping Zhou , Dong Xu

In this paper, we address a fundamental gap between pre-training and fine-tuning of deep neural networks: while pre-training has shifted from unimodal to multimodal learning with enhanced visual understanding, fine-tuning predominantly…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Shohei Enomoto , Shin'ya Yamaguchi

Pre-trained foundation models, due to their enormous capacity and exposure to vast amounts of data during pre-training, are known to have learned plenty of real-world concepts. An important step in making these pre-trained models effective…

机器学习 · 计算机科学 2024-07-02 Jishnu Mukhoti , Yarin Gal , Philip H. S. Torr , Puneet K. Dokania

The rise of imaging techniques such as optical coherence tomography (OCT) and advances in deep learning (DL) have enabled clinicians and researchers to streamline retinal disease staging. A popular DL approach is self-supervised learning…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Ronald Fecso , José Morano , Ursula Schmidt-Erfurth , Hrvoje Bogunović