English
Related papers

Related papers: Continual Retinal Vision-Language Pre-training upo…

200 papers

We propose a novel framework for retinal feature point alignment, designed for learning cross-modality features to enhance matching and registration across multi-modality retinal images. Our model draws on the success of previous…

Image and Video Processing · Electrical Eng. & Systems 2024-07-29 Jiacheng Wang , Hao Li , Dewei Hu , Rui Xu , Xing Yao , Yuankai K. Tao , Ipek Oguz

Neural radiance fields (NeRFs) have emerged as an effective method for novel-view synthesis and 3D scene reconstruction. However, conventional training methods require access to all training views during scene optimization. This assumption…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Ryan Po , Zhengyang Dong , Alexander W. Bergman , Gordon Wetzstein

Despite the success of multimodal contrastive learning in aligning visual and linguistic representations, a persistent geometric anomaly, the Modality Gap, remains: embeddings of distinct modalities expressing identical semantics occupy…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Xiaomin Yu , Yi Xin , Yuhui Zhang , Wenjie Zhang , Chonghan Liu , Hanzhen Zhao , Chen Liu , Xiaoxing Hu , Ziyue Qiao , Hao Tang , Xiaobin Hu , Chengwei Qin , Hui Xiong , Yu Qiao , Shuicheng Yan

Self-supervised learning is an efficient pre-training method for medical image analysis. However, current research is mostly confined to specific-modality data pre-training, consuming considerable time and resources without achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yiwen Ye , Yutong Xie , Jianpeng Zhang , Ziyang Chen , Qi Wu , Yong Xia

Multilingual vision-language models have made significant strides in image captioning, yet they still lag behind their English counterparts due to limited multilingual training data and costly large-scale model parameterization.…

Computation and Language · Computer Science 2025-07-29 George Ibrahim , Rita Ramos , Yova Kementchedjhieva

Subtle semantic differences in retinal image and text data present great challenges for pre-training visual-language models. Moreover, false negative samples, i.e., image-text pairs having the same semantics but incorrectly regarded as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shengzhu Yang , Jiawei Du , Jia Guo , Weihang Zhang , Hanruo Liu , Huiqi Li , Ningli Wang

Recently, vision-language representation learning has made remarkable advancements in building up medical foundation models, holding immense potential for transforming the landscape of clinical research and medical care. The underlying…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Weijian Huang , Cheng Li , Hao Yang , Jiarun Liu , Yong Liang , Hairong Zheng , Shanshan Wang

While Multimodal Large Language Models (MLLMs) have achieved remarkable progress in open-ended visual question answering, they remain vulnerable to hallucinations. These are outputs that contradict or misrepresent input semantics, posing a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jianjiang Yang , Yanshu li , Ziyan Huang

Artificial intelligence applied to retinal images offers significant potential for recognizing signs and symptoms of retinal conditions and expediting the diagnosis of eye diseases and systemic disorders. However, developing generalized…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Boa Jang , Youngbin Ahn , Eun Kyung Choe , Chang Ki Yoon , Hyuk Jin Choi , Young-Gon Kim

Image-language learning has made unprecedented progress in visual understanding. These developments have come at high costs, as contemporary vision-language models require large model scales and amounts of data. We here propose a much…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 AJ Piergiovanni , Anelia Angelova

The acquisition of high-resolution retinal fundus images with a large field of view (FOV) is challenging due to technological, physiological and economic reasons. This paper proposes a fully automatic framework to reconstruct retinal images…

Computer Vision and Pattern Recognition · Computer Science 2016-02-11 Thomas Köhler , Axel Heinrich , Andreas Maier , Joachim Hornegger , Ralf P. Tornow

Continual learning aims to enable models to learn sequentially from continuously incoming data while retaining performance on previously learned tasks. With the Contrastive Language-Image Pre-trained model (CLIP) exhibiting strong…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Linlan Huang , Xusheng Cao , Haori Lu , Yifan Meng , Fei Yang , Xialei Liu

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

Fundus photography and Optical Coherence Tomography Angiography (OCT-A) are two commonly used modalities in ophthalmic imaging. With the development of deep learning algorithms, fundus image processing, especially retinal vessel…

Image and Video Processing · Electrical Eng. & Systems 2019-11-07 Weilin Fu , Lennart Husvogt , Stefan Ploner James G. Fujimoto Andreas Maier

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

Recent advancements in vision-language models (VLMs), such as CLIP, have demonstrated substantial success in self-supervised representation learning for vision tasks. However, effectively adapting VLMs to downstream applications remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

General-purpose foundation models have led to recent breakthroughs in artificial intelligence. In remote sensing, self-supervised learning (SSL) and Masked Image Modeling (MIM) have been adopted to build foundation models. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Fan Liu , Delong Chen , Zhangqingyun Guan , Xiaocong Zhou , Jiale Zhu , Qiaolin Ye , Liyong Fu , Jun Zhou

Generating informative and knowledge-rich image captions remains a challenge for many existing captioning models, which often produce generic descriptions that lack specificity and contextual depth. To address this limitation, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Reem AlJunaid , Muzammil Behzad

Vision-language pre-training (VLP) has attracted increasing attention recently. With a large amount of image-text pairs, VLP models trained with contrastive loss have achieved impressive performance in various tasks, especially the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shipeng Yan , Lanqing Hong , Hang Xu , Jianhua Han , Tinne Tuytelaars , Zhenguo Li , Xuming He

Accurate retinal vessel segmentation is a challenging problem in color fundus image analysis. An automatic retinal vessel segmentation system can effectively facilitate clinical diagnosis and ophthalmological research. Technically, this…

Image and Video Processing · Electrical Eng. & Systems 2021-03-26 Muyi Sun , Guanhong Zhang