English
Related papers

Related papers: Vision-Language Enhanced Foundation Model for Semi…

200 papers

Few-shot learning is a promising way for reducing the label cost in new categories adaptation with the guidance of a small, well labeled support set. But for few-shot semantic segmentation, the pixel-level annotations of support images are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jing Wang , Yuang Liu , Qiang Zhou , Fan Wang

Medical image segmentation is more clinically valuable when it supports diagnosis rather than merely producing lesion masks. However, diagnostically relevant lesion cues are often subtle and localized, while existing models may be…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Fengyi Zhang , Xujie Zeng , Mohan Liu , Zengyi Wang , Yalong Jiang

We study semi-supervised learning (SSL) for vision transformers (ViT), an under-explored topic despite the wide adoption of the ViT architectures to different tasks. To tackle this problem, we propose a new SSL pipeline, consisting of first…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Zhaowei Cai , Avinash Ravichandran , Paolo Favaro , Manchen Wang , Davide Modolo , Rahul Bhotika , Zhuowen Tu , Stefano Soatto

Accurate segmentation of ultrasound (US) images of the cervical muscles is crucial for precision healthcare. The demand for automatic computer-assisted methods is high. However, the scarcity of labeled data hinders the development of these…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Fangyijie Wang , Kathleen M. Curran , Guénolé Silvestre

Few-shot semantic segmentation (FSS) aims to enable models to segment novel/unseen object classes using only a limited number of labeled examples. However, current FSS methods frequently struggle with generalization due to incomplete and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Amin Karimi , Charalambos Poullis

Semi-supervised learning (SSL) has made notable advancements in medical image segmentation (MIS), particularly in scenarios with limited labeled data and significantly enhancing data utilization efficiency. Previous methods primarily focus…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Mengzhu Wang , Jiao Li , Houcheng Su , Nan Yin , Liang Yang , Shen Li

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision--language models offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xiaoliu Luo , Minxue Xiao , Ting Xie , Mengzhu Wang , Huiqing Qi , Joey Tianyi Zhou , Taiping Zhang , Xu Wang

Vision-language pre-training (VLP) methods are blossoming recently, and its crucial goal is to jointly learn visual and textual features via a transformer-based architecture, demonstrating promising improvements on a variety of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Weihan Wang , Zhen Yang , Bin Xu , Juanzi Li , Yankui Sun

This work aims to leverage pre-trained foundation models, such as contrastive language-image pre-training (CLIP) and segment anything model (SAM), to address weakly supervised semantic segmentation (WSSS) using image-level labels. To this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xiaobo Yang , Xiaojin Gong

Self-supervised Learning (SSL) has become a powerful paradigm for representation learning without manual annotations. However, most existing frameworks focus on global alignment and struggle to capture the hierarchical, multi-scale lesion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Abdullah Al Mamun , Miaohua Zhang , David Ahmedt-Aristizabal , Zeeshan Hayder , Mohammad Awrangjeb

Vision-language models (VLMs) pre-trained on large, heterogeneous data sources are becoming increasingly popular, providing rich multi-modal embeddings that enable efficient transfer to new tasks. A particularly relevant application is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Julio Silva-Rodríguez , Ender Konukoglu

Volume-wise labeling in 3D medical images is a time-consuming task that requires expertise. As a result, there is growing interest in using semi-supervised learning (SSL) techniques to train models with limited labeled data. However, the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-18 Haonan Wang , Xiaomeng Li

Medical reports with substantial information can be naturally complementary to medical images for computer vision tasks, and the modality gap between vision and language can be solved by vision-language matching (VLM). However, current…

Image and Video Processing · Electrical Eng. & Systems 2023-05-23 Chen Wenting , Liu Jie , Yuan Yixuan

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

In medical image classification, supervised learning is challenging due to the scarcity of labeled medical images. To address this, we leverage the visual-textual alignment within Vision-Language Models (VLMs) to enable unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Umaima Rahman , Raza Imam , Mohammad Yaqub , Boulbaba Ben Amor , Dwarikanath Mahapatra

Semantic segmentation is crucial in remote sensing, where high-resolution satellite images are segmented into meaningful regions. Recent advancements in deep learning have significantly improved satellite image segmentation. However, most…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Santiago Rivier , Carlos Hinojosa , Silvio Giancola , Bernard Ghanem

Medical vision foundation models remain limited in downstream tasks, particularly volumetric medical image segmentation. While fine-tuning on labeled target-domain data improves performance, existing approaches typically rely on randomly…

Image and Video Processing · Electrical Eng. & Systems 2026-05-07 Jin Yang , Daniel S. Marcus , Aristeidis Sotiras

Large-scale Vision-Language Models (VLMs) have achieved notable progress in aligning visual inputs with text. However, their ability to deeply understand the unique physical properties of non-RGB vision sensor images remains limited. In…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sangyun Chung , Youngjoon Yu , Se Yeon Kim , Youngchae Chee , Yong Man Ro

Semi-supervised semantic segmentation in computational pathology remains challenging due to scarce pixel-level annotations and unreliable pseudo-label supervision. We propose UniSemAlign, a dual-modal semantic alignment framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Le-Van Thai , Tien Dat Nguyen , Hoai Nhan Pham , Lan Anh Dinh Thi , Duy-Dong Nguyen , Ngoc Lam Quang Bui

Vascular structures in the retina contain important information for the detection and analysis of ocular diseases, including age-related macular degeneration, diabetic retinopathy and glaucoma. Commonly used modalities in diagnosis of these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Erick O. Rodrigues , Aura Conci , Panos Liatsis