English
Related papers

Related papers: Tuning-free Universally-Supervised Semantic Segmen…

200 papers

Semantic segmentation of 3D LiDAR point clouds, essential for autonomous driving and infrastructure management, is best achieved by supervised learning, which demands extensive annotated datasets and faces the problem of domain shifts. We…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Andrew Caunes , Thierry Chateau , Vincent Frémont

Recently, pre-trained vision-language models have been increasingly used to tackle the challenging zero-shot segmentation task. Typical solutions follow the paradigm of first generating mask proposals and then adopting CLIP to classify…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Siyu Jiao , Yunchao Wei , Yaowei Wang , Yao Zhao , Humphrey Shi

Contrastively pretrained audio-language models (e.g., CLAP) excel at clip-level understanding but struggle with frame-level tasks. Existing extensions fail to exploit the varying granularity of real-world audio-text data, where massive…

Sound · Computer Science 2026-04-02 Xiquan Li , Xuenan Xu , Ziyang Ma , Wenxi Chen , Haolin He , Qiuqiang Kong , Xie Chen

Large vision-language representation learning models like CLIP have demonstrated impressive performance for zero-shot transfer to downstream tasks while largely benefiting from inter-modal (image-text) alignment via contrastive objectives.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Muhammad Waleed Gondal , Jochen Gast , Inigo Alonso Ruiz , Richard Droste , Tommaso Macri , Suren Kumar , Luitpold Staudigl

Contrastive vision-language models like CLIP exhibit remarkable zero-shot generalization. However, prompt tuning remains highly sensitive to label noise, as mislabeled samples generate disproportionately large gradients that can overwhelm…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiayu Li , Jiaxin Qi , Sheng Zhou , Jiaqiang Huang , Xiansheng Hua

This paper examines the robustness of a multi-modal computer vision model, CLIP (Contrastive Language-Image Pretraining), in the context of unsupervised learning. The main objective is twofold: first, to evaluate the robustness of CLIP, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Clement Laroudie , Andrei Bursuc , Mai Lan Ha , Gianni Franchi

Learning generalized representations from limited training samples is crucial for applying deep neural networks in low-resource scenarios. Recently, methods based on Contrastive Language-Image Pre-training (CLIP) have exhibited promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yao Zhu , Yuefeng Chen , Wei Wang , Xiaofeng Mao , Xiu Yan , Yue Wang , Zhigang Li , Wang lu , Jindong Wang , Xiangyang Ji

In this work, we present a fully self-supervised framework for semantic segmentation(FS^4). A fully bootstrapped strategy for semantic segmentation, which saves efforts for the huge amount of annotation, is crucial for building customized…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Yuan Wang , Wei Zhuo , Yucong Li , Zhi Wang , Qi Ju , Wenwu Zhu

This study introduces SAMatch, a SAM-guided Match-based framework for semi-supervised medical image segmentation, aimed at improving pseudo label quality in data-scarce scenarios. While Match-based frameworks are effective, they struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Guoping Xu , Xiaoxue Qian , Hua Chieh Shao , Jax Luo , Weiguo Lu , You Zhang

We address the problem of unsupervised semantic segmentation of outdoor LiDAR point clouds in diverse traffic scenarios. The key idea is to leverage the spatiotemporal nature of a dynamic point cloud sequence and introduce drastically…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Xiao Li , Pan He , Aotian Wu , Sanjay Ranka , Anand Rangarajan

Recent open-vocabulary segmentation methods adopt mask generators to predict segmentation masks and leverage pre-trained vision-language models, e.g., CLIP, to classify these masks via mask pooling. Although these approaches show promising…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yongkang Li , Tianheng Cheng , Bin Feng , Wenyu Liu , Xinggang Wang

CLIP achieves strong zero-shot image-text retrieval by aligning global vision and text representations, yet it falls behind on fine-grained tasks even when fine-tuned on long, detailed captions. In this work, we propose $\beta$-CLIP, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Fatimah Zohra , Chen Zhao , Hani Itani , Bernard Ghanem

In this paper, we propose an intuitive, training-free and label-free method for intent clustering in conversational search. Current approaches to short text clustering use LLM-generated pseudo-labels to enrich text representations or to…

Computation and Language · Computer Science 2026-02-26 I-Fan Lin , Faegheh Hasibi , Suzan Verberne

Medical ultrasound imaging is ubiquitous, but manual analysis struggles to keep pace. Automated segmentation can help but requires large labeled datasets, which are scarce. Semi-supervised learning leveraging both unlabeled and limited…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Yaxiong Chen , Yujie Wang , Zixuan Zheng , Jingliang Hu , Yilei Shi , Shengwu Xiong , Xiao Xiang Zhu , Lichao Mou

We propose Semantic-Fast-SAM (SFS), a semantic segmentation framework that combines the Fast Segment Anything model with a semantic labeling pipeline to achieve real-time performance without sacrificing accuracy. FastSAM is an efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Byunghyun Kim

Large Vision-Language Models like CLIP have become a powerful foundation for Unsupervised Domain Adaptation due to their strong zero-shot generalization. State-of-the-art methods typically leverage CLIP to generate pseudo-labels for the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Haoran Chen , Zexiao Wang , Haidong Cao , Zuxuan Wu , Yu-Gang Jiang

Supervised or weakly supervised methods for phrase localization (textual grounding) either rely on human annotations or some other supervised models, e.g., object detectors. Obtaining these annotations is labor-intensive and may be…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Jiahao Li , Greg Shakhnarovich , Raymond A. Yeh

Training vision models with language supervision enables general and transferable representations. However, many visual domains, especially non-object-centric domains such as medical imaging and remote sensing, contain itemized text…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yiwei Lyu , Chenhui Zhao , Soumyanil Banerjee , Shixuan Liu , Akshay Rao , Akhil Kondepudi , Honglak Lee , Todd C. Hollon

Besides image classification, Contrastive Language-Image Pre-training (CLIP) has accomplished extraordinary success for a wide range of vision tasks, including object-level and 3D space understanding. However, it's still challenging to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Renrui Zhang , Ziyao Zeng , Ziyu Guo , Yafeng Li

In this paper, we present a novel cross-consistency based semi-supervised approach for semantic segmentation. Consistency training has proven to be a powerful semi-supervised learning framework for leveraging unlabeled data under the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Yassine Ouali , Céline Hudelot , Myriam Tami