English
Related papers

Related papers: Local-Global Prompt Learning via Sparse Optimal Tr…

200 papers

Prompt learning has been widely adopted to efficiently adapt vision-language models (VLMs), e.g. CLIP, for few-shot image classification. Despite their success, most prompt learning methods trade-off between classification accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Marc Lafon , Elias Ramzi , Clément Rambour , Nicolas Audebert , Nicolas Thome

Vision-language models (VLMs) such as CLIP demonstrate strong performance but struggle when adapted to downstream tasks. Prompt learning has emerged as an efficient and effective strategy to adapt VLMs while preserving their pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Hao Wang , Huayu Li , Haiyu Wu , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

With the increasing attention to large vision-language models such as CLIP, there has been a significant amount of effort dedicated to building efficient prompts. Unlike conventional methods of only learning one single prompt, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Guangyi Chen , Weiran Yao , Xiangchen Song , Xinyue Li , Yongming Rao , Kun Zhang

Vision-language models such as CLIP are capable of mapping the different modality data into a unified feature space, enabling zero/few-shot inference by measuring the similarity of given images and texts. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

Remote sensing applications increasingly rely on deep learning for scene classification. However, their performance is often constrained by the scarcity of labeled data and the high cost of annotation across diverse geographic and sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Ivica Dimitrovski , Vlatko Spasev , Ivan Kitanovski

Large pre-trained vision-language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different from the traditional representation learning that is based…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Kaiyang Zhou , Jingkang Yang , Chen Change Loy , Ziwei Liu

We present a novel vision-language prompt learning approach for few-shot out-of-distribution (OOD) detection. Few-shot OOD detection aims to detect OOD images from classes that are unseen during training using only a few labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Vision-language models (VLMs) have demonstrated exceptional generalization capabilities for downstream tasks. Due to its efficiency, prompt learning has gradually become a more effective and efficient method for transferring VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chenhao Ding , Xinyuan Gao , Songlin Dong , Jizhou Han , Qiang Wang , Zhengdong Zhou , Yuhang He , Yihong Gong

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yu Du , Tong Niu , Rong Zhao

Vision-language models (VLMs), such as CLIP, have demonstrated impressive zero-shot capabilities for various downstream tasks. Their performance can be further enhanced through few-shot prompt tuning methods. However, current studies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zhi Zhou , Ming Yang , Jiang-Xin Shi , Lan-Zhe Guo , Yu-Feng Li

Few-shot, fine-grained classification in computer vision poses significant challenges due to the need to differentiate subtle class distinctions with limited data. This paper presents a novel method that enhances the Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Eric Brouwer , Jan Erik van Woerden , Gertjan Burghouts , Matias Valdenegro-Toro , Marco Zullich

Vision-language pre-trained models (VLMs) such as CLIP have demonstrated remarkable zero-shot generalization, and prompt learning has emerged as an efficient alternative to full fine-tuning. However, existing methods often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Zhaolong Wang , Tongfeng Sun , Mingzheng Du , Yachao Huang

Whole slide pathology image classification presents challenges due to gigapixel image sizes and limited annotation labels, hindering model generalization. This paper introduces a prompt learning method to adapt large vision-language models…

Foundation Vision-Language Models (VLMs) like CLIP exhibit strong generalization capabilities due to large-scale pretraining on diverse image-text pairs. However, their performance often degrades when applied to target datasets with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Debarshi Brahma , Soma Biswas

Out-of-distribution (OOD) detection is crucial for model reliability, as it identifies samples from unknown classes and reduces errors due to unexpected inputs. Vision-Language Models (VLMs) such as CLIP are emerging as powerful tools for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Yabin Zhang , Wenjie Zhu , Chenhang He , Lei Zhang

CLIP (Contrastive Language-Image Pretraining) is well-developed for open-vocabulary zero-shot image-level recognition, while its applications in pixel-level tasks are less investigated, where most efforts directly adopt CLIP features…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Jie Guo , Qimeng Wang , Yan Gao , Xiaolong Jiang , Xu Tang , Yao Hu , Baochang Zhang

Recent advances in multimodal learning has resulted in powerful vision-language models, whose representations are generalizable across a variety of downstream tasks. Recently, their generalization ability has been further extended by…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Koustava Goswami , Srikrishna Karanam , Prateksha Udhayanan , K J Joseph , Balaji Vasan Srinivasan

The reliability of artificial intelligence (AI) systems in open-world settings depends heavily on their ability to flag out-of-distribution (OOD) inputs unseen during training. Recent advances in large-scale vision-language models (VLMs)…

Machine Learning · Computer Science 2025-10-14 Faizul Rakib Sayem , Shahana Ibrahim

In this work, we address the task of few-shot part segmentation, which aims to segment the different parts of an unseen object using very few labeled examples. It is found that leveraging the textual space of a powerful pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Mengya Han , Heliang Zheng , Chaoyue Wang , Yong Luo , Han Hu , Jing Zhang , Yonggang Wen

Out-of-Distribution (OOD) detection, aiming to distinguish outliers from known categories, has gained prominence in practical scenarios. Recently, the advent of vision-language models (VLM) has heightened interest in enhancing OOD detection…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Fanhu Zeng , Zhen Cheng , Fei Zhu , Hongxin Wei , Xu-Yao Zhang
‹ Prev 1 2 3 10 Next ›