English
Related papers

Related papers: BiPrompt: Bilateral Prompt Optimization for Visual…

200 papers

Vision-language models such as CLIP are capable of mapping the different modality data into a unified feature space, enabling zero/few-shot inference by measuring the similarity of given images and texts. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

We present a novel methodology aimed at optimizing the application of frozen large language models (LLMs) for resource-intensive vision-language (VL) pre-training. The current paradigm uses visual features as prompts to guide language…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Yiren Jian , Chongyang Gao , Soroush Vosoughi

Pre-trained Vision-Language Models (VLMs), like CLIP, exhibit strong generalization ability to downstream tasks but struggle in few-shot scenarios. Existing prompting techniques primarily focus on global text and image representations, yet…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xin Liu , Jiamin Wu , and Wenfei Yang , Xu Zhou , Tianzhu Zhang

Prompt learning (PL) has emerged as an effective strategy to adapt vision-language models (VLMs), such as CLIP, for downstream tasks under limited supervision. While PL has demonstrated strong generalization on natural image datasets, its…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Pankhi Kashyap , Mainak Singha , Biplab Banerjee

Prompt tuning of large-scale vision-language models such as CLIP enables efficient task adaptation without updating model weights. However, it often leads to poor confidence calibration and unreliable predictive uncertainty. We address this…

Contrastive Language-Image Pre-training (CLIP) represents the latest incarnation of pre-trained vision-language models. Although CLIP has recently shown its superior power on a wide range of downstream vision-language tasks like Visual…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sinuo Deng , Lifang Wu , Ge Shi , Lehao Xing , Meng Jian , Ye Xiang

Pre-trained vision-language (V-L) models such as CLIP have shown excellent generalization ability to downstream tasks. However, they are sensitive to the choice of input text prompts and require careful selection of prompt templates to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Muhammad Uzair Khattak , Hanoona Rasheed , Muhammad Maaz , Salman Khan , Fahad Shahbaz Khan

Vision-language pre-trained models (VLMs) such as CLIP have demonstrated remarkable zero-shot generalization, and prompt learning has emerged as an efficient alternative to full fine-tuning. However, existing methods often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Zhaolong Wang , Tongfeng Sun , Mingzheng Du , Yachao Huang

Prompt tuning has shown promising results, but its robustness and generalization to unseen categories remain limited. Through our experiments, we demonstrate that the complete removal of semantic noise is a key factor restricting…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Yansheng Gao , Yufei Zheng , Shengsheng Wang

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yu Du , Tong Niu , Rong Zhao

Prompt learning is an effective method to customize Vision-Language Models (VLMs) for various downstream tasks, involving tuning very few parameters of input prompt tokens. Recently, prompt pretraining in large-scale dataset (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Zhenyuan Chen , Lingfeng Yang , Shuo Chen , Zhaowei Chen , Jiajun Liang , Xiang Li

Prompt learning has become one of the most efficient paradigms for adapting large pre-trained vision-language models to downstream tasks. Current state-of-the-art methods, like CoOp and ProDA, tend to adopt soft prompts to learn an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Sifan Long , Zhen Zhao , Junkun Yuan , Zichang Tan , Jiangjiang Liu , Luping Zhou , Shengsheng Wang , Jingdong Wang

Pre-trained vision-language models like CLIP have remarkably adapted to various downstream tasks. Nonetheless, their performance heavily depends on the specificity of the input text prompts, which requires skillful prompt template…

Machine Learning · Computer Science 2024-10-22 Yingjun Du , Wenfang Sun , Cees G. M. Snoek

Large-scale foundation models like CLIP have shown strong zero-shot generalization but struggle with domain shifts, limiting their adaptability. In our work, we introduce \textsc{StyLIP}, a novel domain-agnostic prompt learning strategy for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Ankit Jha

Existing vision-language models (VLMs) such as CLIP have showcased an impressive capability to generalize well across various downstream tasks. These models leverage the synergy between visual and textual information, enabling them to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Fangming Cui , Yonggang Zhang , Xuan Wang , Xule Wang , Liang Xiao

Contrastive Language-Image Pretraining (CLIP) model has exhibited remarkable efficacy in establishing cross-modal connections between texts and images, yielding impressive performance across a broad spectrum of downstream applications…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yi Zhang , Ce Zhang , Ke Yu , Yushun Tang , Zhihai He

The Contrastive Language-Image Pretraining (CLIP) model has been widely used in various downstream vision tasks. The few-shot learning paradigm has been widely adopted to augment its capacity for these tasks. However, current paradigms may…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Jintao Rong , Hao Chen , Linlin Ou , Tianxiao Chen , Xinyi Yu , Yifan Liu

CLIP models learn transferable multi-modal features via image-text contrastive learning on internet-scale data. They are widely used in zero-shot classification, multi-modal retrieval, text-to-image diffusion, and as image encoders in large…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Marc-Antoine Lavoie , Anas Mahmoud , Aldo Zaimi , Arsene Fansi Tchango , Steven L. Waslander

Open-vocabulary semantic segmentation requires models to effectively integrate visual representations with open-vocabulary semantic labels. While Contrastive Language-Image Pre-training (CLIP) models shine in recognizing visual concepts…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Mengcheng Lan , Chaofeng Chen , Yiping Ke , Xinjiang Wang , Litong Feng , Wayne Zhang

We address the challenges inherent in sketch-based image retrieval (SBIR) across various settings, including zero-shot SBIR, generalized zero-shot SBIR, and fine-grained zero-shot SBIR, by leveraging the vision-language foundation model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Mainak Singha , Ankit Jha , Divyam Gupta , Pranav Singla , Biplab Banerjee