English
Related papers

Related papers: Style-Pro: Style-Guided Prompt Learning for Genera…

200 papers

Vision-language models (VLMs) have demonstrated exceptional generalization capabilities for downstream tasks. Due to its efficiency, prompt learning has gradually become a more effective and efficient method for transferring VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chenhao Ding , Xinyuan Gao , Songlin Dong , Jizhou Han , Qiang Wang , Zhengdong Zhou , Yuhang He , Yihong Gong

Large-scale foundation models, such as CLIP, have demonstrated impressive zero-shot generalization performance on downstream tasks, leveraging well-designed language prompts. However, these prompt learning techniques often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Shirsha Bose , Ankit Jha , Enrico Fini , Mainak Singha , Elisa Ricci , Biplab Banerjee

Large-scale foundation models like CLIP have shown strong zero-shot generalization but struggle with domain shifts, limiting their adaptability. In our work, we introduce \textsc{StyLIP}, a novel domain-agnostic prompt learning strategy for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Ankit Jha

Prompt tuning for vision-language models such as CLIP involves optimizing the text prompts used to generate image-text pairs for specific downstream tasks. While hand-crafted or template-based prompts are generally applicable to a wider…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Qian Zhang

Contrastive Language-Image Pretraining (CLIP) model has exhibited remarkable efficacy in establishing cross-modal connections between texts and images, yielding impressive performance across a broad spectrum of downstream applications…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yi Zhang , Ce Zhang , Ke Yu , Yushun Tang , Zhihai He

Existing vision-language models (VLMs) such as CLIP have showcased an impressive capability to generalize well across various downstream tasks. These models leverage the synergy between visual and textual information, enabling them to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Fangming Cui , Yonggang Zhang , Xuan Wang , Xule Wang , Liang Xiao

Large-scale contrastive vision-language pre-training has shown significant progress in visual representation learning. Unlike traditional visual systems trained by a fixed set of discrete labels, a new paradigm was introduced in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Peng Gao , Shijie Geng , Renrui Zhang , Teli Ma , Rongyao Fang , Yongfeng Zhang , Hongsheng Li , Yu Qiao

Pre-trained vision-language (V-L) models such as CLIP have shown excellent generalization ability to downstream tasks. However, they are sensitive to the choice of input text prompts and require careful selection of prompt templates to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Muhammad Uzair Khattak , Hanoona Rasheed , Muhammad Maaz , Salman Khan , Fahad Shahbaz Khan

Pre-trained vision-language models, such as CLIP, show impressive zero-shot recognition ability and can be easily transferred to specific downstream tasks via prompt tuning, even with limited training data. However, existing prompt tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yuqi Peng , Pengfei Wang , Jianzhuang Liu , Shifeng Chen

Prompt learning has emerged as a valuable technique in enhancing vision-language models (VLMs) such as CLIP for downstream tasks in specific domains. Existing work mainly focuses on designing various learning forms of prompts, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Zheng Li , Xiang Li , Xinyi Fu , Xin Zhang , Weiqiang Wang , Shuo Chen , Jian Yang

Recent Vision-Language Pretrained (VLP) models have become the backbone for many downstream tasks, but they are utilized as frozen model without learning. Prompt learning is a method to improve the pre-trained VLP model by adding a…

Computation and Language · Computer Science 2024-01-17 Youngjae Cho , HeeSun Bae , Seungjae Shin , Yeo Dong Youn , Weonyoung Joo , Il-Chul Moon

Large pre-trained vision-language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different from the traditional representation learning that is based…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Kaiyang Zhou , Jingkang Yang , Chen Change Loy , Ziwei Liu

Large-scale foundation models, such as CLIP, have demonstrated remarkable success in visual recognition tasks by embedding images in a semantically rich space. Self-supervised learning (SSL) has also shown promise in improving visual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Mainak Singha , Ankit Jha , Biplab Banerjee

Contrastive language-image pretraining has shown great success in learning visual-textual joint representation from web-scale data, demonstrating remarkable "zero-shot" generalization ability for various image tasks. However, how to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Bolin Ni , Houwen Peng , Minghao Chen , Songyang Zhang , Gaofeng Meng , Jianlong Fu , Shiming Xiang , Haibin Ling

Prompt learning has been designed as an alternative to fine-tuning for adapting Vision-language (V-L) models to the downstream tasks. Previous works mainly focus on text prompt while visual prompt works are limited for V-L models. The…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Chen Xu , Yuhan Zhu , Haocheng Shen , Boheng Chen , Yixuan Liao , Xiaoxin Chen , Limin Wang

The potential for zero-shot generalization in vision-language (V-L) models such as CLIP has spurred their widespread adoption in addressing numerous downstream tasks. Previous methods have employed test-time prompt tuning to adapt the model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Anant Khandelwal

Contrastive vision-language models like CLIP have shown great progress in transfer learning. In the inference stage, the proper text description, also known as prompt, needs to be carefully designed to correctly classify the given images.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Tony Huang , Jack Chu , Fangyun Wei

Prompt learning is a powerful technique for transferring Vision-Language Models (VLMs) such as CLIP to downstream tasks. However, the prompt-based methods that are fine-tuned solely with base classes may struggle to generalize to novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Mushui Liu , Weijie He , Ziqian Lu , Yunlong Yu

Pre-trained vision-language models (e.g., CLIP) have shown promising zero-shot generalization in many downstream tasks with properly designed text prompts. Instead of relying on hand-engineered prompts, recent works learn prompts using the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Manli Shu , Weili Nie , De-An Huang , Zhiding Yu , Tom Goldstein , Anima Anandkumar , Chaowei Xiao

Vision-language models (VLMs) like CLIP (Contrastive Language-Image Pre-Training) have seen remarkable success in visual recognition, highlighting the increasing need to safeguard the intellectual property (IP) of well-trained models.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Lianyu Wang , Meng Wang , Huazhu Fu , Daoqiang Zhang
‹ Prev 1 2 3 10 Next ›