English
Related papers

Related papers: Optimization of Prompt Learning via Multi-Knowledg…

200 papers

Pre-trained Vision-Language Models (VLMs), like CLIP, exhibit strong generalization ability to downstream tasks but struggle in few-shot scenarios. Existing prompting techniques primarily focus on global text and image representations, yet…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xin Liu , Jiamin Wu , and Wenfei Yang , Xu Zhou , Tianzhu Zhang

Low-light conditions have an adverse impact on machine cognition, limiting the performance of computer vision systems in real life. Since low-light data is limited and difficult to annotate, we focus on image processing to enhance low-light…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Igor Morawski , Kai He , Shusil Dangi , Winston H. Hsu

Pre-trained vision-language models (VLMs) have shown remarkable generalization capabilities via prompting, which leverages VLMs as knowledge bases to extract information beneficial for downstream tasks. However, existing methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xiaoyu Qiu , Hao Feng , Yuechen Wang , Wengang Zhou , Houqiang Li

Large-scale vision-language models (VLMs), e.g., CLIP, learn broad visual concepts from tedious training data, showing superb generalization ability. Amount of prompt learning methods have been proposed to efficiently adapt the VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Hongyu Hu , Tiancheng Lin , Jie Wang , Zhenbang Sun , Yi Xu

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yu Du , Tong Niu , Rong Zhao

Vision-language models (VLMs) pre-trained on natural image and language data, such as CLIP, have exhibited significant potential in few-shot image recognition tasks, leading to development of various efficient transfer learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Dexia Chen , Wentao Zhang , Qianjie Zhu , Ping Hu , Weibing Li , Tong Zhang , Ruixuan Wang

Pretrained vision-language models (VLMs) such as CLIP have shown impressive generalization capability in downstream vision tasks with appropriate text prompts. Instead of designing prompts manually, Context Optimization (CoOp) has been…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Chengcheng Ma , Yang Liu , Jiankang Deng , Lingxi Xie , Weiming Dong , Changsheng Xu

Pre-trained vision-language models, e.g., CLIP, working with manually designed prompts have demonstrated great capacity of transfer learning. Recently, learnable prompts achieve state-of-the-art performance, which however are prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Baoshuo Kan , Teng Wang , Wenpeng Lu , Xiantong Zhen , Weili Guan , Feng Zheng

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

Existing vision-language models (VLMs) treat text descriptions as a unit, confusing individual concepts in a prompt and impairing visual semantic matching and reasoning. An important aspect of reasoning in logic and language is negations.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jaisidh Singh , Ishaan Shrivastava , Mayank Vatsa , Richa Singh , Aparna Bharati

Image recognition has recently witnessed a paradigm shift, where vision-language models are now used to perform few-shot classification based on textual prompts. Among these, the CLIP model has shown remarkable capabilities for zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Lorenzo Agnolucci , Alberto Baldrati , Francesco Todino , Federico Becattini , Marco Bertini , Alberto Del Bimbo

Large pre-trained vision-language models like CLIP have transformed computer vision by aligning images and text in a shared feature space, enabling robust zero-shot transfer via prompting. Soft-prompting, such as Context Optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Vision-language models (VLMs) have demonstrated exceptional generalization capabilities for downstream tasks. Due to its efficiency, prompt learning has gradually become a more effective and efficient method for transferring VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chenhao Ding , Xinyuan Gao , Songlin Dong , Jizhou Han , Qiang Wang , Zhengdong Zhou , Yuhang He , Yihong Gong

Recent breakthroughs in reasoning models have markedly advanced the reasoning capabilities of large language models, particularly via training on tasks with verifiable rewards. Yet, a significant gap persists in their adaptation to real…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaao Yu , Shenwei Li , Mingjie Han , Yifei Yin , Wenzheng Song , Chenghao Jia , Man Lan

Recent years have witnessed the fast development of large-scale pre-training frameworks that can extract multi-modal representations in a unified form and achieve promising performances when transferred to downstream tasks. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Xuran Pan , Tianzhu Ye , Dongchen Han , Shiji Song , Gao Huang

Vision and Language Models (VLMs), such as CLIP, have enabled visual recognition of a potentially unlimited set of categories described by text prompts. However, for the best visual recognition performance, these models still require tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Horst Possegger , Rogerio Feris , Horst Bischof

Recent advances in pre-training vision-language models (VLMs), e.g., contrastive language-image pre-training (CLIP) methods, have shown great potential in learning out-of-distribution (OOD) representations. Despite showing competitive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Min Zhang , Bo Jiang , Jie Zhou , Yimeng Liu , Xin Lin

Remote sensing applications increasingly rely on deep learning for scene classification. However, their performance is often constrained by the scarcity of labeled data and the high cost of annotation across diverse geographic and sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Ivica Dimitrovski , Vlatko Spasev , Ivan Kitanovski

Vision-language models (VLMs), such as CLIP, have shown strong generalization under zero-shot settings, yet adapting them to downstream tasks with limited supervision remains a significant challenge. Existing multi-modal prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Silin Cheng , Kai Han

Going beyond mere fine-tuning of vision-language models (VLMs), learnable prompt tuning has emerged as a promising, resource-efficient alternative. Despite their potential, effectively learning prompts faces the following challenges: (i)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Hari Chandana Kuchibhotla , Sai Srinivas Kancheti , Abbavaram Gowtham Reddy , Vineeth N Balasubramanian