English
Related papers

Related papers: Prompting Large Pre-trained Vision-Language Models…

200 papers

Large-scale vision-language models (VLMs), trained on extensive datasets of image-text pairs, exhibit strong multimodal understanding capabilities by implicitly learning associations between textual descriptions and image regions. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Mir Rayat Imtiaz Hossain , Mennatullah Siam , Leonid Sigal , James J. Little

The vision community is undergoing the unprecedented progress with the emergence of Vision-Language Pretraining Models (VLMs). Prompt learning plays as the holy grail of accessing VLMs since it enables their fast adaptation to downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Ziliang Chen , Xin Huang , Quanlong Guan , Liang Lin , Weiqi Luo

As an effective approach to tune pre-trained language models (PLMs) for specific tasks, prompt-learning has recently attracted much attention from researchers. By using \textit{cloze}-style language prompts to stimulate the versatile…

Computation and Language · Computer Science 2021-08-25 Ning Ding , Yulin Chen , Xu Han , Guangwei Xu , Pengjun Xie , Hai-Tao Zheng , Zhiyuan Liu , Juanzi Li , Hong-Gee Kim

Soft prompt learning methods are effective for adapting vision-language models (VLMs) to downstream tasks. Nevertheless, empirical evidence reveals a tendency of existing methods that they overfit seen classes and exhibit degraded…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yang Chen , Shuai Fu , Yu Zhang

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Samarth Singhal , Sandeep Singhal

Recent advances in large language and vision-language models have enabled zero-shot inference, allowing models to solve new tasks without task-specific training. Various adaptation techniques such as prompt engineering, In-Context Learning…

Machine Learning · Computer Science 2025-04-04 Artyom Gadetsky , Andrei Atanov , Yulun Jiang , Zhitong Gao , Ghazal Hosseini Mighan , Amir Zamir , Maria Brbic

Vision-Language Models (VLMs) have shown remarkable capabilities in a large number of downstream tasks. Nonetheless, compositional image understanding remains a rather difficult task due to the object bias present in training data. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Matteo Nulli , Anesa Ibrahimi , Avik Pal , Hoshe Lee , Ivona Najdenkoska

Prompt learning is a new learning paradigm which reformulates downstream tasks as similar pretraining tasks on pretrained models by leveraging textual prompts. Recent works have demonstrated that prompt learning is particularly useful for…

Computation and Language · Computer Science 2022-10-21 Yue Zhang , Hongliang Fei , Dingcheng Li , Tan Yu , Ping Li

Recent advancements in deep learning have driven significant progress in lossless image compression. With the emergence of Large Language Models (LLMs), preliminary attempts have been made to leverage the extensive prior knowledge embedded…

Image and Video Processing · Electrical Eng. & Systems 2025-02-25 Junhao Du , Chuqin Zhou , Ning Cao , Gang Chen , Yunuo Chen , Zhengxue Cheng , Li Song , Guo Lu , Wenjun Zhang

Pre-trained Vision Language Models (VLMs) have demonstrated notable progress in various zero-shot tasks, such as classification and retrieval. Despite their performance, because improving performance on new tasks requires task-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jihwan Bang , Sumyeong Ahn , Jae-Gil Lee

Inspired by the success of vision-language methods (VLMs) in zero-shot classification, recent works attempt to extend this line of work into object detection by leveraging the localization ability of pre-trained VLMs and generating pseudo…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Yanxin Long , Jianhua Han , Runhui Huang , Xu Hang , Yi Zhu , Chunjing Xu , Xiaodan Liang

Visual Word Sense Disambiguation (VWSD) is a novel challenging task that lies between linguistic sense disambiguation and fine-grained multimodal retrieval. The recent advancements in the development of visiolinguistic (VL) transformers…

Computation and Language · Computer Science 2024-04-23 Anastasia Kritharoula , Maria Lymperaiou , Giorgos Stamou

Large language models (LLMs) have the potential to enhance K-12 STEM education by improving both teaching and learning processes. While previous studies have shown promising results, there is still a lack of comprehensive understanding…

Computation and Language · Computer Science 2024-10-16 Eason Chen , Danyang Wang , Luyi Xu , Chen Cao , Xiao Fang , Jionghao Lin

Language-vision models like CLIP have made significant strides in vision tasks, such as zero-shot image classification (ZSIC). However, generating specific and expressive visual descriptions remains challenging; descriptions produced by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Michael Ogezi , Bradley Hauer , Grzegorz Kondrak

Prompt learning methods have significantly extended the transferability of pre-trained Vision-Language Models (VLMs) like CLIP for various downstream tasks. These methods adopt handcraft templates or learnable vectors to provide text or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Jiahui Wang , Qin Xu , Bo Jiang , Bin Luo

Detecting Human-Object Interactions (HOI) in zero-shot settings, where models must handle unseen classes, poses significant challenges. Existing methods that rely on aligning visual encoders with large Vision-Language Models (VLMs) to tap…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Qinqian Lei , Bo Wang , Robby T. Tan

Thanks to the large pre-trained vision-language models (VLMs) like CLIP, we can craft a zero-shot classifier by "prompt", e.g., the confidence score of an image being "[CLASS]" can be obtained by using the VLM provided similarity measure…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Beier Zhu , Yulei Niu , Yucheng Han , Yue Wu , Hanwang Zhang

Existing Large Vision-Language Models (LVLMs) excel at matching concepts across multi-modal inputs but struggle with compositional concepts and high-level relationships between entities. This paper introduces Progressive multi-granular…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Quang-Hung Le , Long Hoang Dang , Ngan Le , Truyen Tran , Thao Minh Le

We investigate whether prompts learned independently for different tasks can be later combined through prompt algebra to obtain a model that supports composition of tasks. We consider Visual Language Models (VLM) with prompt tuning as our…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Pramuditha Perera , Matthew Trager , Luca Zancato , Alessandro Achille , Stefano Soatto

Zero-shot learning (ZSL) aims to predict unseen classes whose samples have never appeared during training. One of the most effective and widely used semantic information for zero-shot image classification are attributes which are…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Zhuo Chen , Yufeng Huang , Jiaoyan Chen , Yuxia Geng , Wen Zhang , Yin Fang , Jeff Z. Pan , Huajun Chen