English
Related papers

Related papers: Exploring Interpretability for Visual Prompt Tunin…

200 papers

Unpaired Image Captioning (UIC) has been developed to learn image descriptions from unaligned vision-language sample pairs. Existing works usually tackle this task using adversarial learning and visual concept reward based on reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Peipei Zhu , Xiao Wang , Lin Zhu , Zhenglong Sun , Weishi Zheng , Yaowei Wang , Changwen Chen

Pre-trained vision-language models, e.g., CLIP, working with manually designed prompts have demonstrated great capacity of transfer learning. Recently, learnable prompts achieve state-of-the-art performance, which however are prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Baoshuo Kan , Teng Wang , Wenpeng Lu , Xiantong Zhen , Weili Guan , Feng Zheng

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

Prompt learning has become a prevalent strategy for adapting vision-language foundation models to downstream tasks. As large language models (LLMs) have emerged, recent studies have explored the use of category-related descriptions as input…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yubin Wang , Xinyang Jiang , De Cheng , Dongsheng Li , Cairong Zhao

Transferring knowledge from an image synthesis model trained on a large dataset is a promising direction for learning generative image models from various domains efficiently. While previous works have studied GAN models, we present a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Kihyuk Sohn , Yuan Hao , José Lezama , Luisa Polania , Huiwen Chang , Han Zhang , Irfan Essa , Lu Jiang

Prompt tuning, like CoOp, has recently shown promising vision recognizing and transfer learning ability on various downstream tasks with the emergence of large pre-trained vision-language models like CLIP. However, we identify that existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yongzhu Miao , Shasha Li , Jintao Tang , Ting Wang

Prompt tuning has become a popular strategy for adapting Vision-Language Models (VLMs) to zero/few-shot visual recognition tasks. Some prompting techniques introduce prior knowledge due to its richness, but when learnable tokens are…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Shuchang Zhou , Jiwei Wei , Shiyuan He , Yuyang Zhou , Chaoning Zhang , Jie Zou , Ning Xie , Yang Yang

Large pre-trained vision-language (VL) models have shown significant promise in adapting to various downstream tasks. However, fine-tuning the entire network is challenging due to the massive number of model parameters. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jingchen Sun , Jiayu Qin , Zihao Lin , Changyou Chen

Prompt learning has become a prevalent strategy for adapting vision-language foundation models (VLMs) such as CLIP to downstream tasks. With the emergence of large language models (LLMs), recent studies have explored the potential of using…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Yubin Wang , Xinyang Jiang , De Cheng , Wenli Sun , Dongsheng Li , Cairong Zhao

Soft prompts have been popularized as a cheap and easy way to improve task-specific LLM performance beyond few-shot prompts. Despite their origin as an automated prompting method, however, soft prompts and other trainable prompts remain a…

Machine Learning · Computer Science 2025-04-04 Oam Patel , Jason Wang , Nikhil Shivakumar Nayak , Suraj Srinivas , Himabindu Lakkaraju

Pre-trained Vision-Language Models (VLMs) have recently shown promise in detecting anomalies. However, previous approaches are fundamentally limited by their reliance on human-designed prompts and the lack of accessible anomaly samples,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Pi-Wei Chen , Jerry Chun-Wei Lin , Wei-Han Chen , Jia Ji , Zih-Ching Chen , Feng-Hao Yeh , Chao-Chun Chen

With the scale of vision Transformer-based models continuing to grow, finetuning these large-scale pretrained models for new tasks has become increasingly parameter-intensive. Visual prompt tuning is introduced as a parameter-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Runjia Zeng , Cheng Han , Qifan Wang , Chunshu Wu , Tong Geng , Lifu Huang , Ying Nian Wu , Dongfang Liu

As the scale of vision models continues to grow, Visual Prompt Tuning (VPT) has emerged as a parameter-efficient transfer learning technique, noted for its superior performance compared to full fine-tuning. However, indiscriminately…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Haowei Zhu , Fangyuan Zhang , Rui Qin , Tianxiang Pan , Junhai Yong , Bin Wang

Although Multimodal Large Language Models (MLLMs) have demonstrated promising versatile capabilities, their performance is still inferior to specialized models on downstream tasks, which makes adaptation necessary to enhance their utility.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yichi Zhang , Yinpeng Dong , Siyuan Zhang , Tianzan Min , Hang Su , Jun Zhu

We consider the generic problem of detecting low-level structures in images, which includes segmenting the manipulated parts, identifying out-of-focus pixels, separating shadow regions, and detecting concealed objects. Whereas each such…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Weihuang Liu , Xi Shen , Chi-Man Pun , Xiaodong Cun

Prompt learning is one of the most effective and trending ways to adapt powerful vision-language foundation models like CLIP to downstream datasets by tuning learnable prompt vectors with very few samples. However, although prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Cairong Zhao , Yubin Wang , Xinyang Jiang , Yifei Shen , Kaitao Song , Dongsheng Li , Duoqian Miao

CLIP-based prompt tuning enables pretrained Vision-Language Models (VLMs) to efficiently adapt to downstream tasks. Although existing studies have made significant progress, they pay limited attention to changes in the internal attention…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Haoyang Li , Liang Wang , Siyu Zhou , Jiacheng Sun , Jing Jiang , Chao Wang , Guodong Long , Yan Peng

Large pre-trained vision and language models have demonstrated remarkable capacities for various tasks. However, solving the knowledge-based visual reasoning tasks remains challenging, which requires a model to comprehensively understand…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Zhenfang Chen , Qinhong Zhou , Yikang Shen , Yining Hong , Hao Zhang , Chuang Gan

Image recognition with prototypes is considered an interpretable alternative for black box deep learning models. Classification depends on the extent to which a test image "looks like" a prototype. However, perceptual similarity for humans…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Meike Nauta , Annemarie Jutte , Jesper Provoost , Christin Seifert

Fine-tuning large language models is becoming ever more impractical due to their rapidly-growing scale. This motivates the use of parameter-efficient adaptation methods such as prompt tuning (PT), which adds a small number of tunable…

Computation and Language · Computer Science 2023-02-23 Simeng Sun , Yang Liu , Dan Iter , Chenguang Zhu , Mohit Iyyer