English
Related papers

Related papers: CLIP-guided Prototype Modulating for Few-shot Acti…

200 papers

Few-shot action recognition aims to enable models to quickly learn new action categories from limited labeled samples, addressing the challenge of data scarcity in real-world applications. Current research primarily addresses three core…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Xiaoyang Li , Mingming Lu , Ruiqi Wang , Hao Li , Zewei Le

Large vision-language representation learning models like CLIP have demonstrated impressive performance for zero-shot transfer to downstream tasks while largely benefiting from inter-modal (image-text) alignment via contrastive objectives.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Muhammad Waleed Gondal , Jochen Gast , Inigo Alonso Ruiz , Richard Droste , Tommaso Macri , Suren Kumar , Luitpold Staudigl

Applying large-scale vision-language pre-trained models like CLIP to few-shot action recognition (FSAR) can significantly enhance both performance and efficiency. While several studies have recognized this advantage, most of them resort to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Jiazheng Xing , Chao Xu , Mengmeng Wang , Guang Dai , Baigui Sun , Yong Liu , Jingdong Wang , Jian Zhao

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

Transferring vision-language knowledge from pretrained multimodal foundation models to various downstream tasks is a promising direction. However, most current few-shot action recognition methods are still limited to a single visual…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Xiang Wang , Shiwei Zhang , Hangjie Yuan , Yingya Zhang , Changxin Gao , Deli Zhao , Nong Sang

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations using large-scale image-text pairs. It shows impressive performance on downstream tasks by zero-shot knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Renrui Zhang , Zhang Wei , Rongyao Fang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

Multi-modal (vision-language) models, such as CLIP, are replacing traditional supervised pre-training models (e.g., ImageNet-based pre-training) as the new generation of visual foundation models. These models with robust and aligned…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fan Liu , Tianshu Zhang , Wenwen Dai , Wenwen Cai , Xiaocong Zhou , Delong Chen

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations by using large-scale contrastive image-text pairs. It shows impressive performance on zero-shot knowledge transfer to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Renrui Zhang , Rongyao Fang , Wei Zhang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

Foundation Vision-Language Models (VLMs) like CLIP exhibit strong generalization capabilities due to large-scale pretraining on diverse image-text pairs. However, their performance often degrades when applied to target datasets with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Debarshi Brahma , Soma Biswas

Visual language models like Contrastive Language-Image Pretraining (CLIP) have shown impressive performance in analyzing natural images with language information. However, these models often encounter challenges when applied to specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Jiaqing Zhang , Mingxiang Cao , Xue Yang , Kai Jiang , Yunsong Li

We propose a novel framework for few-shot learning by leveraging large-scale vision-language models such as CLIP. Motivated by unimodal prototypical networks for few-shot learning, we introduce Proto-CLIP which utilizes image prototypes and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jishnu Jaykumar P , Kamalesh Palanisamy , Yu-Wei Chao , Xinya Du , Yu Xiang

Few-shot action recognition (FSAR) has recently made notable progress through set matching and efficient adaptation of large-scale pre-trained models. However, two key limitations persist. First, existing set matching metrics typically rely…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Fei Long , Yao Zhang , Jiaming Lv , Jiangtao Xie , Peihua Li

Large-scale contrastive vision-language pre-training has shown significant progress in visual representation learning. Unlike traditional visual systems trained by a fixed set of discrete labels, a new paradigm was introduced in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Peng Gao , Shijie Geng , Renrui Zhang , Teli Ma , Rongyao Fang , Yongfeng Zhang , Hongsheng Li , Yu Qiao

Recently, few-shot action recognition has significantly progressed by learning the feature discriminability and designing suitable comparison methods. Still, there are the following restrictions. (a) Previous works are mainly based on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Fei Guo , Li Zhu , YiKang Wang , Han Qi

The popularity of Contrastive Language-Image Pre-training (CLIP) has propelled its application to diverse downstream vision tasks. To improve its capacity on downstream tasks, few-shot learning has become a widely-adopted technique.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Xiangyang Zhu , Renrui Zhang , Bowei He , Aojun Zhou , Dong Wang , Bin Zhao , Peng Gao

Few-shot learning (FSL) often requires effective adaptation of models using limited labeled data. However, most existing FSL methods rely on entangled representations, requiring the model to implicitly recover the unmixing process to obtain…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tianjiao Jiang , Zhen Zhang , Yuhang Liu , Javen Qinfeng Shi

Few-shot Test-Time Domain Adaptation focuses on adapting a model at test time to a specific domain using only a few unlabeled examples, addressing domain shift. Prior methods leverage CLIP's strong out-of-distribution (OOD) abilities by…

Machine Learning · Computer Science 2025-06-24 Zhixiang Chi , Li Gu , Huan Liu , Ziqiang Wang , Yanan Wu , Yang Wang , Konstantinos N Plataniotis

The recent CLIP-based methods have shown promising zero-shot and few-shot performance on image classification tasks. Existing approaches such as CoOp and Tip-Adapter only focus on high-level visual features that are fully aligned with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiaying Shi , Xuetong Xue , Shenghui Xu

Remote sensing applications increasingly rely on deep learning for scene classification. However, their performance is often constrained by the scarcity of labeled data and the high cost of annotation across diverse geographic and sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Ivica Dimitrovski , Vlatko Spasev , Ivan Kitanovski

Learning generalized representations from limited training samples is crucial for applying deep neural networks in low-resource scenarios. Recently, methods based on Contrastive Language-Image Pre-training (CLIP) have exhibited promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yao Zhu , Yuefeng Chen , Wei Wang , Xiaofeng Mao , Xiu Yan , Yue Wang , Zhigang Li , Wang lu , Jindong Wang , Xiangyang Ji
‹ Prev 1 2 3 10 Next ›