English
Related papers

Related papers: CLIP-guided Prototype Modulating for Few-shot Acti…

200 papers

Recent advancements in multimodal foundation models (e.g., CLIP) have excelled in zero-shot generalization. Prompt tuning involved in the knowledge transfer from foundation models to downstream tasks has gained significant attention…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xuejing Liu , Wei Tang , Jinghui Lu , Rui Zhao , Zhaojun Guo , Fei Tan

Few-shot object detection, which focuses on detecting novel objects with few labels, is an emerging challenge in the community. Recent studies show that adapting a pre-trained model or modified loss function can improve performance. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Min Jae Jung , Seung Dae Han , Joohee Kim

Few-Shot Action Recognition (FSAR) is a challenging task that requires recognizing novel action categories with a few labeled videos. Recent works typically apply semantically coarse category names as auxiliary contexts to guide the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Hongyu Qu , Xiangbo Shu , Rui Yan , Hailiang Gao , Wenguan Wang , Jinhui Tang

Pre-trained vision-language (V-L) models such as CLIP have shown excellent performance in many downstream cross-modal tasks. However, most of them are only applicable to the English context. Subsequent research has focused on this problem…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Wenbo Zhang , Yifan Zhang , Jianfeng Lin , Binqiang Huang , Jinlu Zhang , Wenhao Yu

Multi-Task Learning (MTL) is designed to train multiple correlated tasks simultaneously, thereby enhancing the performance of individual tasks. Typically, a multi-task network structure consists of a shared backbone and task-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Yi Xin , Junlong Du , Qiang Wang , Ke Yan , Shouhong Ding

Recent few-shot action recognition (FSAR) methods typically perform semantic matching on learned discriminative features to achieve promising performance. However, most FSAR methods focus on single-scale (e.g., frame-level, segment-level,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Hongyu Qu , Rui Yan , Xiangbo Shu , Hailiang Gao , Peng Huang , Guo-Sen Xie

With the rapid advancements in wireless communication technology, automatic modulation recognition (AMR) plays a critical role in ensuring communication security and reliability. However, numerous challenges, including higher performance…

Machine Learning · Computer Science 2025-02-27 Dongwei Xu , Yutao Zhu , Yao Lu , Youpeng Feng , Yun Lin , Qi Xuan

Prompt learning has propelled vision-language models like CLIP to excel in diverse tasks, making them ideal for federated learning due to computational efficiency. However, conventional approaches that rely solely on final-layer features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Suraj Prasad , Navyansh Mahla , Sunny Gupta , Amit Sethi

Few-shot learning (FSL) aims to recognize novel concepts from only a few labeled support samples. Recent studies enhance support features by incorporating additional semantic information or designing complex semantic fusion modules.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Wenhao Li , Qiangchang Wang , Xianjing Meng , Zhibin Wu , Yilong Yin

Existing vision-language models (VLMs) such as CLIP have showcased an impressive capability to generalize well across various downstream tasks. These models leverage the synergy between visual and textual information, enabling them to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Fangming Cui , Yonggang Zhang , Xuan Wang , Xule Wang , Liang Xiao

Vision-Language Models (VLMs) such as CLIP demonstrate strong zero-shot generalization, but their performance significantly degrades in cross-domain scenarios with scarce target-domain training data (Cross-Domain Few-Shot Learning, CDFSL).…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Vision-language foundation models have exhibited remarkable success across a multitude of downstream tasks due to their scalability on extensive image-text paired data. However, these models also display significant limitations when applied…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Huan Ma , Yan Zhu , Changqing Zhang , Peilin Zhao , Baoyuan Wu , Long-Kai Huang , Qinghua Hu , Bingzhe Wu

Contrastive Language-Image Pre-training (CLIP) exhibits strong zero-shot classification ability on various image-level tasks, leading to the research to adapt CLIP for pixel-level open-vocabulary semantic segmentation without additional…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Lin Sun , Jiale Cao , Jin Xie , Xiaoheng Jiang , Yanwei Pang

Large pre-trained vision-language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different from the traditional representation learning that is based…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Kaiyang Zhou , Jingkang Yang , Chen Change Loy , Ziwei Liu

CLIP models perform remarkably well on zero-shot classification and retrieval tasks. But recent studies have shown that learnt representations in CLIP are not well suited for dense prediction tasks like object detection, semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Pavan Kumar Anasosalu Vasu , Hadi Pouransari , Fartash Faghri , Oncel Tuzel

As a pioneering vision-language model, CLIP (Contrastive Language-Image Pre-training) has achieved significant success across various domains and a wide range of downstream vision-language tasks. However, the text encoders in popular CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Mothilal Asokan , Kebin Wu , Fatima Albreiki

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Recent progress in the few-shot adaptation of Vision-Language Models (VLMs) has further pushed their generalization capabilities, at the expense of just a few labeled samples within the target downstream task. However, this promising,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Maxime Zanella , Ismail Ben Ayed

Pre-trained vision-language models have inspired much research on few-shot learning. However, with only a few training images, there exist two crucial problems: (1) the visual feature distributions are easily distracted by class-irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Runqi Wang , Hao Zheng , Xiaoyue Duan , Jianzhuang Liu , Yuning Lu , Tian Wang , Songcen Xu , Baochang Zhang