English
Related papers

Related papers: Multi-Modal Few-Shot Temporal Action Detection

200 papers

Zero-shot learning (ZSL) aims to train a model on seen classes and recognize unseen classes by knowledge transfer through shared auxiliary information. Recent studies reveal that documents from encyclopedias provide helpful auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiangyan Qu , Jing Yu , Jiamin Zhuang , Gaopeng Gou , Gang Xiong , Qi Wu

Few-shot segmentation performance declines substantially when facing images from a domain different than the training domain, effectively limiting real-world use cases. To alleviate this, recently cross-domain few-shot segmentation (CD-FSS)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Jonas Herzog

Few-Shot Object Detection (FSOD) is a rapidly growing field in computer vision. It consists in finding all occurrences of a given set of classes with only a few annotated examples for each class. Numerous methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Pierre Le Jeune , Anissa Mokraoui

Few-shot action recognition (FSAR) requires models to generalize to novel action categories from only a handful of annotated samples. Despite progress with vision-language models, existing approaches still suffer from semantic-temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Hongli Liu , Yu Wang , Shengjie Zhao

Zero-shot temporal action localization (ZS-TAL) consists of classifying and localizing actions in untrimmed videos, where action classes are unseen at training time. Existing work uses Vision and Language Models (VLMs), taking advantage of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Benedetta Liberatori , Alessandro Conti , Lorenzo Vaquero , Paolo Rota , Yiming Wang , Elisa Ricci

Large-scale multimodal representation learning successfully optimizes for zero-shot transfer at test time. Yet the standard pretraining paradigm (contrastive learning on large amounts of image-text data) does not explicitly encourage…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Karsten Roth , Zeynep Akata , Dima Damen , Ivana Balažević , Olivier J. Hénaff

Meta-learning is widely used for few-shot slot tagging in task of few-shot learning. The performance of existing methods is, however, seriously affected by \textit{sample forgetting issue}, where the model forgets the historically learned…

Artificial Intelligence · Computer Science 2023-09-12 Hongru Wang , Zezhong Wang , Wai Chung Kwan , Kam-Fai Wong

Spatial and temporal modeling is one of the most core aspects of few-shot action recognition. Most previous works mainly focus on long-term temporal relation modeling based on high-level spatial representations, without considering the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jiazheng Xing , Mengmeng Wang , Yong Liu , Boyu Mu

Few-shot semantic segmentation (FSS) endeavors to segment unseen classes with only a few labeled samples. Current FSS methods are commonly built on the assumption that their training and application scenarios share similar domains, and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Weizhao He , Yang Zhang , Wei Zhuo , Linlin Shen , Jiaqi Yang , Songhe Deng , Liang Sun

Few-shot learning is an important research field of machine learning in which a classifier must be trained in such a way that it can adapt to new classes which are not included in the training set. However, only small amounts of examples of…

Machine Learning · Computer Science 2020-06-11 Andrei Boiarov , Oleg Granichin , Olga Granichina

Cross-Domain Few-Shot Object Detection (CD-FSOD) aims to detect novel classes in unseen target domains given only a few labeled examples. While open-vocabulary detectors built on vision-language models (VLMs) transfer well, they depend…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Wanqi Wang , Jingcai Guo , Yuxiang Cai , Zhi Chen

Adapting pre-trained models to open classes is a challenging problem in machine learning. Vision-language models fully explore the knowledge of text modality, demonstrating strong zero-shot recognition performance, which is naturally suited…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Zhengqing Gao , Xiang Ao , Xu-Yao Zhang , Cheng-Lin Liu

Despite significant success of deep learning in object detection tasks, the standard training of deep neural networks requires access to a substantial quantity of annotated images across all classes. Data annotation is an arduous and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zeyu Shangguan , Mohammad Rostami

Temporal Action Detection (TAD), the task of localizing and classifying actions in untrimmed video, remains challenging due to action overlaps and variable action durations. Recent findings suggest that TAD performance is dependent on the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Aglind Reka , Diana Laura Borza , Dominick Reilly , Michal Balazia , Francois Bremond

The present few-shot temporal action localization model can't handle the situation where videos contain multiple action instances. So the purpose of this paper is to achieve manifold action instances localization in a lengthy untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Fengshun Wang , Qiurui Wang , Yuting Wang

Vision-language models have recently shown great potential on many tasks in computer vision. Meanwhile, prior work demonstrates prompt tuning designed for vision-language models could acquire superior performance on few-shot image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kun Ding , Ying Wang , Pengzhang Liu , Qiang Yu , Haojian Zhang , Shiming Xiang , Chunhong Pan

Object detection has achieved a huge breakthrough with deep neural networks and massive annotated data. However, current detection methods cannot be directly transferred to the scenario where the annotated data is scarce due to the severe…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Qihan Huang , Haofei Zhang , Mengqi Xue , Jie Song , Mingli Song

Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed meta-learning approach which addresses the problem of few-shot NER by…

Computation and Language · Computer Science 2022-04-14 Tingting Ma , Huiqiang Jiang , Qianhui Wu , Tiejun Zhao , Chin-Yew Lin

Generative zero-shot learning (ZSL) methods typically synthesize visual features for unseen classes using predefined semantic attributes, followed by training a fully supervised classification model. While effective, these methods require…

Machine Learning · Computer Science 2025-07-03 Md Shakil Ahamed Shohag , Q. M. Jonathan Wu , Farhad Pourpanah

In this paper, we address the challenges in unsupervised video object segmentation (UVOS) by proposing an efficient algorithm, termed MTNet, which concurrently exploits motion and temporal cues. Unlike previous methods that focus solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Yunzhi Zhuge , Hongyu Gu , Lu Zhang , Jinqing Qi , Huchuan Lu