English
Related papers

Related papers: Temporal-Relational CrossTransformers for Few-Shot…

200 papers

This paper introduces the task of few-shot common action localization in time and space. Given a few trimmed support videos containing the same but unknown action, we strive for spatio-temporal localization of that action in a long…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Pengwan Yang , Pascal Mettes , Cees G. M. Snoek

There is a growing interest in learning a model which could recognize novel classes with only a few labeled examples. In this paper, we propose Temporal Alignment Module (TAM), a novel few-shot learning framework that can learn to classify…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Kaidi Cao , Jingwei Ji , Zhangjie Cao , Chien-Yi Chang , Juan Carlos Niebles

Spatial and temporal modeling is one of the most core aspects of few-shot action recognition. Most previous works mainly focus on long-term temporal relation modeling based on high-level spatial representations, without considering the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jiazheng Xing , Mengmeng Wang , Yong Liu , Boyu Mu

Few-shot relation classification seeks to classify incoming query instances after meeting only few support instances. This ability is gained by training with large amount of in-domain annotated data. In this paper, we tackle an even harder…

Computation and Language · Computer Science 2020-12-15 Xiaoqing Geng , Xiwen Chen , Kenny Q. Zhu , Libin Shen , Yinggong Zhao

The existing few-shot video classification methods often employ a meta-learning paradigm by designing customized temporal alignment module for similarity calculation. While significant progress has been made, these methods fail to focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhenxi Zhu , Limin Wang , Sheng Guo , Gangshan Wu

Dynamic scene graphs generated from video clips could help enhance the semantic visual understanding in a wide range of challenging tasks such as environmental perception, autonomous navigation, and task planning of self-driving vehicles…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Jingyi Wang , Jinfa Huang , Can Zhang , Zhidong Deng

We propose a novel few-shot action recognition framework, STRM, which enhances class-specific feature discriminability while simultaneously learning higher-order temporal representations. The focus of our approach is a novel spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Anirudh Thatipelli , Sanath Narayan , Salman Khan , Rao Muhammad Anwer , Fahad Shahbaz Khan , Bernard Ghanem

We propose a Few-shot Learning pipeline for 3D skeleton-based action recognition by Joint tEmporal and cAmera viewpoiNt alIgnmEnt (JEANIE). To factor out misalignment between query and support sequences of 3D body joints, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Lei Wang , Piotr Koniusz

Few-shot action recognition has attracted increasing attention due to the difficulty in acquiring the properly labelled training samples. Current works have shown that preserving spatial information and comparing video descriptors are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Yang Bo , Yangdi Lu , Wenbo He

In recent years, 2D Convolutional Networks-based video action recognition has encouragingly gained wide popularity; However, constrained by the lack of long-range non-linear temporal relation modeling and reverse motion information…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yongkang Zhang , Jun Li , Guoming Wu , Han Zhang , Zhiping Shi , Zhaoxun Liu , Zizhang Wu

Few-shot action recognition aims to recognize novel action classes (query) using just a few samples (support). The majority of current approaches follow the metric learning paradigm, which learns to compare the similarity between videos.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Shuyuan Li , Huabin Liu , Rui Qian , Yuxi Li , John See , Mengjuan Fei , Xiaoyuan Yu , Weiyao Lin

Many interesting events in the real world are rare making preannotated machine learning ready videos a rarity in consequence. Thus, temporal activity detection models that are able to learn from a few examples are desirable. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Huijuan Xu , Ximeng Sun , Eric Tzeng , Abir Das , Kate Saenko , Trevor Darrell

In this paper, we propose a novel Temporal Sequence-Aware Model (TSAM) for few-shot action recognition (FSAR), which incorporates a sequential perceiver adapter into the pre-training framework, to integrate both the spatial information and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Bozheng Li , Mushui Liu , Gaoang Wang , Yunlong Yu

Current few-shot action recognition methods reach impressive performance by learning discriminative features for each video via episodic training and designing various temporal alignment strategies. Nevertheless, they are limited in that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Xiang Wang , Shiwei Zhang , Zhiwu Qing , Mingqian Tang , Zhengrong Zuo , Changxin Gao , Rong Jin , Nong Sang

Few-shot relation extraction aims to recognize novel relations with few labeled sentences in each relation. Previous metric-based few-shot relation extraction algorithms identify relationships by comparing the prototypes generated by the…

Computation and Language · Computer Science 2023-05-12 Zhongju Yuan , Zhenkun Wang , Genghui Li

Many activities of interest are rare events, with only a few labeled examples available. Therefore models for temporal activity detection which are able to learn from a few examples are desirable. In this paper, we present a conceptually…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Huijuan Xu , Bingyi Kang , Ximeng Sun , Jiashi Feng , Kate Saenko , Trevor Darrell

Recent attempts mainly focus on learning deep representations for each video individually under the episodic meta-learning regime and then performing temporal alignment to match query and support videos. However, they still suffer from two…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Xiang Wang , Shiwei Zhang , Zhiwu Qing , Zhengrong Zuo , Changxin Gao , Rong Jin , Nong Sang

Existing works in few-shot action recognition mostly fine-tune a pre-trained image model and design sophisticated temporal alignment modules at feature level. However, simply fully fine-tuning the pre-trained model could cause overfitting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Congqi Cao , Yueran Zhang , Yating Yu , Qinyi Lv , Lingtong Min , Yanning Zhang

Sign language recognition from sequences of monocular images or 2D poses is a challenging field, not only due to the difficulty to infer 3D information from 2D data, but also due to the temporal relationship between the sequences of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Silvan Ferreira , Esdras Costa , Márcio Dahia , Jampierre Rocha

Few-shot algorithms aim at learning new tasks provided only a handful of training examples. In this work we investigate few-shot learning in the setting where the data points are sequences of tokens and propose an efficient learning…

Machine Learning · Computer Science 2020-12-18 Lajanugen Logeswaran , Ann Lee , Myle Ott , Honglak Lee , Marc'Aurelio Ranzato , Arthur Szlam