English
Related papers

Related papers: Task-Specific Alignment and Multiple Level Transfo…

200 papers

Existing temporal action localization (TAL) works rely on a large number of training videos with exhaustive segment-level annotation, preventing them from scaling to new classes. As a solution to this problem, few-shot TAL (FS-TAL) aims to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sauradip Nag , Xiatian Zhu , Tao Xiang

Existing works in few-shot action recognition mostly fine-tune a pre-trained image model and design sophisticated temporal alignment modules at feature level. However, simply fully fine-tuning the pre-trained model could cause overfitting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Congqi Cao , Yueran Zhang , Yating Yu , Qinyi Lv , Lingtong Min , Yanning Zhang

We propose MASTAF, a Model-Agnostic Spatio-Temporal Attention Fusion network for few-shot video classification. MASTAF takes input from a general video spatial and temporal representation,e.g., using 2D CNN, 3D CNN, and Video Transformer.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Rex Liu , Huanle Zhang , Hamed Pirsiavash , Xin Liu

Deep neural networks (DNNs) have achieved state-of-the-art results on time series classification (TSC) tasks. In this work, we focus on leveraging DNNs in the often-encountered practical scenario where access to labeled training data is…

Machine Learning · Computer Science 2021-03-05 Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff , Vishnu Tv

Meta-learning (ML) has emerged as a promising direction in learning models under constrained resource settings like few-shot learning. The popular approaches for ML either learn a generalizable initial model or a generic parametric…

Machine Learning · Computer Science 2022-03-07 Aroof Aimen , Sahil Sidheekh , Narayanan C. Krishnan

Large-scale pre-trained models have achieved remarkable success in language and image tasks, leading an increasing number of studies to explore the application of pre-trained image models, such as CLIP, in the domain of few-shot action…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Congqi Cao , Peiheng Han , Yueran zhang , Yating Yu , Qinyi Lv , Lingtong Min , Yanning zhang

Temporal Action Detection (TAD) in untrimmed videos poses significant challenges, particularly for Activities of Daily Living (ADL) requiring models to (1) process long-duration videos, (2) capture temporal variations in actions, and (3)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Arkaprava Sinha , Monish Soundar Raj , Pu Wang , Ahmed Helmy , Hieu Le , Srijan Das

Recent few-shot action recognition (FSAR) methods typically perform semantic matching on learned discriminative features to achieve promising performance. However, most FSAR methods focus on single-scale (e.g., frame-level, segment-level,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Hongyu Qu , Rui Yan , Xiangbo Shu , Hailiang Gao , Peng Huang , Guo-Sen Xie

Current few-shot learning models capture visual object relations in the so-called meta-learning setting under a fixed-resolution input. However, such models have a limited generalization ability under the scale and location mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hongguang Zhang , Philip H. S. Torr , Piotr Koniusz

Semi-supervised temporal action segmentation (SS-TA) aims to perform frame-wise classification in long untrimmed videos, where only a fraction of videos in the training set have labels. Recent studies have shown the potential of contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Feixiang Zhou , Zheheng Jiang , Huiyu Zhou , Xuelong Li

Few-shot learning aims to recognize instances from novel classes with few labeled samples, which has great value in research and application. Although there has been a lot of work in this area recently, most of the existing work is based on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Congqi Cao , Yajuan Li , Qinyi Lv , Peng Wang , Yanning Zhang

The task of Few-shot Learning (FSL) aims to do the inference on novel categories containing only few labeled examples, with the help of knowledge learned from base categories containing abundant labeled training samples. While there are…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Chengming Xu , Siqian Yang , Yabiao Wang , Zhanxiong Wang , Yanwei Fu , Xiangyang Xue

Meta learning approaches to few-shot classification are computationally efficient at test time, requiring just a few optimization steps or single forward pass to learn a new task, but they remain highly memory-intensive to train. This…

In recent years, assessing action quality from videos has attracted growing attention in computer vision community and human computer interaction. Most existing approaches usually tackle this problem by directly migrating the model from…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Shunli Wang , Dingkang Yang , Peng Zhai , Chixiao Chen , Lihua Zhang

Meta-learning aims at learning quickly on novel tasks with limited data by transferring generic experience learned from previous tasks. Naturally, few-shot learning has been one of the most popular applications for meta-learning. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Yudong Chen , Chaoyu Guan , Zhikun Wei , Xin Wang , Wenwu Zhu

We introduce TAM-RL (Task Aware Modulation using Representation Learning), a novel multimodal meta-learning framework for few-shot learning in heterogeneous systems, designed for science and engineering problems where entities share a…

Machine Learning · Computer Science 2024-10-17 Arvind Renganathan , Rahul Ghosh , Ankush Khandelwal , Vipin Kumar

Few-shot learning is a relatively new technique that specializes in problems where we have little amounts of data. The goal of these methods is to classify categories that have not been seen before with just a handful of samples. Recent…

The task of language-guided video temporal grounding is to localize the particular video clip corresponding to a query sentence in an untrimmed video. Though progress has been made continuously in this field, some issues still need to be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Binjie Zhang , Yu Li , Chun Yuan , Dejing Xu , Pin Jiang , Ying Shan

In few-shot learning scenarios, the challenge is to generalize and perform well on new unseen examples when only very few labeled examples are available for each task. Model-agnostic meta-learning (MAML) has gained the popularity as one of…

Machine Learning · Computer Science 2021-10-19 Sungyong Baik , Janghoon Choi , Heewon Kim , Dohee Cho , Jaesik Min , Kyoung Mu Lee

The difficulty of the fine-grained image classification mainly comes from a shared overall appearance across classes. Thus, recognizing discriminative details, such as eyes and beaks for birds, is a key in the task. However, this is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 SuBeen Lee , WonJun Moon , Hyun Seok Seong , Jae-Pil Heo