English
Related papers

Related papers: Revisiting Few-shot Activity Detection with Class …

200 papers

Few-shot (FS) and zero-shot (ZS) learning are two different approaches for scaling temporal action detection (TAD) to new classes. The former adapts a pretrained vision model to a new task represented by as few as a single video per class,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sauradip Nag , Mengmeng Xu , Xiatian Zhu , Juan-Manuel Perez-Rua , Bernard Ghanem , Yi-Zhe Song , Tao Xiang

We address the problem of anomaly detection in videos. The goal is to identify unusual behaviours automatically by learning exclusively from normal videos. Most existing approaches are usually data-hungry and have limited generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Yiwei Lu , Frank Yu , Mahesh Kumar Krishna Reddy , Yang Wang

Most work on temporal action detection is formulated as an offline problem, in which the start and end times of actions are determined after the entire video is fully observed. However, important real-time applications including…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Mingze Xu , Mingfei Gao , Yi-Ting Chen , Larry S. Davis , David J. Crandall

In this paper, we are interested in the few-shot learning problem. In particular, we focus on a challenging scenario where the number of categories is large and the number of examples per novel category is very limited, e.g. 1, 2, or 3.…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Siyuan Qiao , Chenxi Liu , Wei Shen , Alan Yuille

Weakly-supervised Temporal Action Localization (WS-TAL) methods learn to localize temporal starts and ends of action instances in a video under only video-level supervision. Existing WS-TAL methods rely on deep features learned for action…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Ziyi Liu , Le Wang , Wei Tang , Junsong Yuan , Nanning Zheng , Gang Hua

Understanding temporal information and how the visual world changes over time is a fundamental ability of intelligent systems. In video understanding, temporal information is at the core of many current challenges, including compression,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Laura Sevilla-Lara , Shengxin Zha , Zhicheng Yan , Vedanuj Goswami , Matt Feiszli , Lorenzo Torresani

Online action detection in untrimmed videos aims to identify an action as it happens, which makes it very important for real-time applications. Previous methods rely on tedious annotations of temporal action boundaries for training, which…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Mingfei Gao , Yingbo Zhou , Ran Xu , Richard Socher , Caiming Xiong

We present an approach for weakly supervised learning of human actions. Given a set of videos and an ordered list of the occurring actions, the goal is to infer start and end frames of the related action classes within the video and to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Alexander Richard , Hilde Kuehne , Juergen Gall

Detecting actions in untrimmed videos is an important yet challenging task. In this paper, we present the structured segment network (SSN), a novel framework which models the temporal structure of each action instance via a structured…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Yue Zhao , Yuanjun Xiong , Limin Wang , Zhirong Wu , Xiaoou Tang , Dahua Lin

Despite excellent progress has been made, the performance on action recognition still heavily relies on specific datasets, which are difficult to extend new action classes due to labor-intensive labeling. Moreover, the high diversity in…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 Xiaoyuan Ni , Sizhe Song , Yu-Wing Tai , Chi-Keung Tang

Weakly-supervised temporal action localization aims to locate action regions and identify action categories in untrimmed videos simultaneously by taking only video-level labels as the supervision. Pseudo label generation is a promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Wulian Yun , Mengshi Qi , Chuanming Wang , Huadong Ma

We propose a novel approach to few-shot action recognition, finding temporally-corresponding frame tuples between the query and videos in the support set. Distinct from previous few-shot works, we construct class prototypes using the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Toby Perrett , Alessandro Masullo , Tilo Burghardt , Majid Mirmehdi , Dima Damen

Recognising actions in videos relies on labelled supervision during training, typically the start and end times of each action instance. This supervision is not only subjective, but also expensive to acquire. Weak video-level supervision…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Davide Moltisanti , Sanja Fidler , Dima Damen

Spatial and temporal modeling is one of the most core aspects of few-shot action recognition. Most previous works mainly focus on long-term temporal relation modeling based on high-level spatial representations, without considering the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jiazheng Xing , Mengmeng Wang , Yong Liu , Boyu Mu

Our objective in this work is fine-grained classification of actions in untrimmed videos, where the actions may be temporally extended or may span only a few frames of the video. We cast this into a query-response mechanism, where each…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Chuhan Zhang , Ankush Gupta , Andrew Zisserman

Many few-shot learning models focus on recognising images. In contrast, we tackle a challenging task of few-shot action recognition from videos. We build on a C3D encoder for spatio-temporal video blocks to capture short-range action…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Hongguang Zhang , Li Zhang , Xiaojuan Qi , Hongdong Li , Philip H. S. Torr , Piotr Koniusz

Research on video activity detection has primarily focused on identifying well-defined human activities in short video segments. The majority of the research on video activity recognition is focused on the development of large parameter…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Venkatesh Jatla , Sravani Teeparthi , Ugesh Egala , Sylvia Celedon Pattichis , Marios S. Patticis

Temporal action detection aims to locate and classify actions in untrimmed videos. While recent works focus on designing powerful feature processors for pre-trained representations, they often overlook the inherent noise and redundancy…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xinnan Zhu , Yicheng Zhu , Tixin Chen , Wentao Wu , Yuanjie Dang

Time-series forecasting is important for many applications. Forecasting models are usually trained using time-series data in a specific target task. However, sufficient data in the target task might be unavailable, which leads to…

Machine Learning · Statistics 2020-10-01 Tomoharu Iwata , Atsutoshi Kumagai

In this paper, we present a novel Single Shot multi-Span Detector for temporal activity detection in long, untrimmed videos using a simple end-to-end fully three-dimensional convolutional (Conv3D) network. Our architecture, named S3D,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-09 Da Zhang , Xiyang Dai , Xin Wang , Yuan-Fang Wang