English
Related papers

Related papers: Faster-TAD: Towards Temporal Action Detection with…

200 papers

Existing temporal action detection (TAD) methods rely on generating an overwhelmingly large number of proposals per video. This leads to complex model designs due to proposal generation and/or per-proposal action instance evaluation and the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Sauradip Nag , Xiatian Zhu , Yi-Zhe Song , Tao Xiang

Temporal Action Detection (TAD) focuses on detecting pre-defined actions, while Moment Retrieval (MR) aims to identify the events described by open-ended natural language within untrimmed videos. Despite that they focus on different events,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yingsen Zeng , Yujie Zhong , Chengjian Feng , Lin Ma

Temporal action detection (TAD) aims to identify and localize action instances in untrimmed videos, which is essential for various video understanding tasks. However, recent improvements in model performance, driven by larger feature…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Xiaoyong Chen , Yong Guo , Jiaming Liang , Sitong Zhuang , Runhao Zeng , Xiping Hu

Most current pipelines for spatio-temporal action localization connect frame-wise or clip-wise detection results to generate action proposals, where only local information is exploited and the efficiency is hindered by dense per-frame…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Yuxi Li , Weiyao Lin , John See , Ning Xu , Shugong Xu , Ke Yan , Cong Yang

Temporal action proposal generation is an important task, akin to object proposals, temporal action proposals are intended to capture "clips" or temporal intervals in videos that are likely to contain an action. Previous methods can be…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Jiyang Gao , Kan Chen , Ram Nevatia

Existing temporal action detection (TAD) methods rely on a large number of training data with segment-level annotations. Collecting and annotating such a training set is thus highly expensive and unscalable. Semi-supervised TAD (SS-TAD)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Sauradip Nag , Xiatian Zhu , Yi-Zhe Song , Tao Xiang

Temporal Action Proposal (TAP) generation is an important problem, as fast and accurate extraction of semantically important (e.g. human actions) segments from untrimmed videos is an important step for large-scale video analysis. We propose…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Jiyang Gao , Zhenheng Yang , Chen Sun , Kan Chen , Ram Nevatia

Temporal action detection (TAD) with end-to-end training often suffers from the pain of huge demand for computing resources due to long video duration. In this work, we propose an efficient temporal action detector (ETAD) that can train…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Shuming Liu , Mengmeng Xu , Chen Zhao , Xu Zhao , Bernard Ghanem

Temporal action detection is a fundamental yet challenging task in video understanding. Many of the state-of-the-art methods predict the boundaries of action instances based on predetermined anchors akin to the two-dimensional object…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Yiping Tang , Chuang Niu , Minghao Dong , Shenghan Ren , Jimin Liang

As a fundamental task in long-form video understanding, temporal action detection (TAD) aims to capture inherent temporal relations in untrimmed videos and identify candidate actions with precise boundaries. Over the years, various…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Shuming Liu , Lin Sui , Chen-Lin Zhang , Fangzhou Mu , Chen Zhao , Bernard Ghanem

Interpretation and understanding of video presents a challenging computer vision task in numerous fields - e.g. autonomous driving and sports analytics. Existing approaches to interpreting the actions taking place within a video clip are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Salman Khan , Izzeddin Teeti , Andrew Bradley , Mohamed Elhoseiny , Fabio Cuzzolin

Temporal action detection (TAD) aims to locate action positions and recognize action categories in long-term untrimmed videos. Although many methods have achieved promising results, their robustness has not been thoroughly studied. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Runhao Zeng , Xiaoyong Chen , Jiaming Liang , Huisi Wu , Guangzhong Cao , Yong Guo

Temporal action detection (TAD) is extensively studied in the video understanding community by generally following the object detection pipeline in images. However, complex designs are not uncommon in TAD, such as two-stream feature…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Min Yang , Guo Chen , Yin-Dong Zheng , Tong Lu , Limin Wang

Temporal action detection is a fundamental yet challenging task in video understanding. Video context is a critical cue to effectively detect actions, but current works mainly focus on temporal context, while neglecting semantic context as…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Mengmeng Xu , Chen Zhao , David S. Rojas , Ali Thabet , Bernard Ghanem

Temporal action detection aims to locate the boundaries of action in the video. The current method based on boundary matching enumerates and calculates all possible boundary matchings to generate proposals. However, these methods neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Guo Chen , Yin-Dong Zheng , Limin Wang , Tong Lu

Training temporal action detection in videos requires large amounts of labeled data, yet such annotation is expensive to collect. Incorporating unlabeled or weakly-labeled data to train action detection model could help reduce annotation…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Baifeng Shi , Qi Dai , Judy Hoffman , Kate Saenko , Trevor Darrell , Huijuan Xu

This technical report presents our first place winning solution for temporal action detection task in CVPR-2022 AcitivityNet Challenge. The task aims to localize temporal boundaries of action instances with specific classes in long…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Xiang Wang , Huaxin Zhang , Shiwei Zhang , Changxin Gao , Yuanjie Shao , Nong Sang

Traffic anomaly detection (TAD) in driving videos is critical for ensuring the safety of autonomous driving and advanced driver assistance systems. Previous single-stage TAD methods primarily rely on frame prediction, making them vulnerable…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Rongqin Liang , Yuanman Li , Jiantao Zhou , Xia Li

Current state-of-the-art approaches for spatio-temporal action detection have achieved impressive results but remain unsatisfactory for temporal extent detection. The main reason comes from that, there are some ambiguous states similar to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Lin Song , Shiwei Zhang , Gang Yu , Hongbin Sun

Detecting actions in untrimmed videos is an important yet challenging task. In this paper, we present the structured segment network (SSN), a novel framework which models the temporal structure of each action instance via a structured…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Yue Zhao , Yuanjun Xiong , Limin Wang , Zhirong Wu , Xiaoou Tang , Dahua Lin