English
Related papers

Related papers: Post-Processing Temporal Action Detection

200 papers

Temporal action proposal generation is an important task, akin to object proposals, temporal action proposals are intended to capture "clips" or temporal intervals in videos that are likely to contain an action. Previous methods can be…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Jiyang Gao , Kan Chen , Ram Nevatia

Recent works reveal that adversarial augmentation benefits the generalization of neural networks (NNs) if used in an appropriate manner. In this paper, we introduce Temporal Adversarial Augmentation (TA), a novel video augmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Jinhao Duan , Quanfu Fan , Hao Cheng , Xiaoshuang Shi , Kaidi Xu

Temporal action detection (TAD) with end-to-end training often suffers from the pain of huge demand for computing resources due to long video duration. In this work, we propose an efficient temporal action detector (ETAD) that can train…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Shuming Liu , Mengmeng Xu , Chen Zhao , Xu Zhao , Bernard Ghanem

The goal of Temporal Action Localization (TAL) is to find the categories and temporal boundaries of actions in an untrimmed video. Most TAL methods rely heavily on action recognition models that are sensitive to action labels rather than…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Hao Zhang , Chunyan Feng , Jiahui Yang , Zheng Li , Caili Guo

Traditional temporal action detection (TAD) usually handles untrimmed videos with small number of action instances from a single label (e.g., ActivityNet, THUMOS). However, this setting might be unrealistic as different classes of actions…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Jing Tan , Xiaotong Zhao , Xintian Shi , Bin Kang , Limin Wang

Temporal action detection (TAD) aims to locate and recognize the actions in an untrimmed video. Anchor-free methods have made remarkable progress which mainly formulate TAD into two tasks: classification and localization using two separate…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Junshan Hu , Chaoxu guo , Liansheng Zhuang , Biao Wang , Tiezheng Ge , Yuning Jiang , Houqiang Li

Temporal Action Localization (TAL) task which is to predict the start and end of each action in a video along with the class label of the action has numerous applications in the real world. But due to the complexity of this task, acceptable…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Hassan Keshvarikhojasteh , Hoda Mohammadzade , Hamid Behroozi

In recent years, proposed studies on time-series anomaly detection (TAD) report high F1 scores on benchmark TAD datasets, giving the impression of clear improvements in TAD. However, most studies apply a peculiar evaluation protocol called…

Machine Learning · Computer Science 2022-01-05 Siwon Kim , Kukjin Choi , Hyun-Soo Choi , Byunghan Lee , Sungroh Yoon

Temporal action detection (TAD) is challenging, yet fundamental for real-world video applications. Recently, DETR-based models for TAD have been prevailing thanks to their unique benefits. However, transformers demand a huge dataset, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jihwan Kim , Miso Lee , Jae-Pil Heo

Current methods for action recognition primarily rely on deep convolutional networks to derive feature embeddings of visual and motion features. While these methods have demonstrated remarkable performance on standard benchmarks, we are…

Computer Vision and Pattern Recognition · Computer Science 2020-05-21 Dian Shao , Yue Zhao , Bo Dai , Dahua Lin

Temporal Action Proposal (TAP) generation is an important problem, as fast and accurate extraction of semantically important (e.g. human actions) segments from untrimmed videos is an important step for large-scale video analysis. We propose…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Jiyang Gao , Zhenheng Yang , Chen Sun , Kan Chen , Ram Nevatia

In this paper, we propose Spatio-TEmporal Progressive (STEP) action detector---a progressive learning framework for spatio-temporal action detection in videos. Starting from a handful of coarse-scale proposal cuboids, our approach…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Xitong Yang , Xiaodong Yang , Ming-Yu Liu , Fanyi Xiao , Larry Davis , Jan Kautz

Recently, temporal action detection (TAD) has seen significant performance improvement with end-to-end training. However, due to the memory bottleneck, only models with limited scales and limited data volumes can afford end-to-end training,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Shuming Liu , Chen-Lin Zhang , Chen Zhao , Bernard Ghanem

In this paper, we investigate that the normalized coordinate expression is a key factor as reliance on hand-crafted components in query-based detectors for temporal action detection (TAD). Despite significant advancements towards an…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Ho-Joong Kim , Jung-Ho Hong , Heejo Kong , Seong-Whan Lee

Open-Vocabulary Temporal Action Detection (OV-TAD) aims to classify and localize action segments in untrimmed videos for unseen categories. Previous methods rely solely on global alignment between label-level semantics and visual features,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Sa Zhu , Wanqian Zhang , Lin Wang , Xiaohua Chen , Chenxu Cui , Jinchao Zhang , Bo Li

Temporal action localization (TAL) aims to detect the boundary and identify the class of each action instance in a long untrimmed video. Current approaches treat video frames homogeneously, and tend to give background and key objects…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Yifan Liu , Youbao Tang , Ning Zhang , Ruei-Sung Lin , Haoqian Wang

Temporal Action Detection (TAD) aims to identify and localize actions by determining their starting and ending frames within untrimmed videos. Recent Structured State-Space Models such as Mamba have demonstrated potential in TAD due to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hui Lu , Yi Yu , Shijian Lu , Deepu Rajan , Boon Poh Ng , Alex C. Kot , Xudong Jiang

Temporal action detection is a fundamental yet challenging task in video understanding. Video context is a critical cue to effectively detect actions, but current works mainly focus on temporal context, while neglecting semantic context as…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Mengmeng Xu , Chen Zhao , David S. Rojas , Ali Thabet , Bernard Ghanem

Vision Transformer (ViT) has shown high potential in video recognition, owing to its flexible design, adaptable self-attention mechanisms, and the efficacy of masked pre-training. Yet, it remains unclear how to adapt these pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Min Yang , Huan Gao , Ping Guo , Limin Wang

The goal of few-shot video classification is to learn a classification model with good generalization ability when trained with only a few labeled videos. However, it is difficult to learn discriminative feature representations for videos…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Fei Pan , Chunlei Xu , Jie Guo , Yanwen Guo