English
Related papers

Related papers: Faster-TAD: Towards Temporal Action Detection with…

200 papers

Time series anomaly detection (TSAD) plays an important role in many domains such as finance, transportation, and healthcare. With the ongoing instrumentation of reality, more time series data will be available, leading also to growing…

Video action detection (spatio-temporal action localization) is usually the starting point for human-centric intelligent analysis of videos nowadays. It has high practical impacts for many applications across robotics, security, healthcare,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Xin Hu , Zhenyu Wu , Hao-Yu Miao , Siqi Fan , Taiyu Long , Zhenyu Hu , Pengcheng Pi , Yi Wu , Zhou Ren , Zhangyang Wang , Gang Hua

Online action detection in untrimmed videos aims to identify an action as it happens, which makes it very important for real-time applications. Previous methods rely on tedious annotations of temporal action boundaries for training, which…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Mingfei Gao , Yingbo Zhou , Ran Xu , Richard Socher , Caiming Xiong

The temporal action segmentation task segments videos temporally and predicts action labels for all frames. Fully supervising such a segmentation model requires dense frame-wise action annotations, which are expensive and tedious to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Guodong Ding , Angela Yao

Temporal Action Detection (TAD) aims to identify the action boundaries and the corresponding category within untrimmed videos. Inspired by the success of DETR in object detection, several methods have adapted the query-based framework to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yuhan Zhu , Guozhen Zhang , Jing Tan , Gangshan Wu , Limin Wang

In this paper, we investigate that the normalized coordinate expression is a key factor as reliance on hand-crafted components in query-based detectors for temporal action detection (TAD). Despite significant advancements towards an…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Ho-Joong Kim , Jung-Ho Hong , Heejo Kong , Seong-Whan Lee

Temporal action proposal generation is an important and challenging task in video understanding, which aims at detecting all temporal segments containing action instances of interest. The existing proposal generation approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Jing Tan , Jiaqi Tang , Limin Wang , Gangshan Wu

Temporal action proposal generation (TAPG) aims to estimate temporal intervals of actions in untrimmed videos, which is a challenging yet plays an important role in many tasks of video analysis and understanding. Despite the great…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Khoa Vo , Kashu Yamazaki , Sang Truong , Minh-Triet Tran , Akihiro Sugimoto , Ngan Le

Temporal Action Detection (TAD) aims to identify and localize actions by determining their starting and ending frames within untrimmed videos. Recent Structured State-Space Models such as Mamba have demonstrated potential in TAD due to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hui Lu , Yi Yu , Shijian Lu , Deepu Rajan , Boon Poh Ng , Alex C. Kot , Xudong Jiang

Temporal action detection (TAD), which locates and recognizes action segments, remains a challenging task in video understanding due to variable segment lengths and ambiguous boundaries. Existing methods treat neighboring contexts of an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ning Wang , Yun Xiao , Xiaopeng Peng , Xiaojun Chang , Xuanhong Wang , Dingyi Fang

This work aims at advancing temporal action detection (TAD) using an encoder-decoder framework with action queries, similar to DETR, which has shown great success in object detection. However, the framework suffers from several problems if…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Dingfeng Shi , Yujie Zhong , Qiong Cao , Jing Zhang , Lin Ma , Jia Li , Dacheng Tao

Point-level supervised temporal action localization (PTAL) aims at recognizing and localizing actions in untrimmed videos where only a single point (frame) within every action instance is annotated in training data. Without temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Yuan Yin , Yifei Huang , Ryosuke Furuta , Yoichi Sato

Spatio-temporal action detection (STAD) aims to classify the actions present in a video and localize them in space and time. It has become a particularly active area of research in computer vision because of its explosively emerging…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Peng Wang , Fanwei Zeng , Yuntao Qian

This paper addresses the problem of Target Activity Detection (TAD) for binaural listening devices. TAD denotes the problem of robustly detecting the activity of a target speaker in a harsh acoustic environment, which comprises interfering…

Sound · Computer Science 2016-12-21 Daniel Gerber , Stefan Meier , Walter Kellermann

Recently, temporal action detection (TAD) has seen significant performance improvement with end-to-end training. However, due to the memory bottleneck, only models with limited scales and limited data volumes can afford end-to-end training,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Shuming Liu , Chen-Lin Zhang , Chen Zhao , Bernard Ghanem

One-stage object detection is commonly implemented by optimizing two sub-tasks: object classification and localization, using heads with two parallel branches, which might lead to a certain level of spatial misalignment in predictions…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Chengjian Feng , Yujie Zhong , Yu Gao , Matthew R. Scott , Weilin Huang

This technical report presents an overview of our solution used in the submission to 2021 HACS Temporal Action Localization Challenge on both Supervised Learning Track and Weakly-Supervised Learning Track. Temporal Action Localization (TAL)…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Haisheng Su , Peiqin Zhuang , Yukun Li , Dongliang Wang , Weihao Gan , Wei Wu , Yu Qiao

Temporal action detection (TAD) is challenging, yet fundamental for real-world video applications. Recently, DETR-based models for TAD have been prevailing thanks to their unique benefits. However, transformers demand a huge dataset, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jihwan Kim , Miso Lee , Jae-Pil Heo

Temporal action localization is a recently-emerging task, aiming to localize video segments from untrimmed videos that contain specific actions. Despite the remarkable recent progress, most two-stage action localization methods still suffer…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Guoqiang Gong , Liangfeng Zheng , Kun Bai , Yadong Mu

Temporal Action Localization (TAL) task which is to predict the start and end of each action in a video along with the class label of the action has numerous applications in the real world. But due to the complexity of this task, acceptable…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Hassan Keshvarikhojasteh , Hoda Mohammadzade , Hamid Behroozi