English
Related papers

Related papers: Online Temporal Action Localization with Memory-Au…

200 papers

Temporal action localization (TAL), which involves recognizing and locating action instances, is a challenging task in video understanding. Most existing approaches directly predict action classes and regress offsets to boundaries, while…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Jiayi Shao , Xiaohan Wang , Ruijie Quan , Junjun Zheng , Jiang Yang , Yi Yang

We introduce Activity Graph Transformer, an end-to-end learnable model for temporal action localization, that receives a video as input and directly predicts a set of action instances that appear in the video. Detecting and localizing…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Megha Nawhal , Greg Mori

Temporal Action Localization (TAL) is a challenging task in video understanding that aims to identify and localize actions within a video sequence. Recent studies have emphasized the importance of applying long-term temporal context…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Tuan N. Tang , Kwonyoung Kim , Kwanghoon Sohn

Temporal Action Detection(TAD) is a crucial but challenging task in video understanding.It is aimed at detecting both the type and start-end frame for each action instance in a long, untrimmed video.Most current models adopt both RGB and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Bowen Deng , Dongchang Liu

Most modern approaches in temporal action localization divide this problem into two parts: (i) short-term feature extraction and (ii) long-range temporal boundary localization. Due to the high GPU memory cost caused by processing long…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Feng Cheng , Gedas Bertasius

We present Long Short-term TRansformer (LSTR), a temporal modeling algorithm for online action detection, which employs a long- and short-term memory mechanism to model prolonged sequence data. It consists of an LSTR encoder that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Mingze Xu , Yuanjun Xiong , Hao Chen , Xinyu Li , Wei Xia , Zhuowen Tu , Stefano Soatto

Real-time and online action localization in a video is a critical yet highly challenging problem. Accurate action localization requires the utilization of both temporal and spatial information. Recent attempts achieve this by using…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Kalana Abeywardena , Shechem Sumanthiran , Sakuna Jayasundara , Sachira Karunasena , Ranga Rodrigo , Peshala Jayasekara

We address the problem of temporal action localization in videos. We pose action localization as a structured prediction over arbitrary-length temporal windows, where each window is scored as the sum of frame-wise classification scores.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Zehuan Yuan , Jonathan C. Stroud , Tong Lu , Jia Deng

Temporal Action Localization (TAL) involves localizing and classifying action snippets in an untrimmed video. The emergence of large video foundation models has led RGB-only video backbones to outperform previous methods needing both RGB…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Akshita Gupta , Gaurav Mittal , Ahmed Magooda , Ye Yu , Graham W. Taylor , Mei Chen

State-of-the-art temporal action detectors inefficiently search the entire video for specific actions. Despite the encouraging progress these methods achieve, it is crucial to design automated approaches that only explore parts of the video…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Humam Alwassel , Fabian Caba Heilbron , Bernard Ghanem

Temporal action detection aims at not only recognizing action category but also detecting start time and end time for each action instance in an untrimmed video. The key challenge of this task is to accurately classify the action and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Wen Wang , Yongjian Wu , Haijun Liu , Shiguang Wang , Jian Cheng

Open-Vocabulary Temporal Action Localization (OVTAL) enables a model to recognize any desired action category in videos without the need to explicitly curate training data for all categories. However, this flexibility poses significant…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Akshita Gupta , Aditya Arora , Sanath Narayan , Salman Khan , Fahad Shahbaz Khan , Graham W. Taylor

Temporal Action Localization (TAL) remains a fundamental challenge in video understanding, aiming to identify the start time, end time, and category of all action instances within untrimmed videos. While recent single-stage, anchor-free…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Thisara Rathnayaka , Uthayasanker Thayasivam

Effectively tackling the problem of temporal action localization (TAL) necessitates a visual representation that jointly pursues two confounding goals, i.e., fine-grained discrimination for temporal localization and sufficient visual…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Zixin Zhu , Wei Tang , Le Wang , Nanning Zheng , Gang Hua

Temporal action localization is a recently-emerging task, aiming to localize video segments from untrimmed videos that contain specific actions. Despite the remarkable recent progress, most two-stage action localization methods still suffer…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Guoqiang Gong , Liangfeng Zheng , Kun Bai , Yadong Mu

Few-shot temporal action localization (TAL) methods that adapt large models via single-prompt tuning often fail to produce precise temporal boundaries. This stems from the model learning a non-discriminative mean representation of an action…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Edward Fish , Andrew Gilbert

The present few-shot temporal action localization model can't handle the situation where videos contain multiple action instances. So the purpose of this paper is to achieve manifold action instances localization in a lengthy untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Fengshun Wang , Qiurui Wang , Yuting Wang

Temporal action localization has recently attracted significant interest in the Computer Vision community. However, despite the great progress, it is hard to identify which aspects of the proposed methods contribute most to the increase in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Tingting Xie , Xiaoshan Yang , Tianzhu Zhang , Changsheng Xu , Ioannis Patras

Temporal Action Localization (TAL) aims to identify actions' start, end, and class labels in untrimmed videos. While recent advancements using transformer networks and Feature Pyramid Networks (FPN) have enhanced visual feature recognition…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Edward Fish , Jon Weinbren , Andrew Gilbert

Temporal Action Localization (TAL) in untrimmed video is important for many applications. But it is very expensive to annotate the segment-level ground truth (action class and temporal boundary). This raises the interest of addressing TAL…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Zheng Shou , Hang Gao , Lei Zhang , Kazuyuki Miyazawa , Shih-Fu Chang