English
Related papers

Related papers: MGCA-Net: Multi-Grained Category-Aware Network for…

200 papers

Temporal Action Localization (TAL) aims to identify actions' start, end, and class labels in untrimmed videos. While recent advancements using transformer networks and Feature Pyramid Networks (FPN) have enhanced visual feature recognition…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Edward Fish , Jon Weinbren , Andrew Gilbert

Recently, temporal action localization (TAL), i.e., finding specific action segments in untrimmed videos, has attracted increasing attentions of the computer vision community. State-of-the-art solutions for TAL involves evaluating the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Peisen Zhao , Lingxi Xie , Chen Ju , Ya Zhang , Yanfeng Wang , Qi Tian

Weakly-Supervised Temporal Action Localization (WSTAL) aims to localize actions in untrimmed videos with only video-level labels. Currently, most state-of-the-art WSTAL methods follow a Multi-Instance Learning (MIL) pipeline: producing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Meng Cao , Can Zhang , Long Chen , Mike Zheng Shou , Yuexian Zou

Existing temporal action localization (TAL) works rely on a large number of training videos with exhaustive segment-level annotation, preventing them from scaling to new classes. As a solution to this problem, few-shot TAL (FS-TAL) aims to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sauradip Nag , Xiatian Zhu , Tao Xiang

Temporal Action Localization (TAL) has experienced remarkable success under the supervised learning paradigm. However, existing TAL methods are rooted in the closed set assumption, which cannot handle the inevitable unknown actions in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Wentao Bao , Qi Yu , Yu Kong

As of today, state-of-the-art activity recognition from wearable sensors relies on algorithms being trained to classify fixed windows of data. In contrast, video-based Human Activity Recognition, known as Temporal Action Localization (TAL),…

Machine Learning · Computer Science 2024-10-15 Marius Bock , Michael Moeller , Kristof Van Laerhoven

Temporal action localization (TAL) involves dual tasks to classify and localize actions within untrimmed videos. However, the two tasks often have conflicting requirements for features. Existing methods typically employ separate heads for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Qiang Li , Di Liu , Jun Kong , Sen Li , Hui Xu , Jianzhong Wang

This paper focuses on tackling the problem of temporal language localization in videos, which aims to identify the start and end points of a moment described by a natural language sentence in an untrimmed video. However, it is non-trivial…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Zongmeng Zhang , Xianjing Han , Xuemeng Song , Yan Yan , Liqiang Nie

Temporal action localization (TAL) requires recognizing the target event and localizing its start and end times precisely in untrimmed videos. Recent vision-language formulations improve semantic reasoning and support language-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Fengshun Wang , Zhengbo Zhang , Zhigang Tu

Temporal Action Localization (TAL) involves localizing and classifying action snippets in an untrimmed video. The emergence of large video foundation models has led RGB-only video backbones to outperform previous methods needing both RGB…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Akshita Gupta , Gaurav Mittal , Ahmed Magooda , Ye Yu , Graham W. Taylor , Mei Chen

In recent years, few-shot action recognition has achieved remarkable performance through spatio-temporal relation modeling. Although a wide range of spatial and temporal alignment modules have been proposed, they primarily address spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Hanyu Guo , Wanchuan Yu , Suzhou Que , Kaiwen Du , Yan Yan , Hanzi Wang

Weakly supervised temporal action localization (WS-TAL) is a challenging task that aims to localize action instances in the given video with video-level categorical supervision. Both appearance and motion features are used in previous…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Fa-Ting Hong , Jia-Chang Feng , Dan Xu , Ying Shan , Wei-Shi Zheng

Action detection is an essential and challenging task, especially for densely labelled datasets of untrimmed videos. The temporal relation is complex in those datasets, including challenges like composite action, and co-occurring action.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Rui Dai , Srijan Das , Kumara Kahatapitiya , Michael S. Ryoo , Francois Bremond

Temporal action localization has long been researched in computer vision. Existing state-of-the-art action localization methods divide each video into multiple action units (i.e., proposals in two-stage methods and segments in one-stage…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Runhao Zeng , Wenbing Huang , Mingkui Tan , Yu Rong , Peilin Zhao , Junzhou Huang , Chuang Gan

Temporal action localization (TAL) is a fundamental yet challenging task in video understanding. Existing TAL methods rely on pre-training a video encoder through action classification supervision. This results in a task discrepancy problem…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Mengmeng Xu , Juan-Manuel Perez-Rua , Xiatian Zhu , Bernard Ghanem , Brais Martinez

Weakly-supervised temporal action localization (WS-TAL) aims to localize actions in untrimmed videos with only video-level labels. Most existing models follow the "localization by classification" procedure: locate temporal regions…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Can Zhang , Meng Cao , Dongming Yang , Jie Chen , Yuexian Zou

Weakly Supervised Temporal Action Localization (WTAL) aims to classify and localize temporal boundaries of actions for the video, given only video-level category labels in the training datasets. Due to the lack of boundary information…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Guozhang Li , De Cheng , Xinpeng Ding , Nannan Wang , Jie Li , Xinbo Gao

The vocabulary size in temporal action localization (TAL) is limited by the scarcity of large-scale annotated datasets. To overcome this, recent works integrate vision-language models (VLMs), such as CLIP, for open-vocabulary TAL (OV-TAL).…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jeongseok Hyun , Su Ho Han , Hyolim Kang , Joon-Young Lee , Seon Joo Kim

Weakly supervised temporal action localization (WTAL) aims to localize actions in untrimmed videos with only weak supervision information (e.g. video-level labels). Most existing models handle all input videos with a fixed temporal scale.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Weiqi Sun , Rui Su , Qian Yu , Dong Xu

Weakly Supervised Temporal Action Localization (WSTAL) aims to localize and classify action instances in long untrimmed videos with only video-level category labels. Due to the lack of snippet-level supervision for indicating action…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Jia-Run Du , Jia-Chang Feng , Kun-Yu Lin , Fa-Ting Hong , Xiao-Ming Wu , Zhongang Qi , Ying Shan , Wei-Shi Zheng