English
Related papers

Related papers: Test-Time Zero-Shot Temporal Action Localization

200 papers

Weakly Supervised Temporal Action Localization (WTAL) aims to classify and localize temporal boundaries of actions for the video, given only video-level category labels in the training datasets. Due to the lack of boundary information…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Guozhang Li , De Cheng , Xinpeng Ding , Nannan Wang , Jie Li , Xinbo Gao

Temporal Action Localization (TAL) has experienced remarkable success under the supervised learning paradigm. However, existing TAL methods are rooted in the closed set assumption, which cannot handle the inevitable unknown actions in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Wentao Bao , Qi Yu , Yu Kong

As of today, state-of-the-art activity recognition from wearable sensors relies on algorithms being trained to classify fixed windows of data. In contrast, video-based Human Activity Recognition, known as Temporal Action Localization (TAL),…

Machine Learning · Computer Science 2024-10-15 Marius Bock , Michael Moeller , Kristof Van Laerhoven

Temporal action localization (TAL) is a task of identifying a set of actions in a video, which involves localizing the start and end frames and classifying each action instance. Existing methods have addressed this task by using predefined…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Tae-Kyung Kang , Gun-Hee Lee , Seong-Whan Lee

Weakly-Supervised Temporal Action Localization (WSTAL) aims to localize actions in untrimmed videos with only video-level labels. Currently, most state-of-the-art WSTAL methods follow a Multi-Instance Learning (MIL) pipeline: producing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Meng Cao , Can Zhang , Long Chen , Mike Zheng Shou , Yuexian Zou

Weakly-supervised temporal action localization aims to locate action regions and identify action categories in untrimmed videos simultaneously by taking only video-level labels as the supervision. Pseudo label generation is a promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Wulian Yun , Mengshi Qi , Chuanming Wang , Huadong Ma

Temporal action localization (TAL) involves dual tasks to classify and localize actions within untrimmed videos. However, the two tasks often have conflicting requirements for features. Existing methods typically employ separate heads for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Qiang Li , Di Liu , Jun Kong , Sen Li , Hui Xu , Jianzhong Wang

Temporal action localization presents a trade-off between test performance and annotation-time cost. Fully supervised methods achieve good performance with time-consuming boundary annotations. Weakly supervised methods with cheaper…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Xinpeng Ding , Nannan Wang , Xinbo Gao , Jie Li , Xiaoyu Wang , Tongliang Liu

Spatio-temporal action localization is an important problem in computer vision that involves detecting where and when activities occur, and therefore requires modeling of both spatial and temporal features. This problem is typically…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Nakul Agarwal , Yi-Ting Chen , Behzad Dariush , Ming-Hsuan Yang

Imitation learning is effective for training agents when expert demonstrations are available, but collecting demonstrations for every complex task in an environment is costly. We study the long-horizon, goal-conditioned setting where a…

Machine Learning · Computer Science 2026-05-12 Maxwell J. Jacobson , Yexiang Xue

Temporal Action Localization (TAL) is a critical task in video analysis, identifying precise start and end times of actions. Existing methods like CNNs, RNNs, GCNs, and Transformers have limitations in capturing long-range dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sangyoun Lee , Juho Jung , Changdae Oh , Sunghee Yun

Temporal action localization plays an important role in video analysis, which aims to localize and classify actions in untrimmed videos. The previous methods often predict actions on a feature space of a single-temporal scale. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Zan Gao , Xinglei Cui , Tao Zhuo , Zhiyong Cheng , An-An Liu , Meng Wang , Shenyong Chen

Video temporal grounding aims to identify video segments within untrimmed videos that are most relevant to a given natural language query. Existing video temporal localization models rely on specific datasets for training and have high data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Minghang Zheng , Xinhao Cai , Qingchao Chen , Yuxin Peng , Yang Liu

Existing approaches for spatio-temporal action detection in videos are limited by the spatial extent and temporal duration of the actions. In this paper, we present a modular system for spatio-temporal action detection in untrimmed security…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Joshua Gleason , Rajeev Ranjan , Steven Schwarcz , Carlos D. Castillo , Jun-Chen Cheng , Rama Chellappa

Weakly supervised temporal action localization (WSTAL) aims to localize actions in untrimmed videos using video-level labels. Despite recent advances, existing approaches mainly follow a localization-by-classification pipeline, generally…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Songchun Zhang , Chunhui Zhao

Audio-visual generalised zero-shot learning for video classification requires understanding the relations between the audio and visual information in order to be able to recognise samples from novel, previously unseen classes at test time.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Otniel-Bogdan Mercea , Thomas Hummel , A. Sophia Koepke , Zeynep Akata

Weakly supervised temporal action localization is a challenging task as only the video-level annotation is available during the training process. To address this problem, we propose a two-stage approach to fully exploit multi-resolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Rui Su , Dong Xu , Luping Zhou , Wanli Ouyang

Weakly-supervised action localization aims to recognize and localize action instancese in untrimmed videos with only video-level labels. Most existing models rely on multiple instance learning(MIL), where the predictions of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Guiqin Wang , Peng Zhao , Cong Zhao , Shusen Yang , Jie Cheng , Luziwei Leng , Jianxing Liao , Qinghai Guo

Weakly-supervised temporal action localization aims to localize and recognize actions in untrimmed videos with only video-level category labels during training. Without instance-level annotations, most existing methods follow the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Huan Ren , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

Test-Time Optimization enables models to adapt to new data during inference by updating parameters on-the-fly. Recent advances in Vision-Language Models (VLMs) have explored learning prompts at test time to improve performance in downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dhruv Sarkar , Aprameyo Chakrabartty , Bibhudatta Bhanja