English
Related papers

Related papers: Weakly Supervised Temporal Action Localization Usi…

200 papers

This paper studies the joint learning of action recognition and temporal localization in long, untrimmed videos. We employ a multi-task learning framework that performs the three highly related steps of action proposal, action recognition,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Yi Zhu , Shawn Newsam

Online temporal action localization from an untrimmed video stream is a challenging problem in computer vision. It is challenging because of i) in an untrimmed video stream, more than one action instance may appear, including background…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Da-Hye Yoon , Nam-Gyu Cho , Seong-Whan Lee

Current action recognition methods heavily rely on trimmed videos for model training. However, it is expensive and time-consuming to acquire a large-scale trimmed video dataset. This paper presents a new weakly supervised architecture,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Limin Wang , Yuanjun Xiong , Dahua Lin , Luc Van Gool

Weakly-Supervised Temporal Action Localization (WS-TAL) task aims to recognize and localize temporal starts and ends of action instances in an untrimmed video with only video-level label supervision. Due to lack of negative samples of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Xiang Wang , Zhiwu Qing , Ziyuan Huang , Yutong Feng , Shiwei Zhang , Jianwen Jiang , Mingqian Tang , Yuanjie Shao , Nong Sang

Temporal action segmentation approaches have been very successful recently. However, annotating videos with frame-wise labels to train such models is very expensive and time consuming. While weakly supervised methods trained using only…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Zhe Li , Yazan Abu Farha , Juergen Gall

Weakly-supervised temporal action localization aims to localize action instances in videos with only video-level action labels. Existing methods mainly embrace a localization-by-classification pipeline that optimizes the snippet-level…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Qinying Liu , Zilei Wang , Shenghai Rong , Junjie Li , Yixin Zhang

Weakly-Supervised Temporal Action Localization (WSTAL) aims to localize actions in untrimmed videos with only video-level labels. Currently, most state-of-the-art WSTAL methods follow a Multi-Instance Learning (MIL) pipeline: producing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Meng Cao , Can Zhang , Long Chen , Mike Zheng Shou , Yuexian Zou

Online action detection in untrimmed videos aims to identify an action as it happens, which makes it very important for real-time applications. Previous methods rely on tedious annotations of temporal action boundaries for training, which…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Mingfei Gao , Yingbo Zhou , Ran Xu , Richard Socher , Caiming Xiong

Weakly-supervised temporal action localization aims to localize and recognize actions in untrimmed videos with only video-level category labels during training. Without instance-level annotations, most existing methods follow the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Huan Ren , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

Weakly-supervised action localization requires training a model to localize the action segments in the video given only video level action label. It can be solved under the Multiple Instance Learning (MIL) framework, where a bag (video)…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Zhekun Luo , Devin Guillory , Baifeng Shi , Wei Ke , Fang Wan , Trevor Darrell , Huijuan Xu

The goal of this work is spatio-temporal action localization in videos, using only the supervision from video-level class labels. The state-of-the-art casts this weakly-supervised action localization regime as a Multiple Instance Learning…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Pascal Mettes , Cees G. M. Snoek

In this paper, we consider the problem of temporal action localization under low-shot (zero-shot & few-shot) scenario, with the goal of detecting and classifying the action instances from arbitrary categories within some untrimmed videos,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Chen Ju , Zeqian Li , Peisen Zhao , Ya Zhang , Xiaopeng Zhang , Qi Tian , Yanfeng Wang , Weidi Xie

Action detection and temporal segmentation of actions in videos are topics of increasing interest. While fully supervised systems have gained much attention lately, full annotation of each action within the video is costly and impractical…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Alexander Richard , Hilde Kuehne , Juergen Gall

Many interesting events in the real world are rare making preannotated machine learning ready videos a rarity in consequence. Thus, temporal activity detection models that are able to learn from a few examples are desirable. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Huijuan Xu , Ximeng Sun , Eric Tzeng , Abir Das , Kate Saenko , Trevor Darrell

Temporal action localization aims at localizing action instances from untrimmed videos. Existing works have designed various effective modules to precisely localize action instances based on appearance and motion features. However, by…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Le Yang , Junwei Han , Tao Zhao , Nian Liu , Dingwen Zhang

Weakly supervised temporal action localization is a challenging task as only the video-level annotation is available during the training process. To address this problem, we propose a two-stage approach to fully exploit multi-resolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Rui Su , Dong Xu , Luping Zhou , Wanli Ouyang

Despite the recent advances in video classification, progress in spatio-temporal action recognition has lagged behind. A major contributing factor has been the prohibitive cost of annotating videos frame-by-frame. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Anurag Arnab , Chen Sun , Arsha Nagrani , Cordelia Schmid

Temporal action localization is an important yet challenging research topic due to its various applications. Since the frame-level or segment-level annotations of untrimmed videos require amounts of labor expenditure, studies on the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Chengwei Zhang , Yunlu Xu , Zhanzhan Cheng , Yi Niu , Shiliang Pu , Fei Wu , Futai Zou

Weakly supervised temporal action localization aims at learning the instance-level action pattern from the video-level labels, where a significant challenge is action-context confusion. To overcome this challenge, one recent work builds an…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Le Yang , Junwei Han , Tao Zhao , Tianwei Lin , Dingwen Zhang , Jianxin Chen

This technical report presents an overview of our solution used in the submission to 2021 HACS Temporal Action Localization Challenge on both Supervised Learning Track and Weakly-Supervised Learning Track. Temporal Action Localization (TAL)…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Haisheng Su , Peiqin Zhuang , Yukun Li , Dongliang Wang , Weihao Gan , Wei Wu , Yu Qiao