English
Related papers

Related papers: Weakly Supervised Temporal Action Localization Usi…

200 papers

We present an approach for weakly supervised learning of human actions. Given a set of videos and an ordered list of the occurring actions, the goal is to infer start and end frames of the related action classes within the video and to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Alexander Richard , Hilde Kuehne , Juergen Gall

Detecting actions in untrimmed videos is an important yet challenging task. In this paper, we present the structured segment network (SSN), a novel framework which models the temporal structure of each action instance via a structured…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Yue Zhao , Yuanjun Xiong , Limin Wang , Zhirong Wu , Xiaoou Tang , Dahua Lin

Weakly supervised temporal action localization (WSTAL) aims to localize actions in untrimmed videos using video-level labels. Despite recent advances, existing approaches mainly follow a localization-by-classification pipeline, generally…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Songchun Zhang , Chunhui Zhao

Weakly-supervised temporal action localization aims to localize action instances in untrimmed videos with only video-level supervision. We witness that different actions record common phases, e.g., the run-up in the HighJump and LongJump.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Yifu Liu , Xiaoxia Li , Zhiling Luo , Wei Zhou

Weakly supervised action localization is a challenging task with extensive applications, which aims to identify actions and the corresponding temporal intervals with only video-level annotations available. This paper analyzes the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xiao-Yu Zhang , Haichao Shi , Changsheng Li , Xinchu Shi

Weakly supervised temporal action localization, which aims at temporally locating action instances in untrimmed videos using only video-level class labels during training, is an important yet challenging problem in video analysis. Many…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Haisheng Su , Xu Zhao , Tianwei Lin

Action understanding has evolved into the era of fine granularity, as most human behaviors in real life have only minor differences. To detect these fine-grained actions accurately in a label-efficient way, we tackle the problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhi Li , Lu He , Huijuan Xu

Temporal action segmentation in untrimmed procedural videos aims to densely label frames into action classes. These videos inherently exhibit long-tailed distributions, where actions vary widely in frequency and duration. In temporal action…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Zhanzhong Pang , Fadime Sener , Shrinivas Ramasubramanian , Angela Yao

Using offline training schemes, researchers have tackled the event segmentation problem by providing full or weak-supervision through manually annotated labels or self-supervised epoch-based training. Most works consider videos that are at…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Ramy Mounir , Roman Gula , Jörn Theuerkauf , Sudeep Sarkar

In this work, we address the task of weakly-supervised human action segmentation in long, untrimmed videos. Recent methods have relied on expensive learning models, such as Recurrent Neural Networks (RNN) and Hidden Markov Models (HMM).…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Li Ding , Chenliang Xu

Current state-of-the-art human action recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. In this work we address the problem of action localisation and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

We are given a set of video clips, each one annotated with an {\em ordered} list of actions, such as "walk" then "sit" then "answer phone" extracted from, for example, the associated text script. We seek to temporally localize the…

Computer Vision and Pattern Recognition · Computer Science 2014-07-07 Piotr Bojanowski , Rémi Lajugie , Francis Bach , Ivan Laptev , Jean Ponce , Cordelia Schmid , Josef Sivic

Weakly-supervised Temporal Action Localization (WSTAL) aims to localize actions in untrimmed videos using only video-level supervision. Latest WSTAL methods introduce pseudo label learning framework to bridge the gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Qianhan Feng , Wenshuo Li , Tong Lin , Xinghao Chen

The goal of this paper is to determine the spatio-temporal location of actions in video. Where training from hard to obtain box annotations is the norm, we propose an intuitive and effective algorithm that localizes actions from their class…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pascal Mettes , Cees G. M. Snoek , Shih-Fu Chang

Real-world videos contain many complex actions with inherent relationships between action classes. In this work, we propose an attention-based architecture that models these action relationships for the task of temporal action localization…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Praveen Tirupattur , Kevin Duarte , Yogesh Rawat , Mubarak Shah

Existing approaches for spatio-temporal action detection in videos are limited by the spatial extent and temporal duration of the actions. In this paper, we present a modular system for spatio-temporal action detection in untrimmed security…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Joshua Gleason , Rajeev Ranjan , Steven Schwarcz , Carlos D. Castillo , Jun-Chen Cheng , Rama Chellappa

Temporal Action Detection (TAD) is an essential and challenging topic in video understanding, aiming to localize the temporal segments containing human action instances and predict the action categories. The previous works greatly rely upon…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jiannan Wu , Peize Sun , Shoufa Chen , Jiewen Yang , Zihao Qi , Lan Ma , Ping Luo

This paper tackles the challenge of point-supervised temporal action detection, wherein only a single frame is annotated for each action instance in the training set. Most of the current methods, hindered by the sparse nature of annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Elahe Vahdani , Yingli Tian

Temporal action segmentation in untrimmed videos has gained increased attention recently. However, annotating action classes and frame-wise boundaries is extremely time consuming and cost intensive, especially on large-scale datasets. To…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Wei Lin , Anna Kukleva , Horst Possegger , Hilde Kuehne , Horst Bischof

Developing end-to-end action recognition models on long videos is fundamental and crucial for long-video action understanding. Due to the unaffordable cost of end-to-end training on the whole long videos, existing works generally train…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jiaming Zhou , Hanjun Li , Kun-Yu Lin , Junwei Liang