English
Related papers

Related papers: Guess Where? Actor-Supervision for Spatiotemporal …

200 papers

We propose an effective approach for spatio-temporal action localization in realistic videos. The approach first detects proposals at the frame-level and scores them with a combination of static and motion CNN features. It then tracks…

Computer Vision and Pattern Recognition · Computer Science 2015-09-29 Philippe Weinzaepfel , Zaid Harchaoui , Cordelia Schmid

State-of-the-art temporal action detectors inefficiently search the entire video for specific actions. Despite the encouraging progress these methods achieve, it is crucial to design automated approaches that only explore parts of the video…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Humam Alwassel , Fabian Caba Heilbron , Bernard Ghanem

While observing complex events with multiple actors, humans do not assess each actor separately, but infer from the context. The surrounding context provides essential information for understanding actions. To this end, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Oytun Ulutan , Swati Rallapalli , Mudhakar Srivatsa , Carlos Torres , B. S. Manjunath

Research in action detection has grown in the recentyears, as it plays a key role in video understanding. Modelling the interactions (either spatial or temporal) between actors and their context has proven to be essential for this task.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Manuel Sarmiento Calderó , David Varas , Elisenda Bou-Balust

Action recognition has become a rapidly developing research field within the last decade. But with the increasing demand for large scale data, the need of hand annotated data for the training becomes more and more impractical. One way to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Hilde Kuehne , Alexander Richard , Juergen Gall

Temporal action segmentation is a topic of increasing interest, however, annotating each frame in a video is cumbersome and costly. Weakly supervised approaches therefore aim at learning temporal action segmentation from videos that are…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Mohsen Fayyaz , Juergen Gall

Current state-of-the-art human action recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. In this work we address the problem of action localisation and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

We describe a latent approach that learns to detect actions in long sequences given training videos with only whole-video class labels. Our approach makes use of two innovations to attention-modeling in weakly-supervised learning. First,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Phuc Xuan Nguyen , Deva Ramanan , Charless C. Fowlkes

Detecting and recognizing human action in videos with crowded scenes is a challenging problem due to the complex environment and diversity events. Prior works always fail to deal with this problem in two aspects: (1) lacking utilizing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Li Yuan , Yichen Zhou , Shuning Chang , Ziyuan Huang , Yunpeng Chen , Xuecheng Nie , Tao Wang , Jiashi Feng , Shuicheng Yan

Action detection and temporal segmentation of actions in videos are topics of increasing interest. While fully supervised systems have gained much attention lately, full annotation of each action within the video is costly and impractical…

Computer Vision and Pattern Recognition · Computer Science 2018-05-18 Alexander Richard , Hilde Kuehne , Juergen Gall

We address the problem of video representation learning without human-annotated labels. While previous efforts address the problem by designing novel self-supervised tasks using video data, the learned features are merely on a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Yunhui Liu , Wei Liu

This paper proposes a novel pretext task to address the self-supervised video representation learning problem. Specifically, given an unlabeled video clip, we compute a series of spatio-temporal statistical summaries, such as the spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Wei Liu , Yun-hui Liu

This work strives for the classification and localization of human actions in videos, without the need for any labeled video training examples. Where existing work relies on transferring global attribute or object information from seen to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Pascal Mettes , William Thong , Cees G. M. Snoek

Since collecting and annotating data for spatio-temporal action detection is very expensive, there is a need to learn approaches with less supervision. Weakly supervised approaches do not require any bounding box annotations and can be…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Sovan Biswas , Juergen Gall

Weakly supervised temporal action localization aims at learning the instance-level action pattern from the video-level labels, where a significant challenge is action-context confusion. To overcome this challenge, one recent work builds an…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Le Yang , Junwei Han , Tao Zhao , Tianwei Lin , Dingwen Zhang , Jianxin Chen

Point-supervised Temporal Action Localization (PTAL) adopts a lightly frame-annotated paradigm (\textit{i.e.}, labeling only a single frame per action instance) to train a model to effectively locate action instances within untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yunchuan Ma , Laiyun Qing , Guorong Li , Yuqing Liu , Yuankai Qi , Qingming Huang

Localizing actions in video is a core task in computer vision. The weakly supervised temporal localization problem investigates whether this task can be adequately solved with only video-level labels, significantly reducing the amount of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Junwei Ma , Satya Krishna Gorti , Maksims Volkovs , Guangwei Yu

This paper presents a simple yet effective approach for the poorly investigated task of global action segmentation, aiming at grouping frames capturing the same action across videos of different activities. Unlike the case of videos…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Elena Bueno-Benito , Mariella Dimiccoli

In this work, we focus on semi-supervised learning for video action detection which utilizes both labeled as well as unlabeled data. We propose a simple end-to-end consistency based approach which effectively utilizes the unlabeled data.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Akash Kumar , Yogesh Singh Rawat

We propose TubeR: a simple solution for spatio-temporal video action detection. Different from existing methods that depend on either an off-line actor detector or hand-designed actor-positional hypotheses like proposals or anchors, we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Jiaojiao Zhao , Yanyi Zhang , Xinyu Li , Hao Chen , Shuai Bing , Mingze Xu , Chunhui Liu , Kaustav Kundu , Yuanjun Xiong , Davide Modolo , Ivan Marsic , Cees G. M. Snoek , Joseph Tighe