English
Related papers

Related papers: Spatio-Temporal Instance Learning: Action Tubes fr…

200 papers

Enabling computational systems with the ability to localize actions in video-based content has manifold applications. Traditionally, such a problem is approached in a fully-supervised setting where video-clips with complete frame-by-frame…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Kurt Degiorgio , Fabio Cuzzolin

This paper strives for spatio-temporal localization of human actions in videos. In the literature, the consensus is to achieve localization by training on bounding box annotations provided for each frame of each training video. As…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Pascal Mettes , Cees G. M. Snoek

The goal of this paper is to determine the spatio-temporal location of actions in video. Where training from hard to obtain box annotations is the norm, we propose an intuitive and effective algorithm that localizes actions from their class…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pascal Mettes , Cees G. M. Snoek , Shih-Fu Chang

We strive for spatio-temporal localization of actions in videos. The state-of-the-art relies on action proposals at test time and selects the best one with a classifier trained on carefully annotated box annotations. Annotating action boxes…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pascal Mettes , Jan C. van Gemert , Cees G. M. Snoek

Current state-of-the-art human action recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. In this work we address the problem of action localisation and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

We propose an effective approach for spatio-temporal action localization in realistic videos. The approach first detects proposals at the frame-level and scores them with a combination of static and motion CNN features. It then tracks…

Computer Vision and Pattern Recognition · Computer Science 2015-09-29 Philippe Weinzaepfel , Zaid Harchaoui , Cordelia Schmid

Spatio-temporal action detection in videos is typically addressed in a fully-supervised setup with manual annotation of training videos required at every frame. Since such annotation is extremely tedious and prohibits scalability, there is…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Guilhem Chéron , Jean-Baptiste Alayrac , Ivan Laptev , Cordelia Schmid

Weakly-supervised temporal action localization aims to locate action regions and identify action categories in untrimmed videos simultaneously by taking only video-level labels as the supervision. Pseudo label generation is a promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Wulian Yun , Mengshi Qi , Chuanming Wang , Huadong Ma

Spatio-temporal grounding describes the task of localizing events in space and time, e.g., in video data, based on verbal descriptions only. Models for this task are usually trained with human-annotated sentences and bounding box…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Brian Chen , Nina Shvetsova , Andrew Rouditchenko , Daniel Kondermann , Samuel Thomas , Shih-Fu Chang , Rogerio Feris , James Glass , Hilde Kuehne

This paper addresses the problem of spatiotemporal localization of actions in videos. Compared to leading approaches, which all learn to localize based on carefully annotated boxes on training video frames, we adhere to a weakly-supervised…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Victor Escorcia , Cuong D. Dao , Mihir Jain , Bernard Ghanem , Cees Snoek

Temporal action segmentation in videos has drawn much attention recently. Timestamp supervision is a cost-effective way for this task. To obtain more information to optimize the model, the existing method generated pseudo frame-wise labels…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Yang Zhao , Yan Song

Temporal action localization is an important step towards video understanding. Most current action localization methods depend on untrimmed videos with full temporal annotations of action instances. However, it is expensive and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Ashraful Islam , Richard J. Radke

Weakly-supervised action localization requires training a model to localize the action segments in the video given only video level action label. It can be solved under the Multiple Instance Learning (MIL) framework, where a bag (video)…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Zhekun Luo , Devin Guillory , Baifeng Shi , Wei Ke , Fang Wan , Trevor Darrell , Huijuan Xu

Weakly-supervised action localization aims to recognize and localize action instancese in untrimmed videos with only video-level labels. Most existing models rely on multiple instance learning(MIL), where the predictions of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Guiqin Wang , Peng Zhao , Cong Zhao , Shusen Yang , Jie Cheng , Luziwei Leng , Jianxing Liao , Qinghai Guo

We tackle the problem of localizing temporal intervals of actions with only a single frame label for each action instance for training. Owing to label sparsity, existing work fails to learn action completeness, resulting in fragmentary…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Pilhyeon Lee , Hyeran Byun

Temporal action localization presents a trade-off between test performance and annotation-time cost. Fully supervised methods achieve good performance with time-consuming boundary annotations. Weakly supervised methods with cheaper…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Xinpeng Ding , Nannan Wang , Xinbo Gao , Jie Li , Xiaoyu Wang , Tongliang Liu

The crux of semi-supervised temporal action localization (SS-TAL) lies in excavating valuable information from abundant unlabeled videos. However, current approaches predominantly focus on building models that are robust to the error-prone…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Kun Xia , Le Wang , Sanping Zhou , Gang Hua , Wei Tang

The present few-shot temporal action localization model can't handle the situation where videos contain multiple action instances. So the purpose of this paper is to achieve manifold action instances localization in a lengthy untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Fengshun Wang , Qiurui Wang , Yuting Wang

Spatio-temporal action detection in videos requires localizing the action both spatially and temporally in the form of an "action tube". Nowadays, most spatio-temporal action detection datasets (e.g. UCF101-24, AVA, DALY) are annotated with…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Huijuan Xu , Lizhi Yang , Stan Sclaroff , Kate Saenko , Trevor Darrell

Despite the recent advances in video classification, progress in spatio-temporal action recognition has lagged behind. A major contributing factor has been the prohibitive cost of annotating videos frame-by-frame. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Anurag Arnab , Chen Sun , Arsha Nagrani , Cordelia Schmid
‹ Prev 1 2 3 10 Next ›