English
Related papers

Related papers: Discovering Spatio-Temporal Action Tubes

200 papers

In this paper, we propose Spatio-TEmporal Progressive (STEP) action detector---a progressive learning framework for spatio-temporal action detection in videos. Starting from a handful of coarse-scale proposal cuboids, our approach…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Xitong Yang , Xiaodong Yang , Ming-Yu Liu , Fanyi Xiao , Larry Davis , Jan Kautz

Real-time video analysis remains a challenging problem in computer vision, requiring efficient processing of both spatial and temporal information while maintaining computational efficiency. Existing approaches often struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shahla John

In this paper, we propose a new framework for action localization that tracks people in videos and extracts full-body human tubes, i.e., spatio-temporal regions localizing actions, even in the case of occlusions or truncations. This is…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Nicolas Chesneau , Grégory Rogez , Karteek Alahari , Cordelia Schmid

Deep convolutional networks have achieved great success for visual recognition in still images. However, for action recognition in videos, the advantage over traditional methods is not so evident. This paper aims to discover the principles…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao , Dahua Lin , Xiaoou Tang , Luc Van Gool

This thesis focuses on video understanding for human action and interaction recognition. We start by identifying the main challenges related to action recognition from videos and review how they have been addressed by current methods. Based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alexandros Stergiou

We present a deep-learning framework for real-time multiple spatio-temporal (S/T) action localisation, classification and early prediction. Current state-of-the-art approaches work offline and are too slow to be useful in real- world…

Computer Vision and Pattern Recognition · Computer Science 2017-08-25 Gurkirt Singh , Suman Saha , Michael Sapienza , Philip Torr , Fabio Cuzzolin

We propose TubeR: a simple solution for spatio-temporal video action detection. Different from existing methods that depend on either an off-line actor detector or hand-designed actor-positional hypotheses like proposals or anchors, we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Jiaojiao Zhao , Yanyi Zhang , Xinyu Li , Hao Chen , Shuai Bing , Mingze Xu , Chunhui Liu , Kaustav Kundu , Yuanjun Xiong , Davide Modolo , Ivan Marsic , Cees G. M. Snoek , Joseph Tighe

This paper presents a novel spatiotemporal transformer network that introduces several original components to detect actions in untrimmed videos. First, the multi-feature selective semantic attention model calculates the correlations…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Matthew Korban , Peter Youngs , Scott T. Acton

Temporal action detection aims at not only recognizing action category but also detecting start time and end time for each action instance in an untrimmed video. The key challenge of this task is to accurately classify the action and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Wen Wang , Yongjian Wu , Haijun Liu , Shiguang Wang , Jian Cheng

In this work, we address the problem of spatio-temporal action detection in temporally untrimmed videos. It is an important and challenging task as finding accurate human actions in both temporal and spatial space is important for analyzing…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Zhenheng Yang , Jiyang Gao , Ram Nevatia

Real-time and online action localization in a video is a critical yet highly challenging problem. Accurate action localization requires the utilization of both temporal and spatial information. Recent attempts achieve this by using…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Kalana Abeywardena , Shechem Sumanthiran , Sakuna Jayasundara , Sachira Karunasena , Ranga Rodrigo , Peshala Jayasekara

Recognizing human actions based on videos has became one of the most popular areas of research in computer vision in recent years. This area has many applications such as surveillance, robotics, health care, video search and human-computer…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Aytekin Nebisoy , Saber Malekzadeh

Temporal action segmentation is a topic of increasing interest, however, annotating each frame in a video is cumbersome and costly. Weakly supervised approaches therefore aim at learning temporal action segmentation from videos that are…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Mohsen Fayyaz , Juergen Gall

Temporal action localization is an important yet challenging problem. Given a long, untrimmed video consisting of multiple action instances and complex background contents, we need not only to recognize their action categories, but also to…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Zheng Shou , Jonathan Chan , Alireza Zareian , Kazuyuki Miyazawa , Shih-Fu Chang

Inspired by the observation that humans are able to process videos efficiently by only paying attention where and when it is needed, we propose an interpretable and easy plug-in spatial-temporal attention mechanism for video action…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Lili Meng , Bo Zhao , Bo Chang , Gao Huang , Wei Sun , Frederich Tung , Leonid Sigal

Deep neural networks have achieved great success for video analysis and understanding. However, designing a high-performance neural architecture requires substantial efforts and expertise. In this paper, we make the first attempt to let…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Wei Peng , Xiaopeng Hong , Guoying Zhao

In this paper we discuss several forms of spatiotemporal convolutions for video analysis and study their effects on action recognition. Our motivation stems from the observation that 2D CNNs applied to individual frames of the video have…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Du Tran , Heng Wang , Lorenzo Torresani , Jamie Ray , Yann LeCun , Manohar Paluri

The task of action recognition or action detection involves analyzing videos and determining what action or motion is being performed. The primary subject of these videos are predominantly humans performing some action. However, this…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Amlaan Bhoi

We present a 3D Convolutional Neural Networks (CNNs) based single shot detector for spatial-temporal action detection tasks. Our model includes: (1) two short-term appearance and motion streams, with single RGB and optical flow image input…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Pengfei Zhang , Yu Cao , Benyuan Liu

We address the problem of temporal activity detection in continuous, untrimmed video streams. This is a difficult task that requires extracting meaningful spatio-temporal features to capture activities, accurately localizing the start and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Huijuan Xu , Abir Das , Kate Saenko