English
Related papers

Related papers: Spatio-Temporal Action Detection with Multi-Object…

200 papers

Spatio-temporal action localization consists of three levels of tasks: spatial localization, action classification, and temporal localization. In this work, we propose a new progressive cross-stream cooperation (PCSC) framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Rui Su , Dong Xu , Luping Zhou , Wanli Ouyang

The current main stream methods formulate their video saliency mainly from two independent venues, i.e., the spatial and temporal branches. As a complementary component, the main task for the temporal branch is to intermittently focus the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Chenglizhao Chen , Guotao Wang , Chong Peng , Dingwen Zhang , Yuming Fang , Hong Qin

Beyond possessing large enough size to feed data hungry machines (eg, transformers), what attributes measure the quality of a dataset? Assuming that the definitions of such attributes do exist, how do we quantify among their relative…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Rajat Modi , Aayush Jung Rana , Akash Kumar , Praveen Tirupattur , Shruti Vyas , Yogesh Singh Rawat , Mubarak Shah

Spatio-temporal feature learning is of central importance for action recognition in videos. Existing deep neural network models either learn spatial and temporal features independently (C2D) or jointly with unconstrained parameters (C3D).…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

Video action recognition has made significant strides, but challenges remain in effectively using both spatial and temporal information. While existing methods often focus on either spatial features (e.g., object appearance) or temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Huilin Chen , Lei Wang , Yifan Chen , Tom Gedeon , Piotr Koniusz

Existing approaches for spatio-temporal action detection in videos are limited by the spatial extent and temporal duration of the actions. In this paper, we present a modular system for spatio-temporal action detection in untrimmed security…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Joshua Gleason , Rajeev Ranjan , Steven Schwarcz , Carlos D. Castillo , Jun-Chen Cheng , Rama Chellappa

We propose TubeR: a simple solution for spatio-temporal video action detection. Different from existing methods that depend on either an off-line actor detector or hand-designed actor-positional hypotheses like proposals or anchors, we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Jiaojiao Zhao , Yanyi Zhang , Xinyu Li , Hao Chen , Shuai Bing , Mingze Xu , Chunhui Liu , Kaustav Kundu , Yuanjun Xiong , Davide Modolo , Ivan Marsic , Cees G. M. Snoek , Joseph Tighe

The human action classification task is a widely researched topic and is still an open problem. Many state-of-the-arts approaches involve the usage of bag-of-video-words with spatio-temporal local features to construct characterizations for…

Computer Vision and Pattern Recognition · Computer Science 2016-10-18 Aznul Qalid Md Sabri , Jacques Boonaert , Erma Rahayu Mohd Faizal Abdullah , Ali Mohammed Mansoor

This work presents advancements in multi-class vehicle detection using UAV cameras through the development of spatiotemporal object detection models. The study introduces a Spatio-Temporal Vehicle Detection Dataset (STVD) containing 6, 600…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Kristina Telegraph , Christos Kyrkou

Tracking multiple moving objects in real-time in a dynamic threat environment is an important element in national security and surveillance system. It helps pinpoint and distinguish potential candidates posing threats from other normal…

Machine Learning · Computer Science 2022-06-27 Imtiaz Ahmed , Mikyoung Jun , Yu Ding

We propose a method for human action recognition, one that can localize the spatiotemporal regions that `define' the actions. This is a challenging task due to the subtlety of human actions in video and the co-occurrence of contextual…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Yang Wang , Vinh Tran , Gedas Bertasius , Lorenzo Torresani , Minh Hoai

Temporal action detection aims at not only recognizing action category but also detecting start time and end time for each action instance in an untrimmed video. The key challenge of this task is to accurately classify the action and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Wen Wang , Yongjian Wu , Haijun Liu , Shiguang Wang , Jian Cheng

Recognizing human actions in videos requires spatial and temporal understanding. Most existing action recognition models lack a balanced spatio-temporal understanding of videos. In this work, we propose a novel two-stream architecture,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Dongho Lee , Jongseo Lee , Jinwoo Choi

Action detection is an essential and challenging task, especially for densely labelled datasets of untrimmed videos. The temporal relation is complex in those datasets, including challenges like composite action, and co-occurring action.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Rui Dai , Srijan Das , Kumara Kahatapitiya , Michael S. Ryoo , Francois Bremond

In this paper, we propose an approach that spatially localizes the activities in a video frame where each person can perform multiple activities at the same time. Our approach takes the temporal scene context as well as the relations of the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Sovan Biswas , Yaser Souri , Juergen Gall

Skeleton data carries valuable motion information and is widely explored in human action recognition. However, not only the motion information but also the interaction with the environment provides discriminative cues to recognize the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Liang Xu , Cuiling Lan , Wenjun Zeng , Cewu Lu

The goal of human action recognition is to temporally or spatially localize the human action of interest in video sequences. Temporal localization (i.e. indicating the start and end frames of the action in a video) is referred to as…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Waqas Sultani , Qazi Ammar Arshad , Chen Chen

Action recognition from multi-modal and multi-view observations holds significant potential for applications in surveillance, robotics, and smart environments. However, existing methods often fall short of addressing real-world challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Trung Thanh Nguyen , Yasutomo Kawanishi , Vijay John , Takahiro Komamizu , Ichiro Ide

Spatio-temporal video grounding aims to retrieve the spatio-temporal tube of a queried object according to the given sentence. Currently, most existing grounding methods are restricted to well-aligned segment-sentence pairs. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Zhu Zhang , Zhou Zhao , Zhijie Lin , Baoxing Huai , Nicholas Jing Yuan

Detecting salient objects from a video requires exploiting both spatial and temporal knowledge included in the video. We propose a novel region-based multiscale spatiotemporal saliency detection method for videos, where static features and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Trung-Nghia Le , Akihiro Sugimoto