English
Related papers

Related papers: Spatio-Temporal Channel Correlation Networks for A…

200 papers

Recently, convolutional neural networks (CNNs) are the leading defacto method for crowd counting. However, when dealing with video datasets, CNN-based methods still process each video frame independently, thus ignoring the powerful temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Zhikang Zou , Huiliang Shao , Xiaoye Qu , Wei Wei , Pan Zhou

Skeleton-based action recognition methods are limited by the semantic extraction of spatio-temporal skeletal maps. However, current methods have difficulty in effectively combining features from both temporal and spatial graph dimensions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Shengqin Wang , Yongji Zhang , Minghao Zhao , Hong Qi , Kai Wang , Fenglin Wei , Yu Jiang

Skeleton-based action recognition has made great progress recently, but many problems still remain unsolved. For example, most of the previous methods model the representations of skeleton sequences without abundant spatial structure…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chenyang Si , Ya Jing , Wei Wang , Liang Wang , Tieniu Tan

Temporal modeling still remains challenging for action recognition in videos. To mitigate this issue, this paper presents a new video architecture, termed as Temporal Difference Network (TDN), with a focus on capturing multi-scale temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Limin Wang , Zhan Tong , Bin Ji , Gangshan Wu

The ability to identify and temporally segment fine-grained human actions throughout a video is crucial for robotics, surveillance, education, and beyond. Typical approaches decouple this problem by first extracting local spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Colin Lea , Michael D. Flynn , Rene Vidal , Austin Reiter , Gregory D. Hager

Dynamics of human body skeletons convey significant information for human action recognition. Conventional approaches for modeling skeletons usually rely on hand-crafted parts or traversal rules, thus resulting in limited expressive power…

Computer Vision and Pattern Recognition · Computer Science 2018-01-26 Sijie Yan , Yuanjun Xiong , Dahua Lin

Three-dimensional convolutional neural networks (3D CNNs) have demonstrated remarkable performance in video recognition tasks by processing both spatial and temporal features. However, the cubic scaling of computational complexity poses…

Hardware Architecture · Computer Science 2026-04-29 Xi Shen , Bowen Qi , Tabassom Hamidfar , Selim M. Shahriar

Understanding actions and gestures in video streams requires temporal reasoning of the spatial content from different time instants, i.e., spatiotemporal (ST) modeling. In this survey paper, we have made a comparative analysis of different…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Okan Köpüklü , Fabian Herzog , Gerhard Rigoll

3D convolution neural networks (CNNs) have been the prevailing option for video recognition. To capture the temporal information, 3D convolutions are computed along the sequences, leading to cubically growing and expensive computations. To…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Junyan Wang , Zhenhong Sun , Yichen Qian , Dong Gong , Xiuyu Sun , Ming Lin , Maurice Pagnucco , Yang Song

This paper presents a new framework for human action recognition from a 3D skeleton sequence. Previous studies do not fully utilize the temporal relationships between video segments in a human action. Some studies successfully used very…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Thao Minh Le , Nakamasa Inoue , Koichi Shinoda

Convolutional Neural Networks with 3D kernels (3D-CNNs) currently achieve state-of-the-art results in video recognition tasks due to their supremacy in extracting spatiotemporal features within video frames. There have been many successful…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Okan Köpüklü , Stefan Hörmann , Fabian Herzog , Hakan Cevikalp , Gerhard Rigoll

Two-stream Convolutional Networks (ConvNets) have shown strong performance for human action recognition in videos. Recently, Residual Networks (ResNets) have arisen as a new technique to train extremely deep architectures. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2016-11-08 Christoph Feichtenhofer , Axel Pinz , Richard P. Wildes

We propose novel Stacked Spatio-Temporal Graph Convolutional Networks (Stacked-STGCN) for action segmentation, i.e., predicting and localizing a sequence of actions over long videos. We extend the Spatio-Temporal Graph Convolutional Network…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Pallabi Ghosh , Yi Yao , Larry S. Davis , Ajay Divakaran

This work studies the entity-wise topical behavior from massive network logs. Both the temporal and the spatial relationships of the behavior are explored with the learning architectures combing the recurrent neural network (RNN) and the…

Machine Learning · Computer Science 2017-05-04 Shih-Chieh Su

Skeleton-based human action recognition has attracted much attention with the prevalence of accessible depth sensors. Recently, graph convolutional networks (GCNs) have been widely used for this task due to their powerful capability to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Zhen Huang , Xu Shen , Xinmei Tian , Houqiang Li , Jianqiang Huang , Xian-Sheng Hua

Recently, three dimensional (3D) convolutional neural networks (CNNs) have emerged as dominant methods to capture spatiotemporal representations in videos, by adding to pre-existing 2D CNNs a third, temporal dimension. Such 3D CNNs,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Gurkirt Singh , Fabio Cuzzolin

Recently, convolutional neural networks with 3D kernels (3D CNNs) have been very popular in computer vision community as a result of their superior ability of extracting spatio-temporal features within video frames compared to 2D CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Okan Köpüklü , Neslihan Kose , Ahmet Gunduz , Gerhard Rigoll

In videos, the human's actions are of three-dimensional (3D) signals. These videos investigate the spatiotemporal knowledge of human behavior. The promising ability is investigated using 3D convolution neural networks (CNNs). The 3D CNNs…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Arslan Syed , Eman A. Aldhahri , Muhammad Munawar Iqbal , Abid Ali , Ammar Muthanna , Harun Jamil , Faisal Jamil

There has been huge progress on video action recognition in recent years. However, many works focus on tweaking existing 2D backbones due to the reliance of ImageNet pretraining, which restrains the models from achieving higher efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Zhe Wang , Xulei Yang

Skeleton-based action recognition relies on the extraction of spatial-temporal topological information. Hypergraphs can establish prior unnatural dependencies for the skeleton. However, the existing methods only focus on the construction of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Shengqin Wang , Yongji Zhang , Hong Qi , Minghao Zhao , Yu Jiang