English
Related papers

Related papers: Squeeze-and-Excitation on Spatial and Temporal Dee…

200 papers

Skeleton-based action recognition task is entangled with complex spatio-temporal variations of skeleton joints, and remains challenging for Recurrent Neural Networks (RNNs). In this work, we propose a temporal-then-spatial recalibration…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Chunyu Xie , Ce Li , Baochang Zhang , Chen Chen , Jungong Han , Changqing Zou , Jianzhuang Liu

In this paper, we propose the use of a semantic image, an improved representation for video analysis, principally in combination with Inception networks. The semantic image is obtained by applying localized sparse segmentation using global…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Sunder Ali Khowaja , Seok-Lyong Lee

Contrastive learning has been successfully leveraged to learn action representations for addressing the problem of semi-supervised skeleton-based action recognition. However, most contrastive learning-based methods only contrast global…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Binqian Xu , Xiangbo Shu

In speaker verification, the extraction of voice representations is mainly based on the Residual Neural Network (ResNet) architecture. ResNet is built upon convolution layers which learn filters to capture local spatial patterns along all…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-14 Mickael Rouvier , Pierre-Michel Bousquet

Skeleton-based action recognition is an important task that requires the adequate understanding of movement characteristics of a human action from the given skeleton sequence. Recent studies have shown that exploring spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Chenyang Si , Wentao Chen , Wei Wang , Liang Wang , Tieniu Tan

Accurate hand gesture prediction is crucial for effective upper-limb prosthetic limbs control. As the high flexibility and multiple degrees of freedom exhibited by human hands, there has been a growing interest in integrating deep networks…

Human-Computer Interaction · Computer Science 2026-04-07 Wenjuan Zhong , Yuyang Zhang , Peiwen Fu , Wenxuan Xiong , Mingming Zhang

Graph Convolutional Networks (GCNs), which model skeleton data as graphs, have obtained remarkable performance for skeleton-based action recognition. Particularly, the temporal dynamic of skeleton sequence conveys significant information in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Jianan Li , Xuemei Xie , Zhifu Zhao , Yuhan Cao , Qingzhe Pan , Guangming Shi

Two-stream Convolutional Networks (ConvNets) have shown strong performance for human action recognition in videos. Recently, Residual Networks (ResNets) have arisen as a new technique to train extremely deep architectures. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2016-11-08 Christoph Feichtenhofer , Axel Pinz , Richard P. Wildes

This paper extends the Spatial-Temporal Graph Convolutional Network (ST-GCN) for skeleton-based action recognition by introducing two novel modules, namely, the Graph Vertex Feature Encoder (GVFE) and the Dilated Hierarchical Temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Konstantinos Papadopoulos , Enjie Ghorbel , Djamila Aouada , Björn Ottersten

Residual networks, which use a residual unit to supplement the identity mappings, enable very deep convolutional architecture to operate well, however, the residual architecture has been proved to be diverse and redundant, which may leads…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Yang Hu , Guihua Wen , Mingnan Luo , Dan Dai , Jiajiong Ma , Zhiwen Yu

Convolutional Neural Networks (CNNs) have revolutionized image classification by extracting spatial features and enabling state-of-the-art accuracy in vision-based tasks. The squeeze and excitation network proposed module gathers…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Mahendran Narayanan

Joint segmentation and classification of fine-grained actions is important for applications of human-robot interaction, video surveillance, and human skill evaluation. However, despite substantial recent progress in large-scale action…

Computer Vision and Pattern Recognition · Computer Science 2016-10-03 Colin Lea , Austin Reiter , Rene Vidal , Gregory D. Hager

We propose novel Stacked Spatio-Temporal Graph Convolutional Networks (Stacked-STGCN) for action segmentation, i.e., predicting and localizing a sequence of actions over long videos. We extend the Spatio-Temporal Graph Convolutional Network…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Pallabi Ghosh , Yi Yao , Larry S. Davis , Ajay Divakaran

Skeleton-based action recognition has become popular in recent years due to its efficiency and robustness. Most current methods adopt graph convolutional network (GCN) for topology modeling, but GCN-based methods are limited in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Jinzhao Luo , Lu Zhou , Guibo Zhu , Guojing Ge , Beiying Yang , Jinqiao Wang

Skeleton-based human action recognition has attracted a lot of research attention during the past few years. Recent works attempted to utilize recurrent neural networks to model the temporal dependencies between the 3D positional…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Jun Liu , Amir Shahroudy , Dong Xu , Alex C. Kot , Gang Wang

Channel and spatial attention mechanisms introduced by earlier works enhance the representation abilities of deep convolutional neural networks (CNNs) but often lead to increased parameter and computation costs. While recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Rishabh Sabharwal , Ram Samarth B B , Parikshit Singh Rathore , Punit Rathore

Human skeleton joints are popular for action analysis since they can be easily extracted from videos to discard background noises. However, current skeleton representations do not fully benefit from machine learning with CNNs. We propose…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Jian Liu , Naveed Akhtar , Ajmal Mian

The current paper proposes a novel neural network model for recognizing visually perceived human actions. The proposed multiple spatio-temporal scales recurrent neural network (MSTRNN) model is derived by introducing multiple timescale…

Computer Vision and Pattern Recognition · Computer Science 2017-02-23 Haanvid Lee , Minju Jung , Jun Tani

The purpose of gesture recognition is to recognize meaningful movements of human bodies, and gesture recognition is an important issue in computer vision. In this paper, we present a multimodal gesture recognition method based on 3D densely…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Yi Zhang , Chong Wang , Ye Zheng , Jieyu Zhao , Yuqi Li , Xijiong Xie

Most existing Convolutional Neural Networks(CNNs) used for action recognition are either difficult to optimize or underuse crucial temporal information. Inspired by the fact that the recurrent model consistently makes breakthroughs in the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Zhenxing Zheng , Gaoyun An , Qiuqi Ruan