English
Related papers

Related papers: Towards To-a-T Spatio-Temporal Focus for Skeleton-…

200 papers

Traditional approaches in unsupervised or self supervised learning for skeleton-based action classification have concentrated predominantly on the dynamic aspects of skeletal sequences. Yet, the intricate interaction between the moving and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Shanaka Ramesh Gunasekara , Wanqing Li , Philip Ogunbona , Jack Yang

Human action recognition in 3D skeleton sequences has attracted a lot of research attention. Recently, Long Short-Term Memory (LSTM) networks have shown promising performance in this task due to their strengths in modeling the dependencies…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Jun Liu , Gang Wang , Ling-Yu Duan , Kamila Abdiyeva , Alex C. Kot

Timely accurate traffic forecast is crucial for urban traffic control and guidance. Due to the high nonlinearity and complexity of traffic flow, traditional methods cannot satisfy the requirements of mid-and-long term prediction tasks and…

Machine Learning · Computer Science 2018-07-13 Bing Yu , Haoteng Yin , Zhanxing Zhu

We study the problem of human action recognition using motion capture (MoCap) sequences. Unlike existing techniques that take multiple manual steps to derive standardized skeleton representations as model input, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoyu Zhu , Po-Yao Huang , Junwei Liang , Celso M. de Melo , Alexander Hauptmann

Conventional 3D convolutional neural networks (CNNs) are computationally expensive, memory intensive, prone to overfitting, and most importantly, there is a need to improve their feature learning capabilities. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Sudhakar Kumawat , Manisha Verma , Yuta Nakashima , Shanmuganathan Raman

This paper presents a 2D skeleton-based action segmentation method with applications in fine-grained human activity recognition. In contrast with state-of-the-art methods which directly take sequences of 3D skeleton coordinates as inputs…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Syed Waleed Hyder , Muhammad Usama , Anas Zafar , Muhammad Naufil , Fawad Javed Fateh , Andrey Konin , M. Zeeshan Zia , Quoc-Huy Tran

In recent years, there has been a rapid development of spatio-temporal prediction techniques in response to the increasing demands of traffic management and travel planning. While advanced end-to-end models have achieved notable success in…

Machine Learning · Computer Science 2023-11-09 Zhonghang Li , Lianghao Xia , Yong Xu , Chao Huang

Skeleton-based action recognition has achieved remarkable results in human action recognition with the development of graph convolutional networks (GCNs). However, the recent works tend to construct complex learning mechanisms with…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Dongjingdin Liu , Pengpeng Chen , Miao Yao , Yijing Lu , Zijie Cai , Yuxin Tian

Human pose assessment and correction play a crucial role in applications across various fields, including computer vision, robotics, sports analysis, healthcare, and entertainment. In this paper, we propose a Spatial-Temporal Transformer…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Wenyang Hu , Kai Liu , Libin Liu , Huiliang Shang

Skeleton-based action recognition aims to recognize human actions given human joint coordinates with skeletal interconnections. By defining a graph with joints as vertices and their natural connections as edges, previous works successfully…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Yuxuan Zhou , Zhi-Qi Cheng , Chao Li , Yanwen Fang , Yifeng Geng , Xuansong Xie , Margret Keuper

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Joint segmentation and classification of fine-grained actions is important for applications of human-robot interaction, video surveillance, and human skill evaluation. However, despite substantial recent progress in large-scale action…

Computer Vision and Pattern Recognition · Computer Science 2016-10-03 Colin Lea , Austin Reiter , Rene Vidal , Gregory D. Hager

Real-time video analysis remains a challenging problem in computer vision, requiring efficient processing of both spatial and temporal information while maintaining computational efficiency. Existing approaches often struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shahla John

We propose ST-DETR, a Spatio-Temporal Transformer-based architecture for object detection from a sequence of temporal frames. We treat the temporal frames as sequences in both space and time and employ the full attention mechanisms to take…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Eslam Mohamed , Ahmad El-Sallab

Action recognition has been a heated topic in computer vision for its wide application in vision systems. Previous approaches achieve improvement by fusing the modalities of the skeleton sequence and RGB video. However, such methods have a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Xiaoguang Zhu , Ye Zhu , Haoyu Wang , Honglin Wen , Yan Yan , Peilin Liu

Spatio-temporal action localization is an important problem in computer vision that involves detecting where and when activities occur, and therefore requires modeling of both spatial and temporal features. This problem is typically…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Nakul Agarwal , Yi-Ting Chen , Behzad Dariush , Ming-Hsuan Yang

Spatial-temporal graphs are widely used in a variety of real-world applications. Spatial-Temporal Graph Neural Networks (STGNNs) have emerged as a powerful tool to extract meaningful insights from this data. However, in real-world…

Machine Learning · Computer Science 2024-12-18 Zhenyu Lei , Yushun Dong , Jundong Li , Chen Chen

Graph convolution networks (GCNs) have achieved remarkable performance in skeleton-based action recognition. However, previous GCN-based methods rely on elaborate human priors excessively and construct complex feature aggregation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Shaojie Zhang , Jianqin Yin , Yonghao Dang , Jiajun Fu

Self-supervised learning has demonstrated remarkable capability in representation learning for skeleton-based action recognition. Existing methods mainly focus on applying global data augmentation to generate different views of the skeleton…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Yujie Zhou , Haodong Duan , Anyi Rao , Bing Su , Jiaqi Wang

For a given video-based Human-Object Interaction scene, modeling the spatio-temporal relationship between humans and objects are the important cue to understand the contextual information presented in the video. With the effective…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Ning Wang , Guangming Zhu , Liang Zhang , Peiyi Shen , Hongsheng Li , Cong Hua