English
Related papers

Related papers: Multi-Scale Spatial-Temporal Self-Attention Graph …

200 papers

Multivariate Time-Series (MTS) data is crucial in various application fields. With its sequential and multi-source (multiple sensors) properties, MTS data inherently exhibits Spatial-Temporal (ST) dependencies, involving temporal…

Machine Learning · Computer Science 2024-01-11 Yucheng Wang , Yuecong Xu , Jianfei Yang , Min Wu , Xiaoli Li , Lihua Xie , Zhenghua Chen

Temporal action localization has long been researched in computer vision. Existing state-of-the-art action localization methods divide each video into multiple action units (i.e., proposals in two-stage methods and segments in one-stage…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Runhao Zeng , Wenbing Huang , Mingkui Tan , Yu Rong , Peilin Zhao , Junzhou Huang , Chuang Gan

We propose novel Stacked Spatio-Temporal Graph Convolutional Networks (Stacked-STGCN) for action segmentation, i.e., predicting and localizing a sequence of actions over long videos. We extend the Spatio-Temporal Graph Convolutional Network…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Pallabi Ghosh , Yi Yao , Larry S. Davis , Ajay Divakaran

In the field of skeleton-based action recognition, current top-performing graph convolutional networks (GCNs) exploit intra-sequence context to construct adaptive graphs for feature aggregation. However, we argue that such context is still…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Xiaohu Huang , Hao Zhou , Jian Wang , Haocheng Feng , Junyu Han , Errui Ding , Jingdong Wang , Xinggang Wang , Wenyu Liu , Bin Feng

Variations of human body skeletons may be considered as dynamic graphs, which are generic data representation for numerous real-world applications. In this paper, we propose a spatio-temporal graph convolution (STGC) approach for assembling…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Chaolong Li , Zhen Cui , Wenming Zheng , Chunyan Xu , Jian Yang

Graph convolutional networks (GCNs) have emerged as a powerful alternative to multiple instance learning with convolutional neural networks in digital pathology, offering superior handling of structural information across various spatial…

Image and Video Processing · Electrical Eng. & Systems 2024-03-25 Victor Ibañez , Przemyslaw Szostak , Quincy Wong , Konstanty Korski , Samaneh Abbasi-Sureshjani , Alvaro Gomariz

Despite the recent progress, 3D multi-person pose estimation from monocular videos is still challenging due to the commonly encountered problem of missing information caused by occlusion, partially out-of-frame target persons, and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Yu Cheng , Bo Wang , Bo Yang , Robby T. Tan

Despite great progress achieved by transformer in various vision tasks, it is still underexplored for skeleton-based action recognition with only a few attempts. Besides, these methods directly calculate the pair-wise global self-attention…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Zhimin Gao , Peitao Wang , Pei Lv , Xiaoheng Jiang , Qidong Liu , Pichao Wang , Mingliang Xu , Wanqing Li

Human motion prediction aims to generate future motions based on the observed human motions. Witnessing the success of Recurrent Neural Networks (RNN) in modeling the sequential data, recent works utilize RNN to model human-skeleton motion…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Xiangbo Shu , Liyan Zhang , Guo-Jun Qi , Wei Liu , Jinhui Tang

We propose a Dynamic Graph-Based Spatial-Temporal Attention (DG-STA) method for hand gesture recognition. The key idea is to first construct a fully-connected graph from a hand skeleton, where the node features and edges are then…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Yuxiao Chen , Long Zhao , Xi Peng , Jianbo Yuan , Dimitris N. Metaxas

Human action recognition is one of the challenging tasks in computer vision. The current action recognition methods use computationally expensive models for learning spatio-temporal dependencies of the action. Models utilizing RGB channels…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Labina Shrestha , Shikha Dubey , Farrukh Olimov , Muhammad Aasim Rafique , Moongu Jeon

It's common for current methods in skeleton-based action recognition to mainly consider capturing long-term temporal dependencies as skeleton sequences are typically long (>128 frames), which forms a challenging problem for previous…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Lianyu Hu , Shenglan Liu , Wei Feng

Human action recognition is an important task in computer vision. Extracting discriminative spatial and temporal features to model the spatial and temporal evolutions of different actions plays a key role in accomplishing this task. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-11-21 Sijie Song , Cuiling Lan , Junliang Xing , Wenjun Zeng , Jiaying Liu

Gait recognition, as a promising biometric technology, identifies individuals through their unique walking patterns and offers distinctive advantages including non-invasiveness, long-range applicability, and resistance to deliberate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Xiaoyun Wang , Cunrong Li , Wu Wang

In the realm of applications where data dynamically evolves across spatial and temporal dimensions, Graph Neural Networks (GNNs) are often complemented by sequence modeling architectures, such as RNNs and transformers, to effectively model…

Machine Learning · Computer Science 2024-09-02 Osama Ahmad , Omer Abdul Jalil , Usman Nazir , Murtaza Taj

Despite the success of deep learning for static image understanding, it remains unclear what are the most effective network architectures for the spatial-temporal modeling in videos. In this paper, in contrast to the existing CNN+RNN or…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Dongliang He , Zhichao Zhou , Chuang Gan , Fu Li , Xiao Liu , Yandong Li , Limin Wang , Shilei Wen

We study the problem of human action recognition using motion capture (MoCap) sequences. Unlike existing techniques that take multiple manual steps to derive standardized skeleton representations as model input, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoyu Zhu , Po-Yao Huang , Junwei Liang , Celso M. de Melo , Alexander Hauptmann

Human motion prediction is challenging due to the complex spatiotemporal feature modeling. Among all methods, graph convolution networks (GCNs) are extensively utilized because of their superiority in explicit connection modeling. Within a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Jiajun Fu , Fuxing Yang , Yonghao Dang , Xiaoli Liu , Jianqin Yin

Accurate traffic forecasting is essential for smart cities to achieve traffic control, route planning, and flow detection. Although many spatial-temporal methods are currently proposed, these methods are deficient in capturing the…

Machine Learning · Computer Science 2024-03-07 Aoyu Liu , Yaying Zhang

We present Bi-Level Attention-Based Relational Graph Convolutional Networks (BR-GCN), unique neural network architectures that utilize masked self-attentional layers with relational graph convolutions, to effectively operate on highly…

Machine Learning · Computer Science 2024-04-16 Roshni G. Iyer , Wei Wang , Yizhou Sun