English
Related papers

Related papers: An End-to-End Spatio-Temporal Attention Model for …

200 papers

We present a module that extends the temporal graph of a graph convolutional network (GCN) for action recognition with a sequence of skeletons. Existing methods attempt to represent a more appropriate spatial graph on an intra-frame, but…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Yuya Obinata , Takuma Yamamoto

We propose a new architecture for the learning of predictive spatio-temporal motion models from data alone. Our approach, dubbed the Dropout Autoencoder LSTM, is capable of synthesizing natural looking motion sequences over long time…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Partha Ghosh , Jie Song , Emre Aksan , Otmar Hilliges

Skeleton-based human action recognition has been drawing more interest recently due to its low sensitivity to appearance changes and the accessibility of more skeleton data. However, even the 3D skeletons captured in practice are still…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Cunling Bian , Wei Feng , Fanbo Meng , Song Wang

We present an attention-based model that reasons on human body shape and motion dynamics to identify individuals in the absence of RGB information, hence in the dark. Our approach leverages unique 4D spatio-temporal signatures to address…

Computer Vision and Pattern Recognition · Computer Science 2016-11-23 Albert Haque , Alexandre Alahi , Li Fei-Fei

Skeleton-based gesture recognition methods have achieved high success using Graph Convolutional Network (GCN). In addition, context-dependent adaptive topology as a neighborhood vertex information and attention mechanism leverages a model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ikuo Nakamura

Skeleton-based action recognition has attracted considerable attention due to its compact representation of the human body's skeletal sructure. Many recent methods have achieved remarkable performance using graph convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Jungho Lee , Minhyeok Lee , Suhwan Cho , Sungmin Woo , Sungjun Jang , Sangyoun Lee

Skeleton-based action recognition, which classifies human actions based on the coordinates of joints and their connectivity within skeleton data, is widely utilized in various scenarios. While Graph Convolutional Networks (GCNs) have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jeonghyeok Do , Munchurl Kim

Skeleton based recognition systems are gaining popularity and machine learning models focusing on points or joints in a skeleton have proved to be computationally effective and application in many areas like Robotics. It is easy to track…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Neha Baranwal , Varun Sharma

Spatiotemporal and motion features are two complementary and crucial information for video action recognition. Recent state-of-the-art methods adopt a 3D CNN stream to learn spatiotemporal features and another flow stream to learn motion…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Boyuan Jiang , Mengmeng Wang , Weihao Gan , Wei Wu , Junjie Yan

This paper presents a novel spatiotemporal transformer network that introduces several original components to detect actions in untrimmed videos. First, the multi-feature selective semantic attention model calculates the correlations…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Matthew Korban , Peter Youngs , Scott T. Acton

We introduce a novel state-space model (SSM)-based framework for skeleton-based human action recognition, with an anatomically-guided architecture that improves state-of-the-art performance in both clinical diagnostics and general action…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Niki Martinel , Mariano Serrao , Christian Micheloni

Skeleton data is of low dimension. However, there is a trend of using very deep and complicated feedforward neural networks to model the skeleton sequence without considering the complexity in recent year. In this paper, a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Pengfei Zhang , Cuiling Lan , Wenjun Zeng , Junliang Xing , Jianru Xue , Nanning Zheng

Skeleton-based human action recognition has received widespread attention in recent years due to its diverse range of application scenarios. Due to the different sources of human skeletons, skeleton data naturally exhibit heterogeneity. The…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Hongsong Wang , Xiaoyan Ma , Jidong Kuang , Jie Gui

Human actions captured in video sequences contain two crucial factors for action recognition, i.e., visual appearance and motion dynamics. To model these two aspects, Convolutional and Recurrent Neural Networks (CNNs and RNNs) are adopted…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Yuan Yuan , Dong Wang , Qi Wang

Human gesture recognition has assumed a capital role in industrial applications, such as Human-Machine Interaction. We propose an approach for segmentation and classification of dynamic gestures based on a set of handcrafted features, which…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 André Brás , Miguel Simão , Pedro Neto

Recent advances in sensing technologies require the design and development of pattern recognition models capable of processing spatiotemporal data efficiently. In this study, we propose a spatially and temporally aware tensor-based neural…

Modeling neural population dynamics underlying noisy single-trial spiking activities is essential for relating neural observation and behavior. A recent non-recurrent method - Neural Data Transformers (NDT) - has shown great success in…

Neurons and Cognition · Quantitative Biology 2022-06-13 Trung Le , Eli Shlizerman

Graph convolutional networks (GCNs) are widely adopted in skeleton-based action recognition due to their powerful ability to model data topology. We argue that the performance of recent proposed skeleton-based action recognition methods is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Liyu Wu , Can Zhang , Yuexian Zou

Human Activity Recognition from body-worn sensor data poses an inherent challenge in capturing spatial and temporal dependencies of time-series signals. In this regard, the existing recurrent or convolutional or their hybrid models for…

Recognizing human actions is fundamentally a spatio-temporal reasoning problem, and should be, at least to some extent, invariant to the appearance of the human and the objects involved. Motivated by this hypothesis, in this work, we take…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Gorjan Radevski , Marie-Francine Moens , Tinne Tuytelaars