English
Related papers

Related papers: Skeletal Movement to Color Map: A Novel Representa…

200 papers

3D Reconstruction of moving articulated objects without additional information about object structure is a challenging problem. Current methods overcome such challenges by employing category-specific skeletal models. Consequently, they do…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Hao Zhang , Fang Li , Samyak Rawlekar , Narendra Ahuja

In this paper, we present Fusion-GCN, an approach for multimodal action recognition using Graph Convolutional Networks (GCNs). Action recognition methods based around GCNs recently yielded state-of-the-art performance for skeleton-based…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Michael Duhme , Raphael Memmesheimer , Dietrich Paulus

Recently, skeleton based action recognition gains more popularity due to cost-effective depth sensors coupled with real-time skeleton estimation algorithms. Traditional approaches based on handcrafted features are limited to represent the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Hongsong Wang , Liang Wang

In this paper, we present Skeleton Transformer Networks (SkeletonNet), an end-to-end framework that can predict not only 3D joint positions but also 3D angular pose (bone rotations) of a human skeleton from a single color image. This in…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Yusuke Yoshiyasu , Ryusuke Sagawa , Ko Ayusawa , Akihiko Murai

This paper proposes a new framework for RGB-D-based action recognition that takes advantages of hand-designed features from skeleton data and deeply learned features from depth maps, and exploits effectively both the local and global…

Computer Vision and Pattern Recognition · Computer Science 2016-02-03 Pichao Wang , Zhaoyang Li , Yonghong Hou , Wanqing Li

Recently, with the availability of cost-effective depth cameras coupled with real-time skeleton estimation, the interest in skeleton-based human action recognition is renewed. Most of the existing skeletal representation approaches use…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Zhize Wu , Thomas Weise , Le Zou , Fei Sun , Ming Tan

We propose a novel system for unsupervised skeleton-based action recognition. Given inputs of body keypoints sequences obtained during various movements, our system associates the sequences with actions. Our system is based on an…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Kun Su , Xiulong Liu , Eli Shlizerman

Despite huge success in the image domain, modern detection models such as Faster R-CNN have not been used nearly as much for video analysis. This is arguably due to the fact that detection models are designed to operate on single frames and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Gedas Bertasius , Christoph Feichtenhofer , Du Tran , Jianbo Shi , Lorenzo Torresani

Skeleton-based action representation learning aims to interpret and understand human behaviors by encoding the skeleton sequences, which can be categorized into two primary training paradigms: supervised learning and self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yang Chen , Tian He , Junfeng Fu , Ling Wang , Jingcai Guo , Ting Hu , Hong Cheng

Skeleton-based human action recognition has attracted much attention with the prevalence of accessible depth sensors. Recently, graph convolutional networks (GCNs) have been widely used for this task due to their powerful capability to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Zhen Huang , Xu Shen , Xinmei Tian , Houqiang Li , Jianqiang Huang , Xian-Sheng Hua

Learning image representations with ConvNets by pre-training on ImageNet has proven useful across many visual understanding tasks including object detection, semantic segmentation, and image captioning. Although any image representation can…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Du Tran , Jamie Ray , Zheng Shou , Shih-Fu Chang , Manohar Paluri

The recent success of implicit neural scene representations has presented a viable new method for how we capture and store 3D scenes. Unlike conventional 3D representations, such as point clouds, which explicitly store scene properties in…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Amit Kohli , Vincent Sitzmann , Gordon Wetzstein

We introduce a novel state-space model (SSM)-based framework for skeleton-based human action recognition, with an anatomically-guided architecture that improves state-of-the-art performance in both clinical diagnostics and general action…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Niki Martinel , Mariano Serrao , Christian Micheloni

For multimodal skeleton-based action recognition, Graph Convolutional Networks (GCNs) are effective models. Still, their reliance on floating-point computations leads to high energy consumption, limiting their applicability in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Naichuan Zheng , Yuchen Du , Hailun Xia , Zeyu Liang

In this paper, we address self-supervised representation learning from human skeletons for action recognition. Previous methods, which usually learn feature presentations from a single reconstruction task, may come across the overfitting…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Lilang Lin , Sijie Song , Wenhan Yan , Jiaying Liu

In this work, we study self-supervised representation learning for 3D skeleton-based action recognition. We extend Bootstrap Your Own Latent (BYOL) for representation learning on skeleton sequence data and propose a new data augmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Olivier Moliner , Sangxia Huang , Kalle Åström

Human action recognition is a crucial task for intelligent robotics, particularly within the context of human-robot collaboration research. In self-supervised skeleton-based action recognition, the mask-based reconstruction paradigm learns…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Wei Wei , Shaojie Zhang , Yonghao Dang , Jianqin Yin

With the prevalence of accessible depth sensors, dynamic human body skeletons have attracted much attention as a robust modality for action recognition. Previous methods model skeletons based on RNN or CNN, which has limited expressive…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Xiang Gao , Wei Hu , Jiaxiang Tang , Jiaying Liu , Zongming Guo

Group Activity Recognition aims to understand collective activities from videos. Existing solutions primarily rely on the RGB modality, which encounters challenges such as background variations, occlusions, motion blurs, and significant…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhengcen Li , Xinle Chang , Yueran Li , Jingyong Su

Graph Convolutional Networks (GCNs) have been widely used to model the high-order dynamic dependencies for skeleton-based action recognition. Most existing approaches do not explicitly embed the high-order spatio-temporal importance to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Lipeng Ke , Kuan-Chuan Peng , Siwei Lyu