English
Related papers

Related papers: Skeleton Sequence and RGB Frame Based Multi-Modali…

200 papers

Capturing the dependencies between joints is critical in skeleton-based action recognition task. Transformer shows great potential to model the correlation of important joints. However, the existing Transformer-based methods cannot capture…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Helei Qiu , Biao Hou , Bo Ren , Xiaohua Zhang

Human motion recognition is one of the most important branches of human-centered research activities. In recent years, motion recognition based on RGB-D data has attracted much attention. Along with the development in artificial…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Pichao Wang , Wanqing Li , Philip Ogunbona , Jun Wan , Sergio Escalera

Skeleton-based gesture recognition methods have achieved high success using Graph Convolutional Network (GCN). In addition, context-dependent adaptive topology as a neighborhood vertex information and attention mechanism leverages a model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ikuo Nakamura

Graph convolutional networks (GCNs), which generalize CNNs to more generic non-Euclidean structures, have achieved remarkable performance for skeleton-based action recognition. However, there still exist several issues in the previous…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Lei Shi , Yifan Zhang , Jian Cheng , Hanqing Lu

Consecutive frames in a video contain redundancy, but they may also contain relevant complementary information for the detection task. The objective of our work is to leverage this complementary information to improve detection. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Noreen Anwar , Guillaume-Alexandre Bilodeau , Wassim Bouachir

Due to the compact and rich high-level representations offered, skeleton-based human action recognition has recently become a highly active research topic. Previous studies have demonstrated that investigating joint relationships in spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Ali Farajzadeh Bavil , Hamed Damirchi , Hamid D. Taghirad

RGB-D semantic segmentation methods conventionally use two independent encoders to extract features from the RGB and depth data. However, there lacks an effective fusion mechanism to bridge the encoders, for the purpose of fully exploiting…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Liuyuan Deng , Ming Yang , Tianyi Li , Yuesheng He , Chunxiang Wang

In the field of multimodal segmentation, the correlation between different modalities can be considered for improving the segmentation results. Considering the correlation between different MR modalities, in this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Tongxue Zhou , Su Ruan , Pierre Vera , Stéphane Canu

Graph convolutional networks have been widely used for skeleton-based action recognition due to their excellent modeling ability of non-Euclidean data. As the graph convolution is a local operation, it can only utilize the short-range joint…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Zhan Chen , Sicheng Li , Bing Yang , Qinghan Li , Hong Liu

Human action recognition is an important task in computer vision. Extracting discriminative spatial and temporal features to model the spatial and temporal evolutions of different actions plays a key role in accomplishing this task. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-11-21 Sijie Song , Cuiling Lan , Junliang Xing , Wenjun Zeng , Jiaying Liu

The emergence of different sensors (Near-Infrared, Depth, etc.) is a remedy for the limited application scenarios of traditional RGB camera. The RGB-X tasks, which rely on RGB input and another type of data input to resolve specific…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Jin Ma , Jinlong Li , Qing Guo , Tianyun Zhang , Yuewei Lin , Hongkai Yu

Current methods for skeleton-based human action recognition usually work with completely observed skeletons. However, in real scenarios, it is prone to capture incomplete and noisy skeletons, which will deteriorate the performance of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Yi-Fan Song , Zhang Zhang , Liang Wang

Human action recognition from well-segmented 3D skeleton data has been intensively studied and has been attracting an increasing attention. Online action detection goes one step further and is more challenging, which identifies the action…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Yanghao Li , Cuiling Lan , Junliang Xing , Wenjun Zeng , Chunfeng Yuan , Jiaying Liu

Skeleton-based action recognition is an important task that requires the adequate understanding of movement characteristics of a human action from the given skeleton sequence. Recent studies have shown that exploring spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Chenyang Si , Wentao Chen , Wei Wang , Liang Wang , Tieniu Tan

Skeleton action recognition involves recognizing human action from human skeletons. The use of graph convolutional networks (GCNs) has driven major advances in this recognition task. In real-world scenarios, the captured skeletons are not…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Tianyi Shen , Huijuan Xu , Nilesh Ahuja , Omesh Tickoo , Philip Shin , Vijaykrishnan Narayanan

Motion recognition is a promising direction in computer vision, but the training of video classification models is much harder than images due to insufficient data and considerable parameters. To get around this, some works strive to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Benjia Zhou , Pichao Wang , Jun Wan , Yanyan Liang , Fan Wang

This paper extends the Spatial-Temporal Graph Convolutional Network (ST-GCN) for skeleton-based action recognition by introducing two novel modules, namely, the Graph Vertex Feature Encoder (GVFE) and the Dilated Hierarchical Temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Konstantinos Papadopoulos , Enjie Ghorbel , Djamila Aouada , Björn Ottersten

Existing RGB-Event visual object tracking approaches primarily rely on conventional feature-level fusion, failing to fully exploit the unique advantages of event cameras. In particular, the high dynamic range and motion-sensitive nature of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Shiao Wang , Xiao Wang , Haonan Zhao , Jiarui Xu , Bo Jiang , Lin Zhu , Xin Zhao , Yonghong Tian , Jin Tang

Scene recognition is currently one of the top-challenging research fields in computer vision. This may be due to the ambiguity between classes: images of several scene classes may share similar objects, which causes confusion among them.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Álvaro García-Martín

Multi-modal feature fusion as a core investigative component of RGBT tracking emerges numerous fusion studies in recent years. However, existing RGBT tracking methods widely adopt fixed fusion structures to integrate multi-modal feature,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Andong Lu , Wanyu Wang , Chenglong Li , Jin Tang , Bin Luo