English
Related papers

Related papers: Modality Compensation Network: Cross-Modal Adaptat…

200 papers

Skeleton-based action recognition aims to project skeleton sequences to action categories, where skeleton sequences are derived from multiple forms of pre-detected points. Compared with earlier methods that focus on exploring single-form…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Xuanhan Wang , Yan Dai , Lianli Gao , Jingkuan Song

Action recognition has been a heated topic in computer vision for its wide application in vision systems. Previous approaches achieve improvement by fusing the modalities of the skeleton sequence and RGB video. However, such methods have a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Xiaoguang Zhu , Ye Zhu , Haoyu Wang , Honglin Wen , Yan Yan , Peilin Liu

Due to the fast processing-speed and robustness it can achieve, skeleton-based action recognition has recently received the attention of the computer vision community. The recent Convolutional Neural Network (CNN)-based methods have shown…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Han Chen , Yifan Jiang , Hanseok Ko

The data-driven approach that learns an optimal representation of vision features like skeleton frames or RGB videos is currently a dominant paradigm for activity recognition. While great improvements have been achieved from existing single…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Bruce X. B. Yu , Yan Liu , Keith C. C. Chan

In this paper, we present Fusion-GCN, an approach for multimodal action recognition using Graph Convolutional Networks (GCNs). Action recognition methods based around GCNs recently yielded state-of-the-art performance for skeleton-based…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Michael Duhme , Raphael Memmesheimer , Dietrich Paulus

Skeleton-based action recognition has attracted considerable attention in computer vision since skeleton data is more robust to the dynamic circumstance and complicated background than other modalities. Recently, many researchers have used…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Hao Yang , Dan Yan , Li Zhang , Dong Li , YunDa Sun , ShaoDi You , Stephen J. Maybank

A challenge of skeleton-based action recognition is the difficulty to classify actions with similar motions and object-related actions. Visual clues from other streams help in that regard. RGB data are sensible to illumination conditions,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Alban Main de Boissiere , Rita Noumeir

Graph convolutional networks (GCNs), which can model the human body skeletons as spatial and temporal graphs, have shown remarkable potential in skeleton-based action recognition. However, in the existing GCN-based methods, graph-structured…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Han Chen , Yifan Jiang , Hanseok Ko

Recently, there has been a remarkable increase in the interest towards skeleton-based action recognition within the research community, owing to its various advantageous features, including computational efficiency, representative features,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Ayman Ali , Ekkasit Pinyoanuntapong , Pu Wang , Mohsen Dorodchi

Graph convolutional networks (GCNs), which generalize CNNs to more generic non-Euclidean structures, have achieved remarkable performance for skeleton-based action recognition. However, there still exist several issues in the previous…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Lei Shi , Yifan Zhang , Jian Cheng , Hanqing Lu

Skeleton-based action recognition has garnered significant attention due to the utilization of concise and resilient skeletons. Nevertheless, the absence of detailed body information in skeletons restricts performance, while other…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jinfu Liu , Chen Chen , Mengyuan Liu

Recognizing human actions in untrimmed videos is an important challenging task. An effective 3D motion representation and a powerful learning model are two key factors influencing recognition performance. In this paper we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Huy-Hieu Pham , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A. Velastin

Current state-of-the-art approaches to skeleton-based action recognition are mostly based on recurrent neural networks (RNN). In this paper, we propose a novel convolutional neural networks (CNN) based framework for both action…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

Multimodal human action understanding is a significant problem in computer vision, with the central challenge being the effective utilization of the complementarity among diverse modalities while maintaining model efficiency. However, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hongsong Wang , Heng Fei , Bingxuan Dai , Jie Gui

Multimodal-based action recognition methods have achieved high success using pose and RGB modality. However, skeletons sequences lack appearance depiction and RGB images suffer irrelevant noise due to modality limitations. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Jinfu Liu , Runwei Ding , Yuhang Wen , Nan Dai , Fanyang Meng , Shen Zhao , Mengyuan Liu

Human action recognition aims at classifying the category of human action from a segment of a video. Recently, people have dived into designing GCN-based models to extract features from skeletons for performing this task, because skeleton…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Huanyu Zhou , Qingjie Liu , Yunhong Wang

This paper presents an image classification based approach for skeleton-based video action recognition problem. Firstly, A dataset independent translation-scale invariant image mapping method is proposed, which transformes the skeleton…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Bo Li , Mingyi He , Xuelian Cheng , Yucheng Chen , Yuchao Dai

The shared topology of human skeletons motivated the recent investigation of graph convolutional network (GCN) solutions for action recognition. However, most of the existing GCNs rely on the binary connection of two neighboring vertices…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Youwei Zhou , Tianyang Xu , Cong Wu , Xiaojun Wu , Josef Kittler

A novel data representation method of convolutional neural net- work (CNN) is proposed in this paper to represent data of different modalities. We learn a CNN model for the data of each modality to map the data of differ- ent modalities to…

Machine Learning · Computer Science 2016-11-22 Yanbin Wu , Li Wang , Fan Cui , Hongbin Zhai , Baoming Dong , Jim Jing-Yan Wang

In multi-modal action recognition, it is important to consider not only the complementary nature of different modalities but also global action content. In this paper, we propose a novel network, named Modality Mixer (M-Mixer) network, to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Sumin Lee , Sangmin Woo , Yeonju Park , Muhammad Adi Nugroho , Changick Kim
‹ Prev 1 2 3 10 Next ›