English
Related papers

Related papers: Modality Compensation Network: Cross-Modal Adaptat…

200 papers

Human action recognition is one of the challenging tasks in computer vision. The current action recognition methods use computationally expensive models for learning spatio-temporal dependencies of the action. Models utilizing RGB channels…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Labina Shrestha , Shikha Dubey , Farrukh Olimov , Muhammad Aasim Rafique , Moongu Jeon

Convolutional neural networks (CNNs) have been extensively applied for image recognition problems giving state-of-the-art results on recognition, detection, segmentation and retrieval. In this work we propose and evaluate several deep…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Joe Yue-Hei Ng , Matthew Hausknecht , Sudheendra Vijayanarasimhan , Oriol Vinyals , Rajat Monga , George Toderici

Nowadays, cross-modal retrieval plays an indispensable role to flexibly find information across different modalities of data. Effectively measuring the similarity between different modalities of data is the key of cross-modal retrieval.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Yuxin Peng , Jinwei Qi , Yuxin Yuan

This paper investigates body bones from skeleton data for skeleton based action recognition. Body joints, as the direct result of mature pose estimation technologies, are always the key concerns of traditional action recognition methods.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Xikun Zhang , Chang Xu , Xinmei Tian , Dacheng Tao

With the prevalence of accessible depth sensors, dynamic human body skeletons have attracted much attention as a robust modality for action recognition. Previous methods model skeletons based on RNN or CNN, which has limited expressive…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Xiang Gao , Wei Hu , Jiaxiang Tang , Jiaying Liu , Zongming Guo

Human action recognition is regarded as a key cornerstone in domains such as surveillance or video understanding. Despite recent progress in the development of end-to-end solutions for video-based action recognition, achieving…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Jiawei Chen , Jenson Hsiao , Chiu Man Ho

The success of deep convolutional neural networks is partially attributed to the massive amount of annotated training data. However, in practice, medical data annotations are usually expensive and time-consuming to be obtained. Considering…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Kang Li , Lequan Yu , Shujun Wang , Pheng-Ann Heng

Multi-view action recognition aims to identify actions in a given multi-view scene. Traditional studies initially extracted refined features from each view, followed by implemented paired interaction and integration, but they potentially…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yingyuan Yang , Guoyuan Liang , Can Wang , Xiaojun Wu

Skeleton sequences are widely used for action recognition task due to its lightweight and compact characteristics. Recent graph convolutional network (GCN) approaches have achieved great success for skeleton-based action recognition since…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Ruijie Hou , Zhao Wang

Human action recognition remains an important yet challenging task. This work proposes a novel action recognition system. It uses a novel Multiple View Region Adaptive Multi-resolution in time Depth Motion Map (MV-RAMDMM) formulation…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Mahmoud Al-Faris , John P. Chiverton , Yanyan Yang , David L. Ndzi

Human Activity Recognition (HAR) is a field of study that focuses on identifying and classifying human activities. Skeleton-based Human Activity Recognition has received much attention in recent years, where Graph Convolutional Network…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Jingyao Wang , Emmanuel Bergeret , Issam Falih

Multispectral pedestrian detection is capable of adapting to insufficient illumination conditions by leveraging color-thermal modalities. On the other hand, it is still lacking of in-depth insights on how to fuse the two modalities…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Kailai Zhou , Linsen Chen , Xun Cao

This paper addresses the problem of real-time action recognition in trimmed videos, for which deep neural networks have defined the state-of-the-art performance in the recent literature. For attaining higher recognition accuracies with…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Marian K. Y. Boktor , Ahmad Al-Kabbany , Radwa Khalil , Said El-Khamy

Most stroke patients experience upper limb motor dysfunction. Compensatory movements are prevalent during rehabilitation training, which is detrimental to patients' long-term recovery. Therefore, detecting compensatory movements is of great…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jiaxing Fan , Jiaojiao Liu , Wenkong Wang , Yang Zhang , Xin Ma , Jichen Zhang

Skeleton-based action recognition has attracted research attentions in recent years. One common drawback in currently popular skeleton-based human action recognition methods is that the sparse skeleton information alone is not sufficient to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Jinmiao Cai , Nianjuan Jiang , Xiaoguang Han , Kui Jia , Jiangbo Lu

Anomaly detection in surveillance videos is currently a challenge because of the diversity of possible events. We propose a deep convolutional neural network (CNN) that addresses this problem by learning a correspondence between common…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Trong Nguyen Nguyen , Jean Meunier

Online continuous action recognition has emerged as a critical research area due to its practical implications in real-world applications, such as human-computer interaction, healthcare, and robotics. Among various modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Rim Slama , Wael Rabah , Hazem Wannous

Action recognition is a key algorithmic part of emerging on-the-edge smart video surveillance and security systems. Skeleton-based action recognition is an attractive approach which, instead of using RGB pixel data, relies on human pose…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Justin Sanchez , Christopher Neff , Hamed Tabkhi

Convolutional neural networks (CNNs) are deep learning frameworks which are well-known for their notable performance in classification tasks. Hence, many skeleton-based action recognition and segmentation (SBARS) algorithms benefit from…

Machine Learning · Computer Science 2019-11-13 Babak Hosseini , Romain Montagne , Barbara Hammer

Human skeletons and RGB sequences are both widely-adopted input modalities for human action recognition. However, skeletons lack appearance features and color data suffer large amount of irrelevant depiction. To address this, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Runwei Ding , Yuhang Wen , Jinfu Liu , Nan Dai , Fanyang Meng , Mengyuan Liu