English
Related papers

Related papers: Skeleton Sequence and RGB Frame Based Multi-Modali…

200 papers

Online action recognition is an important task for human centered intelligent services, which is still difficult to achieve due to the varieties and uncertainties of spatial and temporal scales of human actions. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Guoliang Liu , Qinghui Zhang , Yichao Cao , Junwei Li , Hao Wu , Guohui Tian

Skeleton-based action recognition has made great progress recently, but many problems still remain unsolved. For example, most of the previous methods model the representations of skeleton sequences without abundant spatial structure…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chenyang Si , Ya Jing , Wei Wang , Liang Wang , Tieniu Tan

In this paper, we proposed a effective but extensible residual one-dimensional convolution neural network as base network, based on the this network, we proposed four subnets to explore the features of skeleton sequences from each aspect.…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Yangyang Xu , Lei Wang

Skeleton-based action recognition has attracted research attentions in recent years. One common drawback in currently popular skeleton-based human action recognition methods is that the sparse skeleton information alone is not sufficient to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Jinmiao Cai , Nianjuan Jiang , Xiaoguang Han , Kui Jia , Jiangbo Lu

How to effectively fuse cross-modal information is the key problem for RGB-D salient object detection. Early fusion and the result fusion schemes fuse RGB and depth information at the input and output stages, respectively, hence incur the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Nian Liu , Ni Zhang , Ling Shao , Junwei Han

Moving Object Detection (MOD) is a critical vision task for successfully achieving safe autonomous driving. Despite plausible results of deep learning methods, most existing approaches are only frame-based and may fail to reach reasonable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Zhuyun Zhou , Zongwei Wu , Rémi Boutteau , Fan Yang , Cédric Demonceaux , Dominique Ginhac

Recently, the RGB images and point clouds fusion methods have been proposed to jointly estimate 2D optical flow and 3D scene flow. However, as both conventional RGB cameras and LiDAR sensors adopt a frame-based data acquisition mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zhexiong Wan , Yuxin Mao , Jing Zhang , Yuchao Dai

Single modality action recognition on RGB or depth sequences has been extensively explored recently. It is generally accepted that each of these two modalities has different strengths and limitations for the task of action recognition.…

Computer Vision and Pattern Recognition · Computer Science 2016-12-28 Amir Shahroudy , Tian-Tsong Ng , Yihong Gong , Gang Wang

Skeleton-based action recognition methods are limited by the semantic extraction of spatio-temporal skeletal maps. However, current methods have difficulty in effectively combining features from both temporal and spatial graph dimensions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Shengqin Wang , Yongji Zhang , Minghao Zhao , Hong Qi , Kai Wang , Fenglin Wei , Yu Jiang

Providing machines with the ability to recognize objects like humans has always been one of the primary goals of machine vision. The introduction of RGB-D cameras has paved the way for a significant leap forward in this direction thanks to…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Mohammad Reza Loghmani , Mirco Planamente , Barbara Caputo , Markus Vincze

This paper presents an image classification based approach for skeleton-based video action recognition problem. Firstly, A dataset independent translation-scale invariant image mapping method is proposed, which transformes the skeleton…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Bo Li , Mingyi He , Xuelian Cheng , Yucheng Chen , Yuchao Dai

In this paper, we study the problem of one-shot skeleton-based action recognition, which poses unique challenges in learning transferable representation from base classes to novel classes, particularly for fine-grained actions. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Tailin Chen , Desen Zhou , Jian Wang , Shidong Wang , Qian He , Chuanyang Hu , Errui Ding , Yu Guan , Xuming He

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Zhangyong Tang , Tianyang Xu , Hui Li , Xiao-Jun Wu , Xuefeng Zhu , Josef Kittler

In this study, we propose a novel RGB-T tracking framework by jointly modeling both appearance and motion cues. First, to obtain a robust appearance model, we develop a novel late fusion method to infer the fusion weight maps of both RGB…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Pengyu Zhang , Jie Zhao , Dong Wang , Huchuan Lu , Xiaoyun Yang

In recent years, graph convolutional networks (GCNs) play an increasingly critical role in skeleton-based human action recognition. However, most GCN-based methods still have two main limitations: 1) They only consider the motion…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Zhigang Tu , Jiaxu Zhang , Hongyan Li , Yujin Chen , Junsong Yuan

This paper propose a novel dictionary learning approach to detect event action using skeletal information extracted from RGBD video. The event action is represented as several latent atoms and composed of latent spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Hao Xing , Yuxuan Xue , Mingchuan Zhou , Darius Burschka

Due to the availability of large-scale skeleton datasets, 3D human action recognition has recently called the attention of computer vision community. Many works have focused on encoding skeleton data as skeleton image representations based…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Carlos Caetano , Jessica Sena , François Brémond , Jefersson A. dos Santos , William Robson Schwartz

Current methods for skeleton-based human action recognition usually work with complete skeletons. However, in real scenarios, it is inevitable to capture incomplete or noisy skeletons, which could significantly deteriorate the performance…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Yi-Fan Song , Zhang Zhang , Caifeng Shan , Liang Wang

Object tracking based on the fusion of visible and thermal im-ages, known as RGB-T tracking, has gained increasing atten-tion from researchers in recent years. How to achieve a more comprehensive fusion of information from the two…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Yang Luo , Xiqing Guo , Hui Feng , Lei Ao

Human action recognition is regarded as a key cornerstone in domains such as surveillance or video understanding. Despite recent progress in the development of end-to-end solutions for video-based action recognition, achieving…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Jiawei Chen , Jenson Hsiao , Chiu Man Ho