English
Related papers

Related papers: A Generically Contrastive Spatiotemporal Represent…

200 papers

In this paper, we address self-supervised representation learning from human skeletons for action recognition. Previous methods, which usually learn feature presentations from a single reconstruction task, may come across the overfitting…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Lilang Lin , Sijie Song , Wenhan Yan , Jiaying Liu

Skeleton-based Human Activity Recognition has achieved great interest in recent years as skeleton data has demonstrated being robust to illumination changes, body scales, dynamic camera views, and complex background. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Chiara Plizzari , Marco Cannici , Matteo Matteucci

Skeleton-based action recognition aims to project skeleton sequences to action categories, where skeleton sequences are derived from multiple forms of pre-detected points. Compared with earlier methods that focus on exploring single-form…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Xuanhan Wang , Yan Dai , Lianli Gao , Jingkuan Song

Deep learning techniques are being used in skeleton based action recognition tasks and outstanding performance has been reported. Compared with RNN based methods which tend to overemphasize temporal information, CNN-based approaches can…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Zewei Ding , Pichao Wang , Philip O. Ogunbona , Wanqing Li

Self-supervised learning has proved effective for skeleton-based human action understanding, which is an important yet challenging topic. Previous works mainly rely on contrastive learning or masked motion modeling paradigm to model the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jiahang Zhang , Lilang Lin , Jiaying Liu

This paper targets unsupervised skeleton-based action representation learning and proposes a new Hierarchical Contrast (HiCo) framework. Different from the existing contrastive-based solutions that typically represent an input skeleton…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Jianfeng Dong , Shengkai Sun , Zhonglin Liu , Shujie Chen , Baolong Liu , Xun Wang

Self-supervised learning has demonstrated remarkable capability in representation learning for skeleton-based action recognition. Existing methods mainly focus on applying global data augmentation to generate different views of the skeleton…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Yujie Zhou , Haodong Duan , Anyi Rao , Bing Su , Jiaqi Wang

Human skeleton, as a compact representation of human action, has received increasing attention in recent years. Many skeleton-based action recognition methods adopt graph convolutional networks (GCN) to extract features on top of human…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Haodong Duan , Yue Zhao , Kai Chen , Dahua Lin , Bo Dai

Human action recognition aims at classifying the category of human action from a segment of a video. Recently, people have dived into designing GCN-based models to extract features from skeletons for performing this task, because skeleton…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Huanyu Zhou , Qingjie Liu , Yunhong Wang

Despite the success of fully-supervised human skeleton sequence modeling, utilizing self-supervised pre-training for skeleton sequence representation learning has been an active field because acquiring task-specific skeleton annotations at…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yuxiao Chen , Long Zhao , Jianbo Yuan , Yu Tian , Zhaoyang Xia , Shijie Geng , Ligong Han , Dimitris N. Metaxas

Self-supervised pre-training paradigms have been extensively explored in the field of skeleton-based action recognition. In particular, methods based on masked prediction have pushed the performance of pre-training to a new height. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Ruizhuo Xu , Linzhi Huang , Mei Wang , Jiani Hu , Weihong Deng

Previous work on action representation learning focused on global representations for short video clips. In contrast, many practical applications, such as video alignment, strongly demand learning the intensive representation of long…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Minghao Chen , Renbo Tu , Chenxi Huang , Yuqi Lin , Boxi Wu , Deng Cai

Deep learning is ubiquitous across many areas areas of computer vision. It often requires large scale datasets for training before being fine-tuned on small-to-medium scale problems. Activity, or, in other words, action recognition, is one…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Yusuf Tas , Piotr Koniusz

Learning socially-aware motion representations is at the core of recent advances in multi-agent problems, such as human motion forecasting and robot navigation in crowds. Despite promising progress, existing representations learned with…

Machine Learning · Computer Science 2021-08-23 Yuejiang Liu , Qi Yan , Alexandre Alahi

Human skeleton joints are popular for action analysis since they can be easily extracted from videos to discard background noises. However, current skeleton representations do not fully benefit from machine learning with CNNs. We propose…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Jian Liu , Naveed Akhtar , Ajmal Mian

This paper presents a new method for 3D action recognition with skeleton sequences (i.e., 3D trajectories of human skeleton joints). The proposed method first transforms each skeleton sequence into three clips each consisting of several…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Qiuhong Ke , Mohammed Bennamoun , Senjian An , Ferdous Sohel , Farid Boussaid

Skeleton-based action recognition is an important task that requires the adequate understanding of movement characteristics of a human action from the given skeleton sequence. Recent studies have shown that exploring spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Chenyang Si , Wentao Chen , Wei Wang , Liang Wang , Tieniu Tan

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Recent methods based on 3D skeleton data have achieved outstanding performance due to its conciseness, robustness, and view-independent representation. With the development of deep learning, Convolutional Neural Networks (CNN) and Long…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Chuankun Li , Pichao Wang , Shuang Wang , Yonghong Hou , Wanqing Li

Contrastive representation learning has proven to be an effective self-supervised learning method. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as positives that should be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault , Stéphane Canu