English
Related papers

Related papers: Skeleton-Snippet Contrastive Learning with Multisc…

200 papers

Semi-supervised video action recognition tends to enable deep neural networks to achieve remarkable performance even with very limited labeled data. However, existing methods are mainly transferred from current image-based methods (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Junfei Xiao , Longlong Jing , Lin Zhang , Ju He , Qi She , Zongwei Zhou , Alan Yuille , Yingwei Li

This paper propose a novel dictionary learning approach to detect event action using skeletal information extracted from RGBD video. The event action is represented as several latent atoms and composed of latent spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Hao Xing , Yuxuan Xue , Mingchuan Zhou , Darius Burschka

This paper presents a novel end-to-end method for the problem of skeleton-based unsupervised human action recognition. We propose a new architecture with a convolutional autoencoder that uses graph Laplacian regularization to model the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Giancarlo Paoletti , Jacopo Cavazza , Cigdem Beyan , Alessio Del Bue

The ability to identify and temporally segment fine-grained actions in motion capture sequences is crucial for applications in human movement analysis. Motion capture is typically performed with optical or inertial measurement systems,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Benjamin Filtjens , Bart Vanrumste , Peter Slaets

Skeleton-based action recognition receives the attention of many researchers as it is robust to viewpoint and illumination changes, and its processing is much more efficient than the processing of video frames. With the emergence of deep…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Ozge Oztimur Karadag

Facial action unit (AU) detection, aiming to classify AU present in the facial image, has long suffered from insufficient AU annotations. In this paper, we aim to mitigate this data scarcity issue by learning AU representations from a large…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Yong Li , Shiguang Shan

Contrastive learning has been proven beneficial for self-supervised skeleton-based action recognition. Most contrastive learning methods utilize carefully designed augmentations to generate different movement patterns of skeletons for the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Jiahang Zhang , Lilang Lin , Jiaying Liu

We propose a supervised contrastive learning framework for video representation learning that leverages temporally global context. We introduce a video to image aggregation strategy that spatially arranges multiple frames from each video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Shaif Chowdhury , Mushfika Rahman , Greg Hamerly

How can we teach a computer to recognize 10,000 different actions? Deep learning has evolved from supervised and unsupervised to self-supervised approaches. In this paper, we present a new contrastive learning-based framework for decision…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Mindi Ruan , Xiangxu Yu , Na Zhang , Chuanbo Hu , Shuo Wang , Xin Li

Recently, there have been efforts to improve the performance in sign language recognition by designing self-supervised learning methods. However, these methods capture limited information from sign pose data in a frame-wise learning manner,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Weichao Zhao , Wengang Zhou , Hezhen Hu , Min Wang , Houqiang Li

Due to the availability of large-scale skeleton datasets, 3D human action recognition has recently called the attention of computer vision community. Many works have focused on encoding skeleton data as skeleton image representations based…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Carlos Caetano , Jessica Sena , François Brémond , Jefersson A. dos Santos , William Robson Schwartz

This paper presents a new method for 3D action recognition with skeleton sequences (i.e., 3D trajectories of human skeleton joints). The proposed method first transforms each skeleton sequence into three clips each consisting of several…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Qiuhong Ke , Mohammed Bennamoun , Senjian An , Ferdous Sohel , Farid Boussaid

Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Yuanyi Zhong , Haoran Tang , Junkun Chen , Jian Peng , Yu-Xiong Wang

We address the problem of video representation learning without human-annotated labels. While previous efforts address the problem by designing novel self-supervised tasks using video data, the learned features are merely on a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Yunhui Liu , Wei Liu

Collecting labeled data for the task of semantic segmentation is expensive and time-consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural Network (CNN) based semantic segmentation approaches have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Xiangyun Zhao , Raviteja Vemulapalli , Philip Mansfield , Boqing Gong , Bradley Green , Lior Shapira , Ying Wu

Deep learning techniques are being used in skeleton based action recognition tasks and outstanding performance has been reported. Compared with RNN based methods which tend to overemphasize temporal information, CNN-based approaches can…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Zewei Ding , Pichao Wang , Philip O. Ogunbona , Wanqing Li

As a pioneering work, PointContrast conducts unsupervised 3D representation learning via leveraging contrastive learning over raw RGB-D frames and proves its effectiveness on various downstream tasks. However, the trend of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Xiaoyang Wu , Xin Wen , Xihui Liu , Hengshuang Zhao

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zhenyuan Lu

Skeleton-based action recognition has recently made significant progress. However, data imbalance is still a great challenge in real-world scenarios. The performance of current action recognition algorithms declines sharply when training…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Hongda Liu , Yunlong Wang , Min Ren , Junxing Hu , Zhengquan Luo , Guangqi Hou , Zhenan Sun

Semi-Supervised Learning (SSL) has shown tremendous potential to improve the predictive performance of deep learning models when annotations are hard to obtain. However, the application of SSL has so far been mainly studied in the context…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Ankit Singh , Efstratios Gavves , Cees G. M. Snoek , Hilde Kuehne