English
Related papers

Related papers: Learning by Aligning 2D Skeleton Sequences and Mul…

200 papers

The data-driven approach that learns an optimal representation of vision features like skeleton frames or RGB videos is currently a dominant paradigm for activity recognition. While great improvements have been achieved from existing single…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Bruce X. B. Yu , Yan Liu , Keith C. C. Chan

Self-supervised learning (SSL), which aims to learn meaningful prior representations from unlabeled data, has been proven effective for skeleton-based action understanding. Different from the image domain, skeleton data possesses sparser…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jiahang Zhang , Lilang Lin , Shuai Yang , Jiaying Liu

We address the problem of video representation learning without human-annotated labels. While previous efforts address the problem by designing novel self-supervised tasks using video data, the learned features are merely on a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Yunhui Liu , Wei Liu

Skeleton-based temporal action segmentation is a fundamental yet challenging task, playing a crucial role in enabling intelligent systems to perceive and respond to human activities. While fully-supervised methods achieve satisfactory…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hongsong Wang , Yiqin Shen , Pengbo Yan , Jie Gui

Current state-of-the-art solutions for motion capture from a single camera are optimization driven: they optimize the parameters of a 3D human model so that its re-projection matches measurements in the video (e.g. person segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Hsiao-Yu Fish Tung , Hsiao-Wei Tung , Ersin Yumer , Katerina Fragkiadaki

Current state-of-the-art methods cast monocular 3D human pose estimation as a learning problem by training neural networks on large data sets of images and corresponding skeleton poses. In contrast, we propose an approach that can exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Simon Jenni , Paolo Favaro

Self-supervised learning has demonstrated remarkable capability in representation learning for skeleton-based action recognition. Existing methods mainly focus on applying global data augmentation to generate different views of the skeleton…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Yujie Zhou , Haodong Duan , Anyi Rao , Bing Su , Jiaqi Wang

Semi-Supervised Learning can be more beneficial for the video domain compared to images because of its higher annotation cost and dimensionality. Besides, any video understanding task requires reasoning over both spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Ishan Rajendrakumar Dave , Mamshad Nayeem Rizve , Chen Chen , Mubarak Shah

Action recognition with 3D skeleton sequences is becoming popular due to its speed and robustness. The recently proposed Convolutional Neural Networks (CNN) based methods have shown good performance in learning spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Zhengyuan Yang , Yuncheng Li , Jianchao Yang , Jiebo Luo

In this paper, we address self-supervised representation learning from human skeletons for action recognition. Previous methods, which usually learn feature presentations from a single reconstruction task, may come across the overfitting…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Lilang Lin , Sijie Song , Wenhan Yan , Jiaying Liu

Self-attention learns pairwise interactions to model long-range dependencies, yielding great improvements for video action recognition. In this paper, we seek a deeper understanding of self-attention for temporal modeling in videos. We…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Bo He , Xitong Yang , Zuxuan Wu , Hao Chen , Ser-Nam Lim , Abhinav Shrivastava

Skeleton-based human action recognition has achieved a great interest in recent years, as skeleton data has been demonstrated to be robust to illumination changes, body scales, dynamic camera views, and complex background. Nevertheless, an…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Chiara Plizzari , Marco Cannici , Matteo Matteucci

Among the existing modalities for 3D action recognition, 3D flow has been poorly examined, although conveying rich motion information cues for human actions. Presumably, its susceptibility to noise renders it intractable, thus challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Vasileios Magoulianitis , Athanasios Psaltis

Multimodal human action understanding is a significant problem in computer vision, with the central challenge being the effective utilization of the complementarity among diverse modalities while maintaining model efficiency. However, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hongsong Wang , Heng Fei , Bingxuan Dai , Jie Gui

Deep learning has proved to be very effective in video action recognition. Video violence recognition attempts to learn the human multi-dynamic behaviours in more complex scenarios. In this work, we develop a method for video violence…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yukun Su , Guosheng Lin , Qingyao Wu

This paper presents a new framework for human action recognition from a 3D skeleton sequence. Previous studies do not fully utilize the temporal relationships between video segments in a human action. Some studies successfully used very…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Thao Minh Le , Nakamasa Inoue , Koichi Shinoda

It remains a challenge to efficiently extract spatialtemporal information from skeleton sequences for 3D human action recognition. Although most recent action recognition methods are based on Recurrent Neural Networks which present…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Hong Liu , Juanhui Tu , Mengyuan Liu

Fully supervised skeleton-based action recognition has achieved great progress with the blooming of deep learning techniques. However, these methods require sufficient labeled data which is not easy to obtain. In contrast, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Wenhan Wu , Yilei Hua , Ce Zheng , Shiqian Wu , Chen Chen , Aidong Lu

Diffusion models are just at a tipping point for image super-resolution task. Nevertheless, it is not trivial to capitalize on diffusion models for video super-resolution which necessitates not only the preservation of visual appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhikai Chen , Fuchen Long , Zhaofan Qiu , Ting Yao , Wengang Zhou , Jiebo Luo , Tao Mei

Skeleton-based action recognition methods are limited by the semantic extraction of spatio-temporal skeletal maps. However, current methods have difficulty in effectively combining features from both temporal and spatial graph dimensions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Shengqin Wang , Yongji Zhang , Minghao Zhao , Hong Qi , Kai Wang , Fenglin Wei , Yu Jiang