English
Related papers

Related papers: Bootstrapped Representation Learning for Skeleton-…

200 papers

Contrastive learning has gained significant attention in skeleton-based action recognition for its ability to learn robust representations from unlabeled data. However, existing methods rely on a single skeleton convention, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Mert Kiray , Alvaro Ritter , Nassir Navab , Benjamin Busam

Understanding human actions is a crucial problem for service robots. However, the general trend in Action Recognition is developing and testing these systems on structured datasets. That's why this work presents a practical Skeleton-based…

Robotics · Computer Science 2019-05-15 Cagatay Odabasi , Jewel Jose

Incorporating heterogeneous representations from different architectures has facilitated various vision tasks, e.g., some hybrid networks combine transformers and convolutions. However, complementarity between such heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Zhong-Yu Li , Bo-Wen Yin , Yongxiang Liu , Li Liu , Ming-Ming Cheng

We present a simple, yet effective, approach for self-supervised 3D human pose estimation. Unlike the prior work, we explore the temporal information next to the multi-view self-supervision. During training, we rely on triangulating 2D body…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Arij Bouazizi , Ulrich Kressel , Vasileios Belagiannis

In recent years, more and more attention has been paid to the learning of 3D human representation. However, the complexity of lots of hand-defined human body constraints and the absence of supervision data limit that the existing works…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Lu Wang , Xishuai Peng , S. Kevin Zhou

Current state-of-the-art approaches to skeleton-based action recognition are mostly based on recurrent neural networks (RNN). In this paper, we propose a novel convolutional neural networks (CNN) based framework for both action…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

Most self-supervised video representation learning approaches focus on action recognition. In contrast, in this paper we focus on self-supervised video learning for movie understanding and propose a novel hierarchical self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Fanyi Xiao , Kaustav Kundu , Joseph Tighe , Davide Modolo

The use of skeletal data allows deep learning models to perform action recognition efficiently and effectively. Herein, we believe that exploring this problem within the context of Continual Learning is crucial. While numerous studies focus…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Matteo Mosconi , Andriy Sorokin , Aniello Panariello , Angelo Porrello , Jacopo Bonato , Marco Cotogni , Luigi Sabetta , Simone Calderara , Rita Cucchiara

We present a new deep learning approach for real-time 3D human action recognition from skeletal data and apply it to develop a vision-based intelligent surveillance system. Given a skeleton sequence, we propose to encode skeleton poses and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Huy Hieu Pham , Houssam Salmane , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A Velastin

Gait recognition plays a vital role in human identification since gait is a unique biometric feature that can be perceived at a distance. Although existing gait recognition methods can learn gait features from gait sequences in different…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Yiqun Liu , Yi Zeng , Jian Pu , Hongming Shan , Peiyang He , Junping Zhang

Self-supervised learning has proved effective for skeleton-based human action understanding, which is an important yet challenging topic. Previous works mainly rely on contrastive learning or masked motion modeling paradigm to model the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jiahang Zhang , Lilang Lin , Jiaying Liu

View-invariant representation learning from egocentric (first-person, ego) and exocentric (third-person, exo) videos is a promising approach toward generalizing video understanding systems across multiple viewpoints. However, this area has…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Jungin Park , Jiyoung Lee , Kwanghoon Sohn

Deep neural networks require collecting and annotating large amounts of data to train successfully. In order to alleviate the annotation bottleneck, we propose a novel self-supervised representation learning approach for spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Alaaeldin El-Nouby , Shuangfei Zhai , Graham W. Taylor , Joshua M. Susskind

Skeleton-based human action recognition is a longstanding challenge due to its complex dynamics. Some fine-grain details of the dynamics play a vital role in classification. The existing work largely focuses on designing incremental neural…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ruijie Hou , Yanran Li , Ningyu Zhang , Yulin Zhou , Xiaosong Yang , Zhao Wang

Current state-of-the-art methods cast monocular 3D human pose estimation as a learning problem by training neural networks on large data sets of images and corresponding skeleton poses. In contrast, we propose an approach that can exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Simon Jenni , Paolo Favaro

We propose an approach to self-supervised representation learning based on maximizing mutual information between features extracted from multiple views of a shared context. For example, one could produce multiple views of a local…

Machine Learning · Computer Science 2019-07-09 Philip Bachman , R Devon Hjelm , William Buchwalter

Many leading self-supervised methods for unsupervised representation learning, in particular those for embedding image features, are built on variants of the instance discrimination task, whose optimization is known to be prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Daniel Shalam , Simon Korman

Machine learning approaches to spatiotemporal physical systems have primarily focused on next-frame prediction, with the goal of learning an accurate emulator for the system's evolution in time. However, these emulators are computationally…

Machine Learning · Computer Science 2026-03-16 Helen Qu , Rudy Morel , Michael McCabe , Alberto Bietti , François Lanusse , Shirley Ho , Yann LeCun

Self-Supervised Learning (SSL) methods operate on unlabeled data to learn robust representations useful for downstream tasks. Most SSL methods rely on augmentations obtained by transforming the 2D image pixel map. These augmentations ignore…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Sumukh Aithal , Anirudh Goyal , Alex Lamb , Yoshua Bengio , Michael Mozer

Human action recognition is a crucial task for intelligent robotics, particularly within the context of human-robot collaboration research. In self-supervised skeleton-based action recognition, the mask-based reconstruction paradigm learns…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Wei Wei , Shaojie Zhang , Yonghao Dang , Jianqin Yin