English
Related papers

Related papers: Learning by Aligning 2D Skeleton Sequences and Mul…

200 papers

The recovery of 3D human mesh from monocular images has significantly been developed in recent years. However, existing models usually ignore spatial and temporal information, which might lead to mesh and image misalignment and temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Wei Yao , Hongwen Zhang , Yunlian Sun , Jinhui Tang

Person re-identification (Re-ID) via gait features within 3D skeleton sequences is a newly-emerging topic with several advantages. Existing solutions either rely on hand-crafted descriptors or supervised gait representation learning. This…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Haocong Rao , Siqi Wang , Xiping Hu , Mingkui Tan , Yi Guo , Jun Cheng , Xinwang Liu , Bin Hu

Recent advances in large-scale pretrained vision models have demonstrated impressive capabilities across a wide range of downstream tasks, including cross-modal and multi-modal scenarios. However, their direct application to 3D human…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Siyuan Yang , Jun Liu , Hao Cheng , Chong Wang , Shijian Lu , Hedvig Kjellstrom , Weisi Lin , Alex C. Kot

Understanding temporal dynamics of video is an essential aspect of learning better video representations. Recently, transformer-based architectural designs have been extensively explored for video tasks due to their capability to capture…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Sukmin Yun , Jaehyung Kim , Dongyoon Han , Hwanjun Song , Jung-Woo Ha , Jinwoo Shin

The raising availability of 3D cameras and dramatic improvement of computer vision algorithms in the recent decade, accelerated the research of automatic movement assessment solutions. Such solutions can be implemented at home, using…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Tal Hakim

Anticipating human actions is an important task that needs to be addressed for the development of reliable intelligent agents, such as self-driving cars or robot assistants. While the ability to make future predictions with high accuracy is…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Olga Zatsarynna , Yazan Abu Farha , Juergen Gall

Current self-supervised approaches for skeleton action representation learning often focus on constrained scenarios, where videos and skeleton data are recorded in laboratory settings. When dealing with estimated skeleton data in real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Di Yang , Yaohui Wang , Antitza Dantcheva , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

We present a new deep learning approach for real-time 3D human action recognition from skeletal data and apply it to develop a vision-based intelligent surveillance system. Given a skeleton sequence, we propose to encode skeleton poses and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Huy Hieu Pham , Houssam Salmane , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A Velastin

Detecting and matching robust viewpoint-invariant keypoints is critical for visual SLAM and Structure-from-Motion. State-of-the-art learning-based methods generate training samples via homography adaptation to create 2D synthetic views with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Jiexiong Tang , Rares Ambrus , Vitor Guizilini , Sudeep Pillai , Hanme Kim , Patric Jensfelt , Adrien Gaidon

We propose a novel Transformer-based architecture for the task of generative modelling of 3D human motion. Previous work commonly relies on RNN-based models considering shorter forecast horizons reaching a stationary and often implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Emre Aksan , Manuel Kaufmann , Peng Cao , Otmar Hilliges

Due to the fast processing-speed and robustness it can achieve, skeleton-based action recognition has recently received the attention of the computer vision community. The recent Convolutional Neural Network (CNN)-based methods have shown…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Han Chen , Yifan Jiang , Hanseok Ko

Recent self-supervised advances in medical computer vision exploit global and local anatomical self-similarity for pretraining prior to downstream tasks such as segmentation. However, current methods assume i.i.d. image acquisition, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Mengwei Ren , Neel Dey , Martin A. Styner , Kelly Botteron , Guido Gerig

Skeleton-based human action recognition has attracted increasing attention in recent years. However, most of the existing works focus on supervised learning which requiring a large number of annotated action sequences that are often…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Siyuan Yang , Jun Liu , Shijian Lu , Meng Hwa Er , Alex C. Kot

Self-supervised representation learning for human action recognition has developed rapidly in recent years. Most of the existing works are based on skeleton data while using a multi-modality setup. These works overlooked the differences in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Yiping Wei , Kunyu Peng , Alina Roitberg , Jiaming Zhang , Junwei Zheng , Ruiping Liu , Yufan Chen , Kailun Yang , Rainer Stiefelhagen

In low-level video analyses, effective representations are important to derive the correspondences between video frames. These representations have been learned in a self-supervised fashion from unlabeled images or videos, using carefully…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Rui Li , Dong Liu

Video moment retrieval aims to search the moment most relevant to a given language query. However, most existing methods in this community often require temporal boundary annotations which are expensive and time-consuming to label. Hence…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Ding Li , Rui Wu , Yongqiang Tang , Zhizhong Zhang , Wensheng Zhang

We propose a self-supervised learning approach for videos that learns representations of both the RGB frames and the accompanying audio without human supervision. In contrast to images that capture the static scene appearance, videos also…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Simon Jenni , Alexander Black , John Collomosse

By leveraging temporal dependency in video sequences, multi-frame human pose estimation algorithms have demonstrated remarkable results in complicated situations, such as occlusion, motion blur, and video defocus. These algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jijie He , Wenwu Yang

We propose a self-supervised learning method to jointly reason about spatial and temporal context for video recognition. Recent self-supervised approaches have used spatial context [9, 34] as well as temporal coherency [32] but a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Unaiza Ahsan , Rishi Madhok , Irfan Essa

Skeleton-based human action recognition has recently drawn increasing attentions with the availability of large-scale skeleton datasets. The most crucial factors for this task lie in two aspects: the intra-frame representation for joint…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu