English
Related papers

Related papers: Deep representation learning for human motion pred…

200 papers

We propose novel dynamic multiscale graph neural networks (DMGNN) to predict 3D skeleton-based human motions. The core idea of DMGNN is to use a multiscale graph to comprehensively model the internal relations of a human body for motion…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Maosen Li , Siheng Chen , Yangheng Zhao , Ya Zhang , Yanfeng Wang , Qi Tian

In this paper, we are interested in self-supervised learning the motion cues in videos using dynamic motion filters for a better motion representation to finally boost human action recognition in particular. Thus far, the vision community…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Ali Diba , Vivek Sharma , Luc Van Gool , Rainer Stiefelhagen

Human motion prediction is a challenging task due to the stochasticity and aperiodicity of future poses. Recently, graph convolutional network has been proven to be very effective to learn dynamic relations among pose joints, which is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Lingwei Dang , Yongwei Nie , Chengjiang Long , Qing Zhang , Guiqing Li

Graph Convolutional Networks (GCN) which typically follows a neural message passing framework to model dependencies among skeletal joints has achieved high success in skeleton-based human motion prediction task. Nevertheless, how to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Xinshun Wang , Wanying Zhang , Can Wang , Yuan Gao , Mengyuan Liu

Predicting and understanding human motion dynamics has many applications, such as motion synthesis, augmented reality, security, and autonomous vehicles. Due to the recent success of generative adversarial networks (GAN), there has been…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Emad Barsoum , John Kender , Zicheng Liu

End-to-end deep representation learning has achieved remarkable accuracy for monocular 3D human pose estimation, yet these models may fail for unseen poses with limited and fixed training data. This paper proposes a novel data augmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Shichao Li , Lei Ke , Kevin Pratama , Yu-Wing Tai , Chi-Keung Tang , Kwang-Ting Cheng

Motion analysis is used in computer vision to understand the behaviour of moving objects in sequences of images. Optimising the interpretation of dynamic biological systems requires accurate and precise motion tracking as well as efficient…

Human motion recovery for real-world interaction demands both precise action details and metric-scale trajectories. Recovering absolute human pose from monocular input presents a viable solution, but faces two main challenges: (1) models'…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zhumei Wang , Zechen Hu , Ruoxi Guo , Huaijin Pi , Ziyong Feng , Liang Zhang , Mingtao Pei , Siyuan Huang

Predicting human motion in unstructured and dynamic environments is difficult as humans naturally exhibit complex behaviors that can change drastically from one environment to the next. In order to alleviate this issue, we propose to encode…

Robotics · Computer Science 2019-07-01 Philipp Kratzer , Marc Toussaint , Jim Mainprice

Motion is an important signal for agents in dynamic environments, but learning to represent motion from unlabeled video is a difficult and underconstrained problem. We propose a model of motion based on elementary group properties of…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Andrew Jaegle , Stephen Phillips , Daphne Ippolito , Kostas Daniilidis

Various neural network based methods are capable of anticipating human body motions from data for a short period of time. What these methods lack are the interpretability and explainability of the network and its results. We propose to use…

Machine Learning · Computer Science 2019-12-17 Kristina Enes , Hassan Errami , Moritz Wolter , Tim Krake , Bernhard Eberhardt , Andreas Weber , Jörg Zimmermann

We propose a novel framework for multi-person 3D motion trajectory prediction. Our key observation is that a human's action and behaviors may highly depend on the other persons around. Thus, instead of predicting each human pose trajectory…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Jiashun Wang , Huazhe Xu , Medhini Narasimhan , Xiaolong Wang

While great strides have been made in using deep learning algorithms to solve supervised learning tasks, the problem of unsupervised learning - leveraging unlabeled examples to learn about the structure of a domain - remains a difficult…

Machine Learning · Computer Science 2017-03-02 William Lotter , Gabriel Kreiman , David Cox

The attention mechanism provides a sequential prediction framework for learning spatial models with enhanced implicit temporal consistency. In this work, we show a systematic design (from 2D to 3D) for how conventional networks and other…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Ruixu Liu , Ju Shen , He Wang , Chen Chen , Sen-ching Cheung , Vijayan K. Asari

Despite the impressive results achieved by deep learning based 3D reconstruction, the techniques of directly learning to model 4D human captures with detailed geometry have been less studied. This work presents a novel framework that can…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Boyan Jiang , Yinda Zhang , Xingkui Wei , Xiangyang Xue , Yanwei Fu

We propose a deep videorealistic 3D human character model displaying highly realistic shape, motion, and dynamic appearance learned in a new weakly supervised way from multi-view imagery. In contrast to previous work, our controllable 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Marc Habermann , Lingjie Liu , Weipeng Xu , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt

Learning general image representations has proven key to the success of many computer vision tasks. For example, many approaches to image understanding problems rely on deep networks that were initially trained on ImageNet, mostly because…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Helge Rhodin , Victor Constantin , Isinsu Katircioglu , Mathieu Salzmann , Pascal Fua

Modeling and prediction of human motion dynamics has long been a challenging problem in computer vision, and most existing methods rely on the end-to-end supervised training of various architectures of recurrent neural networks. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Borui Wang , Ehsan Adeli , Hsu-kuang Chiu , De-An Huang , Juan Carlos Niebles

Pose prediction is to predict future poses given a window of previous poses. In this paper, we propose a new problem that predicts poses using 3D joint coordinate sequences. Different from the traditional pose prediction based on Mocap…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Xiaoli Liu , Jianqin Yin , Huaping Liu , Yilong Yin

The unsupervised Pretraining method has been widely used in aiding human action recognition. However, existing methods focus on reconstructing the already present frames rather than generating frames which happen in future.In this paper, We…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Yu Runsheng , Shi Zhenyu , Ma Qiongxiong , Qing Laiyun