English
Related papers

Related papers: Convolutional Autoencoders for Human Motion Infill…

200 papers

This work addresses the problem of generating 3D holistic body motions from human speech. Given a speech recording, we synthesize sequences of 3D body poses, hand gestures, and facial expressions that are realistic and diverse. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Hongwei Yi , Hualin Liang , Yifei Liu , Qiong Cao , Yandong Wen , Timo Bolkart , Dacheng Tao , Michael J. Black

Recent advances in deep learning have enabled the generation of videos from textual descriptions as well as the prediction of future sequences from input videos. Similarly, in human motion modeling, motions can be generated from text or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Masato Soga , Ryuki Takebayashi

Human motion prediction is a stochastic process: Given an observed sequence of poses, multiple future motions are plausible. Existing approaches to modeling this stochasticity typically combine a random noise vector with information about…

This paper introduces an unsupervised framework to extract semantically rich features for video representation. Inspired by how the human visual system groups objects based on motion cues, we propose a deep convolutional neural network that…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Xunyu Lin , Victor Campos , Xavier Giro-i-Nieto , Jordi Torres , Cristian Canton Ferrer

We propose an efficient approach to exploiting motion information from consecutive frames of a video sequence to recover the 3D pose of people. Previous approaches typically compute candidate poses in individual frames and then link them in…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Bugra Tekin , Artem Rozantsev , Vincent Lepetit , Pascal Fua

We present a new end-to-end learning framework to obtain detailed and spatially coherent reconstructions of multiple people from a single image. Existing multi-person methods suffer from two main drawbacks: they are often model-based and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Armin Mustafa , Akin Caliskan , Lourdes Agapito , Adrian Hilton

We present a convolutional autoencoder that enables high fidelity volumetric reconstructions of human performance to be captured from multi-view video comprising only a small set of camera views. Our method yields similar end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Andrew Gilbert , Marco Volino , John Collomosse , Adrian Hilton

A deep generative model that describes human motions can benefit a wide range of fundamental computer vision and graphics tasks, such as providing robustness to video-based human pose estimation, predicting complete body movements for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Jiaman Li , Ruben Villegas , Duygu Ceylan , Jimei Yang , Zhengfei Kuang , Hao Li , Yajie Zhao

Predicting high-fidelity future human poses, from a historically observed sequence, is decisive for intelligent robots to interact with humans. Deep end-to-end learning approaches, which typically train a generic pre-trained model on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Qiongjie Cui , Huaijiang Sun , Jianfeng Lu , Bin Li , Weiqing Li

Existing marker-less motion capture methods often assume known backgrounds, static cameras, and sequence specific motion priors, which narrows its application scenarios. Here we propose a fully automatic method that given multi-view video,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Yinghao Huang , Federica Bogo , Christoph Lassner , Angjoo Kanazawa , Peter V. Gehler , Ijaz Akhter , Michael J. Black

In this paper, we propose a novel end-to-end architecture that could generate a variety of plausible video sequences correlating two given discontinuous frames. Our work is inspired by the human ability of inference. Specifically, given two…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Weimian Li , Baoyang Chen , Wenmin Wang

Character image animation, which synthesizes videos of reference characters driven by pose sequences, has advanced rapidly but remains largely limited to single-human settings. Existing methods struggle to generalize to multi-humanoid…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xirui Hu , Yanbo Ding , Jiahao Wang , Tingting Shi , Yali Wang , Guo Zhi Zhi , Weizhan Zhang

In the paper, we propose an adaptive data-driven model-based approach for filling the gaps in time series. The approach is based on the automated evolutionary identification of the optimal structure for a composite data-driven model. It…

Machine Learning · Computer Science 2021-07-21 Mikhail Sarafanov , Nikolay O. Nikitin , Anna V. Kalyuzhnaya

We present a unified perspective on tackling various human-centric video tasks by learning human motion representations from large-scale and heterogeneous data resources. Specifically, we propose a pretraining stage in which a motion…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Wentao Zhu , Xiaoxuan Ma , Zhaoyang Liu , Libin Liu , Wayne Wu , Yizhou Wang

The motion of picking up and placing an object in 3D space is full of subtle detail. Typically these motions are formed from the same constraints, optimizing for swiftness, energy efficiency, as well as physiological limits. Yet, even for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Connor Daly , Yuzuko Nakamura , Tobias Ritschel

Existing Graph Convolutional Networks to achieve human motion prediction largely adopt a one-step scheme, which output the prediction straight from history input, failing to exploit human motion patterns. We observe that human motions have…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Xinshun Wang , Qiongjie Cui , Chen Chen , Shen Zhao , Mengyuan Liu

Action recognition is a relatively established task, where givenan input sequence of human motion, the goal is to predict its ac-tion category. This paper, on the other hand, considers a relativelynew problem, which could be thought of as…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Chuan Guo , Xinxin Zuo , Sen Wang , Shihao Zou , Qingyao Sun , Annan Deng , Minglun Gong , Li Cheng

In this paper a joint optimization technique has been proposed for coupled autoencoder which learns the autoencoder weights and coupling map (between source and target) simultaneously. The technique is applicable to any transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Kavya Gupta , Brojeshwar Bhowmick , Angshul Majumdar

We propose a viewpoint invariant model for 3D human pose estimation from a single depth image. To achieve this, our discriminative model embeds local regions into a learned viewpoint invariant feature space. Formulated as a multi-task…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Albert Haque , Boya Peng , Zelun Luo , Alexandre Alahi , Serena Yeung , Li Fei-Fei

Human motion generation aims to generate natural human pose sequences and shows immense potential for real-world applications. Substantial progress has been made recently in motion data collection technologies and generation methods, laying…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Wentao Zhu , Xiaoxuan Ma , Dongwoo Ro , Hai Ci , Jinlu Zhang , Jiaxin Shi , Feng Gao , Qi Tian , Yizhou Wang