English
Related papers

Related papers: Human Motion Prediction, Reconstruction, and Gener…

200 papers

Human pose estimation is a very active research field, stimulated by its important applications in robotics, entertainment or health and sports sciences, among others. Advances in convolutional networks triggered noticeable improvements in…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Yann Desmarais , Denis Mottet , Pierre Slangen , Philippe Montesinos

Text-driven human motion generation in computer vision is both significant and challenging. However, current methods are limited to producing either deterministic or imprecise motion sequences, failing to effectively control the temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Yin Wang , Zhiying Leng , Frederick W. B. Li , Shun-Cheng Wu , Xiaohui Liang

Generative models of 3D human motion are often restricted to a small number of activities and can therefore not generalize well to novel movements or applications. In this work we propose a deep learning framework for human motion capture…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Judith Bütepage , Michael Black , Danica Kragic , Hedvig Kjellström

Robotic navigation through crowds or herds requires the ability to both predict the future motion of nearby individuals and understand how these predictions might change in response to a robot's future action. State of the art trajectory…

Artificial Intelligence · Computer Science 2020-01-29 Stuart Eiffert , Salah Sukkarieh

The most popular type of devices used to track a user's posture in a virtual reality experience consists of a head-mounted display and two controllers held in both hands. However, due to the limited number of tracking sensors (three in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Myungjin Shin , Dohae Lee , In-Kwon Lee

3D Human Motion Indexing and Retrieval is an interesting problem due to the rise of several data-driven applications aimed at analyzing and/or re-utilizing 3D human skeletal data, such as data-driven animation, analysis of sports…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Neeraj Battan , Abbhinav Venkat , Avinash Sharma

Generating 3D human motions from text is a challenging yet valuable task. The key aspects of this task are ensuring text-motion consistency and achieving generation diversity. Although recent advancements have enabled the generation of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zheng Qin , Yabing Wang , Minghui Yang , Sanping Zhou , Ming Yang , Le Wang

In this paper, we tackle the problem of human motion transfer, where we synthesize novel motion video for a target person that imitates the movement from a reference video. It is a video-to-video translation task in which the estimated…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Jian Ren , Menglei Chai , Sergey Tulyakov , Chen Fang , Xiaohui Shen , Jianchao Yang

The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications. Previous approaches for scene-aware motion synthesis are constrained by pre-defined target objects or positions and thus…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jingbo Wang , Yu Rong , Jingyuan Liu , Sijie Yan , Dahua Lin , Bo Dai

Generating and representing human behavior are of major importance for various computer vision applications. Commonly, human video synthesis represents behavior as sequences of postures while directly predicting their likely progressions or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Andreas Blattmann , Timo Milbich , Michael Dorkenwald , Björn Ommer

Derived from rapid advances in computer vision and machine learning, video analysis tasks have been moving from inferring the present state to predicting the future state. Vision-based action recognition and prediction from videos are such…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Yu Kong , Yun Fu

Digital human motion synthesis is a vibrant research field with applications in movies, AR/VR, and video games. Whereas methods were proposed to generate natural and realistic human motions, most only focus on modeling humans and largely…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Quanzhou Li , Jingbo Wang , Chen Change Loy , Bo Dai

Synthesizing realistic videos of humans using neural networks has been a popular alternative to the conventional graphics-based rendering pipeline due to its high efficiency. Existing works typically formulate this as an image-to-image…

Synthesis of long-term human motion skeleton sequences is essential to aid human-centric video generation with potential applications in Augmented Reality, 3D character animations, pedestrian trajectory prediction, etc. Long-term human…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Neeraj Battan , Yudhik Agrawal , Veeravalli Saisooryarao , Aman Goel , Avinash Sharma

Human motion prediction is an important and challenging topic that has promising prospects in efficient and safe human-robot-interaction systems. Currently, the majority of the human motion prediction algorithms are based on deterministic…

Robotics · Computer Science 2021-07-15 Jie Xu , Xingyu Chen , Xuguang Lan , Nanning Zheng

Recent advancements in human video synthesis have enabled the generation of high-quality videos through the application of stable diffusion models. However, existing methods predominantly concentrate on animating solely the human element…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Jinlin Liu , Kai Yu , Mengyang Feng , Xiefan Guo , Miaomiao Cui

Smooth and seamless robot navigation while interacting with humans depends on predicting human movements. Forecasting such human dynamics often involves modeling human trajectories (global motion) or detailed body joint movements (local…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Vida Adeli , Ehsan Adeli , Ian Reid , Juan Carlos Niebles , Hamid Rezatofighi

Lightweight, controllable, and physically plausible human motion synthesis is crucial for animation, virtual reality, robotics, and human-computer interaction applications. Existing methods often compromise between computational efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Arvin Tashakori , Arash Tashakori , Gongbo Yang , Z. Jane Wang , Peyman Servati

Human motion prediction is an important component to facilitate human robot interaction. Robots need to accurately predict human's future movement in order to safely plan its own motion trajectories and efficiently collaborate with humans.…

Robotics · Computer Science 2019-09-19 Yujiao Cheng , Weiye Zhao , Changliu Liu , Masayoshi Tomizuka

We address the computational problem of novel human pose synthesis. Given an image of a person and a desired pose, we produce a depiction of that person in that pose, retaining the appearance of both the person and background. We present a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Guha Balakrishnan , Amy Zhao , Adrian V. Dalca , Fredo Durand , John Guttag