English
Related papers

Related papers: Motion Generation Review: Exploring Deep Learning …

200 papers

We present a novel method for populating 3D indoor scenes with virtual humans that can navigate in the environment and interact with objects in a realistic manner. Existing approaches rely on training sequences that contain captured human…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Kaifeng Zhao , Yan Zhang , Shaofei Wang , Thabo Beeler , Siyu Tang

Text-driven motion generation has attracted increasing attention due to its broad applications in virtual reality, animation, and robotics. While existing methods typically model human and animal motion separately, a joint cross-species…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xuan Wang , Kai Ruan , Liyang Qian , Zhizhi Guo , Chang Su , Gaoang Wang

Robotic motion generation methods using machine learning have been studied in recent years. Bilateral control-based imitation learning can imitate human motions using force information. By means of this method, variable speed motion…

Robotics · Computer Science 2022-02-16 Yuki Saigusa , Ayumu Sasagawa , Sho Sakaino , Toshiaki Tsuji

This work aims to generate natural and diverse group motions of multiple humans from textual descriptions. While single-person text-to-motion generation is extensively studied, it remains challenging to synthesize motions for more than one…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Mengyi Shan , Lu Dong , Yutao Han , Yuan Yao , Tao Liu , Ifeoma Nwogu , Guo-Jun Qi , Mitch Hill

Human-motion generation is a long-standing challenging task due to the requirement of accurately modeling complex and diverse dynamic patterns. Most existing methods adopt sequence models such as RNN to directly model transitions in the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Zhenyi Wang , Ping Yu , Yang Zhao , Ruiyi Zhang , Yufan Zhou , Junsong Yuan , Changyou Chen

This paper aims at one newly raising task in vision and multimedia research: recognizing human actions from still images. Its main challenges lie in the large variations in human poses and appearances, as well as the lack of temporal motion…

Computer Vision and Pattern Recognition · Computer Science 2015-02-03 Zhujin Liang , Xiaolong Wang , Rui Huang , Liang Lin

Human motion synthesis is a fundamental task in computer animation. Despite recent progress in this field utilizing deep learning and motion capture data, existing methods are always limited to specific motion categories, environments, and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Zhikai Zhang , Yitang Li , Haofeng Huang , Mingxian Lin , Li Yi

This paper addresses the challenge of learning semantically and functionally meaningful 3D motion priors from real-world videos, in order to enable prediction of future 3D scene motion from a single input image. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Jiahui Lei , Kyle Genova , George Kopanas , Noah Snavely , Leonidas Guibas

This paper presents a novel framework for speech-driven gesture production, applicable to virtual agents to enhance human-computer interaction. Specifically, we extend recent deep-learning-based, data-driven methods for speech-driven…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Taras Kucherenko , Dai Hasegawa , Naoshi Kaneko , Gustav Eje Henter , Hedvig Kjellström

Human motion generation is a critical task with a wide range of applications. Achieving high realism in generated motions requires naturalness, smoothness, and plausibility. Despite rapid advancements in the field, current generation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Haoru Wang , Wentao Zhu , Luyi Miao , Yishu Xu , Feng Gao , Qi Tian , Yizhou Wang

This paper proposes a novel application system for the generation of three-dimensional (3D) character animation driven by markerless human body motion capturing. The entire pipeline of the system consists of five stages: 1) the capturing of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Jinbao Wang , Ke Lu , Jian Xue

In recent years, motion capture technology using computers has developed rapidly. Because of its high efficiency and excellent performance, it replaces many traditional methods and is being widely used in many fields. Our project is about…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Yanquan Chen , Fei Yang , Tianyu Lang , Guanfang Dong , Anup Basu

We present the first image-based generative model of people in clothing for the full body. We sidestep the commonly used complex graphics rendering pipeline and the need for high-quality 3D scans of dressed people. Instead, we learn…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Christoph Lassner , Gerard Pons-Moll , Peter V. Gehler

3D animation of humans in action is quite challenging as it involves using a huge setup with several motion trackers all over the person's body to track the movements of every limb. This is time-consuming and may cause the person discomfort…

Graphics · Computer Science 2020-02-10 Laxman Kumarapu , Prerana Mukherjee

Learning natural body motion remains challenging due to the strong coupling between spatial geometry and temporal dynamics. Embedding motion in phase manifolds, latent spaces that capture local periodicity, has proven effective for motion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Marco Pegoraro , Evan Atherton , Bruno Roy , Aliasghar Khani , Arianna Rampini

Generating realistic, context-aware two-person motion conditioned on diverse modalities remains a fundamental challenge for graphics, animation and embodied AI systems. Real-world applications such as VR/AR companions, social robotics and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Prerit Gupta , Shourya Verma , Ananth Grama , Aniket Bera

Rapid progress in deep reinforcement learning has made it increasingly feasible to train controllers for high-dimensional humanoid bodies. However, methods that use pure reinforcement learning with simple reward functions tend to produce…

Robotics · Computer Science 2017-07-11 Josh Merel , Yuval Tassa , Dhruva TB , Sriram Srinivasan , Jay Lemmon , Ziyu Wang , Greg Wayne , Nicolas Heess

Human motion generation, a cornerstone technique in animation and video production, has widespread applications in various tasks like text-to-motion and music-to-dance. Previous works focus on developing specialist models tailored for each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mingyuan Zhang , Daisheng Jin , Chenyang Gu , Fangzhou Hong , Zhongang Cai , Jingfang Huang , Chongzhi Zhang , Xinying Guo , Lei Yang , Ying He , Ziwei Liu

Realistic image manipulation is challenging because it requires modifying the image appearance in a user-controlled way, while preserving the realism of the result. Unless the user has considerable artistic skill, it is easy to "fall off"…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Jun-Yan Zhu , Philipp Krähenbühl , Eli Shechtman , Alexei A. Efros

We present a unified perspective on tackling various human-centric video tasks by learning human motion representations from large-scale and heterogeneous data resources. Specifically, we propose a pretraining stage in which a motion…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Wentao Zhu , Xiaoxuan Ma , Zhaoyang Liu , Libin Liu , Wayne Wu , Yizhou Wang