English
Related papers

Related papers: Multi-Track Timeline Control for Text-Driven 3D Hu…

200 papers

This work aims to generate natural and diverse group motions of multiple humans from textual descriptions. While single-person text-to-motion generation is extensively studied, it remains challenging to synthesize motions for more than one…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Mengyi Shan , Lu Dong , Yutao Han , Yuan Yao , Tao Liu , Ifeoma Nwogu , Guo-Jun Qi , Mitch Hill

Generating realistic motions for digital humans is a core but challenging part of computer animations and games, as human motions are both diverse in content and rich in styles. While the latest deep learning approaches have made…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Ziyi Chang , Edmund J. C. Findlay , Haozheng Zhang , Hubert P. H. Shum

Given a series of natural language descriptions, our task is to generate 3D human motions that correspond semantically to the text, and follow the temporal order of the instructions. In particular, our goal is to enable the synthesis of a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Nikos Athanasiou , Mathis Petrovich , Michael J. Black , Gül Varol

Text-driven human motion generation is an emerging task in animation and humanoid robot design. Existing algorithms directly generate the full sequence which is computationally expensive and prone to errors as it does not pay special…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Zichen Geng , Caren Han , Zeeshan Hayder , Jian Liu , Mubarak Shah , Ajmal Mian

Synthesizing human motions in 3D environments, particularly those with complex activities such as locomotion, hand-reaching, and human-object interaction, presents substantial demands for user-defined waypoints and stage transitions. These…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Nan Jiang , Zimo He , Zi Wang , Hongjie Li , Yixin Chen , Siyuan Huang , Yixin Zhu

Generating realistic human videos remains a challenging task, with the most effective methods currently relying on a human motion sequence as a control signal. Existing approaches often use existing motion extracted from other videos, which…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Hsin-Ping Huang , Yang Zhou , Jui-Hsien Wang , Difan Liu , Feng Liu , Ming-Hsuan Yang , Zhan Xu

Text-to-motion generation has experienced remarkable progress in recent years. However, current approaches remain limited to synthesizing motion from short or general text prompts, primarily due to dataset constraints. This limitation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Chuan Guo , Inwoo Hwang , Jian Wang , Bing Zhou

The task of text2motion is to generate human motion sequences from given textual descriptions, where the model explores diverse mappings from natural language instructions to human body movements. While most existing works are confined to…

Artificial Intelligence · Computer Science 2024-03-27 Kunhang Li , Yansong Feng

Trajectory-controlled human motion generation aims to synthesize realistic human motions conditioned on both textual descriptions and spatial trajectories. However, existing methods suffer from two critical limitations: first, the conflict…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Deli Cai , Haoyang Ma , Changxing Ding

With the rapid advancement of game and film production, generating interactive motion from texts has garnered significant attention due to its potential to revolutionize content creation processes. In many practical applications, there is a…

Robotics · Computer Science 2025-02-18 Runqi Wang , Caoyuan Ma , Jian Zhao , Hanrui Xu , Dongfang Sun , Haoyang Chen , Lin Xiong , Zheng Wang , Xuelong Li

In this work, we present a data-driven framework for generating diverse in-betweening motions for kinematic characters. Our approach injects dynamic conditions and explicit motion controls into the procedure of motion transitions. Notably,…

Graphics · Computer Science 2024-10-02 Yuchen Chu , Zeshi Yang

We propose a method leveraging the naturally time-related expressivity of our voice to control an animation composed of a set of short events. The user records itself mimicking onomatopoeia sounds such as "Tick", "Pop", or "Chhh" which are…

Graphics · Computer Science 2019-10-21 Adrien Nivaggioli , Damien Rohmer

Controllable human motion synthesis is essential for applications in AR/VR, gaming and embodied AI. Existing methods often focus solely on either language or full trajectory control, lacking precision in synthesizing motions aligned with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Weilin Wan , Zhiyang Dou , Taku Komura , Wenping Wang , Dinesh Jayaraman , Lingjie Liu

Generating realistic motions for digital humans is time-consuming for many graphics applications. Data-driven motion synthesis approaches have seen solid progress in recent years through deep generative models. These results offer…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Edmund J. C. Findlay , Haozheng Zhang , Ziyi Chang , Hubert P. H. Shum

Generating human motions from textual descriptions has gained growing research interest due to its wide range of applications. However, only a few works consider human-scene interactions together with text conditions, which is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zhi Cen , Huaijin Pi , Sida Peng , Zehong Shen , Minghui Yang , Shuai Zhu , Hujun Bao , Xiaowei Zhou

Language-guided human motion synthesis has been a challenging task due to the inherent complexity and diversity of human behaviors. Previous methods face limitations in generalization to novel actions, often resulting in unrealistic or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yuanhao Zhai , Mingzhen Huang , Tianyu Luan , Lu Dong , Ifeoma Nwogu , Siwei Lyu , David Doermann , Junsong Yuan

In this paper, we address the challenge of generating realistic 3D human motions for action classes that were never seen during the training phase. Our approach involves decomposing complex actions into simpler movements, specifically those…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Lorenzo Mandelli , Stefano Berretti

"How can we animate 3D-characters from a movie script or move robots by simply telling them what we would like them to do?" "How unstructured and complex can we make a sentence and still generate plausible movements from it?" These are…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Anindita Ghosh , Noshaba Cheema , Cennet Oguz , Christian Theobalt , Philipp Slusallek

Gesture recognition research, unlike NLP, continues to face acute data scarcity, with progress constrained by the need for costly human recordings or image processing approaches that cannot generate authentic variability in the gestures…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Hassan Ali , Doreen Jirak , Luca Müller , Stefan Wermter

Keyframes are a standard representation for kinematic motion specification. Recent learned motion-inbetweening methods use keyframes as a way to control generative motion models, and are trained to generate life-like motion that matches the…

Graphics · Computer Science 2025-03-04 Purvi Goel , Haotian Zhang , C. Karen Liu , Kayvon Fatahalian