中文
相关论文

相关论文: Multi-Track Timeline Control for Text-Driven 3D Hu…

200 篇论文

This work aims to generate natural and diverse group motions of multiple humans from textual descriptions. While single-person text-to-motion generation is extensively studied, it remains challenging to synthesize motions for more than one…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Mengyi Shan , Lu Dong , Yutao Han , Yuan Yao , Tao Liu , Ifeoma Nwogu , Guo-Jun Qi , Mitch Hill

Generating realistic motions for digital humans is a core but challenging part of computer animations and games, as human motions are both diverse in content and rich in styles. While the latest deep learning approaches have made…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Ziyi Chang , Edmund J. C. Findlay , Haozheng Zhang , Hubert P. H. Shum

Given a series of natural language descriptions, our task is to generate 3D human motions that correspond semantically to the text, and follow the temporal order of the instructions. In particular, our goal is to enable the synthesis of a…

计算机视觉与模式识别 · 计算机科学 2022-09-13 Nikos Athanasiou , Mathis Petrovich , Michael J. Black , Gül Varol

Text-driven human motion generation is an emerging task in animation and humanoid robot design. Existing algorithms directly generate the full sequence which is computationally expensive and prone to errors as it does not pay special…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Zichen Geng , Caren Han , Zeeshan Hayder , Jian Liu , Mubarak Shah , Ajmal Mian

Synthesizing human motions in 3D environments, particularly those with complex activities such as locomotion, hand-reaching, and human-object interaction, presents substantial demands for user-defined waypoints and stage transitions. These…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Nan Jiang , Zimo He , Zi Wang , Hongjie Li , Yixin Chen , Siyuan Huang , Yixin Zhu

Generating realistic human videos remains a challenging task, with the most effective methods currently relying on a human motion sequence as a control signal. Existing approaches often use existing motion extracted from other videos, which…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Hsin-Ping Huang , Yang Zhou , Jui-Hsien Wang , Difan Liu , Feng Liu , Ming-Hsuan Yang , Zhan Xu

Text-to-motion generation has experienced remarkable progress in recent years. However, current approaches remain limited to synthesizing motion from short or general text prompts, primarily due to dataset constraints. This limitation…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Chuan Guo , Inwoo Hwang , Jian Wang , Bing Zhou

The task of text2motion is to generate human motion sequences from given textual descriptions, where the model explores diverse mappings from natural language instructions to human body movements. While most existing works are confined to…

人工智能 · 计算机科学 2024-03-27 Kunhang Li , Yansong Feng

Trajectory-controlled human motion generation aims to synthesize realistic human motions conditioned on both textual descriptions and spatial trajectories. However, existing methods suffer from two critical limitations: first, the conflict…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Deli Cai , Haoyang Ma , Changxing Ding

With the rapid advancement of game and film production, generating interactive motion from texts has garnered significant attention due to its potential to revolutionize content creation processes. In many practical applications, there is a…

机器人学 · 计算机科学 2025-02-18 Runqi Wang , Caoyuan Ma , Jian Zhao , Hanrui Xu , Dongfang Sun , Haoyang Chen , Lin Xiong , Zheng Wang , Xuelong Li

In this work, we present a data-driven framework for generating diverse in-betweening motions for kinematic characters. Our approach injects dynamic conditions and explicit motion controls into the procedure of motion transitions. Notably,…

图形学 · 计算机科学 2024-10-02 Yuchen Chu , Zeshi Yang

We propose a method leveraging the naturally time-related expressivity of our voice to control an animation composed of a set of short events. The user records itself mimicking onomatopoeia sounds such as "Tick", "Pop", or "Chhh" which are…

图形学 · 计算机科学 2019-10-21 Adrien Nivaggioli , Damien Rohmer

Controllable human motion synthesis is essential for applications in AR/VR, gaming and embodied AI. Existing methods often focus solely on either language or full trajectory control, lacking precision in synthesizing motions aligned with…

计算机视觉与模式识别 · 计算机科学 2024-07-25 Weilin Wan , Zhiyang Dou , Taku Komura , Wenping Wang , Dinesh Jayaraman , Lingjie Liu

Generating realistic motions for digital humans is time-consuming for many graphics applications. Data-driven motion synthesis approaches have seen solid progress in recent years through deep generative models. These results offer…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Edmund J. C. Findlay , Haozheng Zhang , Ziyi Chang , Hubert P. H. Shum

Generating human motions from textual descriptions has gained growing research interest due to its wide range of applications. However, only a few works consider human-scene interactions together with text conditions, which is crucial for…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Zhi Cen , Huaijin Pi , Sida Peng , Zehong Shen , Minghui Yang , Shuai Zhu , Hujun Bao , Xiaowei Zhou

Language-guided human motion synthesis has been a challenging task due to the inherent complexity and diversity of human behaviors. Previous methods face limitations in generalization to novel actions, often resulting in unrealistic or…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Yuanhao Zhai , Mingzhen Huang , Tianyu Luan , Lu Dong , Ifeoma Nwogu , Siwei Lyu , David Doermann , Junsong Yuan

In this paper, we address the challenge of generating realistic 3D human motions for action classes that were never seen during the training phase. Our approach involves decomposing complex actions into simpler movements, specifically those…

计算机视觉与模式识别 · 计算机科学 2024-09-19 Lorenzo Mandelli , Stefano Berretti

"How can we animate 3D-characters from a movie script or move robots by simply telling them what we would like them to do?" "How unstructured and complex can we make a sentence and still generate plausible movements from it?" These are…

计算机视觉与模式识别 · 计算机科学 2023-01-24 Anindita Ghosh , Noshaba Cheema , Cennet Oguz , Christian Theobalt , Philipp Slusallek

Gesture recognition research, unlike NLP, continues to face acute data scarcity, with progress constrained by the need for costly human recordings or image processing approaches that cannot generate authentic variability in the gestures…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Hassan Ali , Doreen Jirak , Luca Müller , Stefan Wermter

Keyframes are a standard representation for kinematic motion specification. Recent learned motion-inbetweening methods use keyframes as a way to control generative motion models, and are trained to generate life-like motion that matches the…

图形学 · 计算机科学 2025-03-04 Purvi Goel , Haotian Zhang , C. Karen Liu , Kayvon Fatahalian