中文
相关论文

相关论文: Contact-aware Human Motion Generation from Textual…

200 篇论文

Recent advancements in human motion synthesis have focused on specific types of motions, such as human-scene interaction, locomotion or human-human interaction, however, there is a lack of a unified system capable of generating a diverse…

计算机视觉与模式识别 · 计算机科学 2025-02-14 Jianqi Chen , Panwen Hu , Xiaojun Chang , Zhenwei Shi , Michael Kampffmeyer , Xiaodan Liang

Text-conditioned motion synthesis has made remarkable progress with the emergence of diffusion models. However, the majority of these motion diffusion models are primarily designed for a single character and overlook multi-human…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Zhenzhi Wang , Jingbo Wang , Yixuan Li , Dahua Lin , Bo Dai

This work targets a novel text-driven whole-body motion generation task, which takes a given textual description as input and aims at generating high-quality, diverse, and coherent facial expressions, hand gestures, and body motions…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Shunlin Lu , Ling-Hao Chen , Ailing Zeng , Jing Lin , Ruimao Zhang , Lei Zhang , Heung-Yeung Shum

Generating 3D human motions from text is a challenging yet valuable task. The key aspects of this task are ensuring text-motion consistency and achieving generation diversity. Although recent advancements have enabled the generation of…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Zheng Qin , Yabing Wang , Minghui Yang , Sanping Zhou , Ming Yang , Le Wang

Among various interactions between humans, such as eye contact and gestures, physical interactions by contact can act as an essential moment in understanding human behaviors. Inspired by this fact, given a 3D partner human with the desired…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Dongjun Gu , Jaehyeok Shim , Jaehoon Jang , Changwoo Kang , Kyungdon Joo

Large-scale capture of human motion with diverse, complex scenes, while immensely useful, is often considered prohibitively costly. Meanwhile, human motion alone contains rich information about the scene they reside in and interact with.…

图形学 · 计算机科学 2023-01-05 Sifan Ye , Yixing Wang , Jiaman Li , Dennis Park , C. Karen Liu , Huazhe Xu , Jiajun Wu

The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications. Previous approaches for scene-aware motion synthesis are constrained by pre-defined target objects or positions and thus…

计算机视觉与模式识别 · 计算机科学 2022-05-27 Jingbo Wang , Yu Rong , Jingyuan Liu , Sijie Yan , Dahua Lin , Bo Dai

Our paper aims to generate diverse and realistic animal motion sequences from textual descriptions, without a large-scale animal text-motion dataset. While the task of text-driven human motion synthesis is already extensively studied and…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Zhangsihao Yang , Mingyuan Zhou , Mengyi Shan , Bingbing Wen , Ziwei Xuan , Mitch Hill , Junjie Bai , Guo-Jun Qi , Yalin Wang

Digital human motion synthesis is a vibrant research field with applications in movies, AR/VR, and video games. Whereas methods were proposed to generate natural and realistic human motions, most only focus on modeling humans and largely…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Quanzhou Li , Jingbo Wang , Chen Change Loy , Bo Dai

The recently emerging text-to-motion advances have spired numerous attempts for convenient and interactive human motion generation. Yet, existing methods are largely limited to generating body motions only without considering the rich…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Wenqian Zhang , Molin Huang , Yuxuan Zhou , Juze Zhang , Jingyi Yu , Jingya Wang , Lan Xu

We address the problem of generating diverse 3D human motions from textual descriptions. This challenging task requires joint modeling of both modalities: understanding and extracting useful human-centric information from the text, and then…

计算机视觉与模式识别 · 计算机科学 2022-07-25 Mathis Petrovich , Michael J. Black , Gül Varol

Text-to-motion generation, which translates textual descriptions into human motions, has been challenging in accurately capturing detailed user-imagined motions from simple text inputs. This paper introduces StickMotion, an efficient…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Tao Wang , Zhihua Wu , Qiaozhi He , Jiaming Chu , Ling Qian , Yu Cheng , Junliang Xing , Jian Zhao , Lei Jin

Motion synthesis for diverse object categories holds great potential for 3D content creation but remains underexplored due to two key challenges: (1) the lack of comprehensive motion datasets that include a wide range of high-quality…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Wonkwang Lee , Jongwon Jeong , Taehong Moon , Hyeon-Jong Kim , Jaehyeon Kim , Gunhee Kim , Byeong-Uk Lee

In this paper, a deep learning-based model for 3D human motion generation from the text is proposed via gesture action classification and an autoregressive model. The model focuses on generating special gestures that express human thinking,…

计算机视觉与模式识别 · 计算机科学 2022-11-21 Gwantae Kim , Youngsuk Ryu , Junyeop Lee , David K. Han , Jeongmin Bae , Hanseok Ko

We explore how body shapes influence human motion synthesis, an aspect often overlooked in existing text-to-motion generation methods due to the ease of learning a homogenized, canonical body shape. However, this homogenization can distort…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Ting-Hsuan Liao , Yi Zhou , Yu Shen , Chun-Hao Paul Huang , Saayan Mitra , Jia-Bin Huang , Uttaran Bhattacharya

Humans constantly contact objects to move and perform tasks. Thus, detecting human-object contact is important for building human-centered artificial intelligence. However, there exists no robust method to detect contact between the body…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Yixin Chen , Sai Kumar Dwivedi , Michael J. Black , Dimitrios Tzionas

Generating realistic and controllable human motions, particularly those involving rich multi-character interactions, remains a significant challenge due to data scarcity and the complexities of modeling inter-personal dynamics. To address…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Ruihao Xi , Xuekuan Wang , Yongcheng Li , Shuhua Li , Zichen Wang , Yiwei Wang , Feng Wei , Cairong Zhao

Due to recent advances in pose-estimation methods, human motion can be extracted from a common video in the form of 3D skeleton sequences. Despite wonderful application opportunities, effective and efficient content-based access to large…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Nicola Messina , Jan Sedmidubsky , Fabrizio Falchi , Tomáš Rebok

Linking human motion and natural language is of great interest for the generation of semantic representations of human activities as well as for the generation of robot activities based on natural language input. However, while there have…

机器人学 · 计算机科学 2018-08-10 Matthias Plappert , Christian Mandery , Tamim Asfour

Text to Motion aims to generate human motions from texts. Existing settings rely on limited Action Texts that include action labels, which limits flexibility and practicability in scenarios difficult to describe directly. This paper extends…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Runqi Wang , Caoyuan Ma , Guopeng Li , Hanrui Xu , Yuke Li , Zheng Wang