中文
相关论文

相关论文: MoLingo: Motion-Language Alignment for Text-to-Mot…

200 篇论文

Diffusion models, particularly latent diffusion models, have demonstrated remarkable success in text-driven human motion generation. However, it remains challenging for latent diffusion models to effectively compose multiple semantic…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Jianrong Zhang , Hehe Fan , Yi Yang

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Wanjiang Weng , Xiaofeng Tan , Junbo Wang , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Generating 3D human motion based on textual descriptions has been a research focus in recent years. It requires the generated motion to be diverse, natural, and conform to the textual description. Due to the complex spatio-temporal nature…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Chongyang Zhong , Lei Hu , Zihao Zhang , Shihong Xia

Diffusion models achieve impressive performance in human motion generation. However, current approaches typically ignore the significance of frequency-domain information in capturing fine-grained motions within the latent space (e.g., low…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Chengjian Li , Xiangbo Shu , Qiongjie Cui , Yazhou Yao , Jinhui Tang

While current diffusion-based models, typically built on U-Net architectures, have shown promising results on the text-to-motion generation task, they still suffer from semantic misalignment and kinematic artifacts. Through analysis, we…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Haozhe Jia , Wenshuo Chen , Yuqi Lin , Yang Yang , Lei Wang , Mang Ning , Bowen Tian , Songning Lai , Nanqian Jia , Yifan Chen , Yutao Yue

Although existing text-to-motion (T2M) methods can produce realistic human motion from text description, it is still difficult to align the generated motion with the desired postures since using text alone is insufficient for precisely…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Ling-An Zeng , Gaojie Wu , Ancong Wu , Jian-Fang Hu , Wei-Shi Zheng

Text-to-motion generation has gained increasing attention, but most existing methods are limited to generating short-term motions that correspond to a single sentence describing a single action. However, when a text stream describes a…

计算机视觉与模式识别 · 计算机科学 2023-08-04 Zhao Yang , Bing Su , Ji-Rong Wen

Text-to-motion generation holds significant potential for cross-linguistic applications, yet it is hindered by the lack of bilingual datasets and the poor cross-lingual semantic understanding of existing language models. To address these…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Wanjiang Weng , Xiaofeng Tan , Xiangbo Shu , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Despite the significant role text-to-motion (T2M) generation plays across various applications, current methods involve a large number of parameters and suffer from slow inference speeds, leading to high usage costs. To address this, we aim…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Ling-An Zeng , Guohong Huang , Gaojie Wu , Wei-Shi Zheng

Recent advances in diffusion-based text-to-video (T2V) models have demonstrated remarkable progress, but these models still face challenges in generating videos with multiple objects. Most models struggle with accurately capturing complex…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Aimon Rahman , Jiang Liu , Ze Wang , Ximeng Sun , Jialian Wu , Xiaodong Yu , Yusheng Su , Vishal M. Patel , Zicheng Liu , Emad Barsoum

In text-to-motion generation, controllability as well as generation quality and speed has become increasingly critical. The controllability challenges include generating a motion of a length that matches the given textual description and…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Kengo Uchida , Takashi Shibuya , Yuhta Takida , Naoki Murata , Julian Tanke , Shusuke Takahashi , Yuki Mitsufuji

Bilingual text-to-motion generation, which synthesizes 3D human motions from bilingual text inputs, holds immense potential for cross-linguistic applications in gaming, film, and robotics. However, this task faces critical challenges: the…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Wanjiang Weng , Xiaofeng Tan , Hongsong Wang , Pan Zhou

Enabling humanoid robots to synthesize complex, physically coherent motions from natural language commands is a cornerstone of autonomous robotics and human-robot interaction. While diffusion models have shown promise in this text-to-motion…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Wenshuo Chen , Haozhe Jia , Songning Lai , Lei Wang , Yuqi Lin , Hongru Xiao , Lijie Hu , Yutao Yue

Text-to-Motion (T2M) generation aims to synthesize realistic human motion sequences from natural language descriptions. While two-stage frameworks leveraging discrete motion representations have advanced T2M research, they often neglect…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Hongsong Wang , Wenjing Yan , Qiuxia Lai , Xin Geng

We propose a zero-shot approach for generating consistent videos of animated characters based on Text-to-Image (T2I) diffusion models. Existing Text-to-Video (T2V) methods are expensive to train and require large-scale video datasets to…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Abdelrahman Eldesokey , Peter Wonka

We present TeSMo, a method for text-controlled scene-aware motion generation based on denoising diffusion models. Previous text-to-motion methods focus on characters in isolation without considering scenes due to the limited availability of…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Hongwei Yi , Justus Thies , Michael J. Black , Xue Bin Peng , Davis Rempe

Text-driven human motion generation is a multimodal task that synthesizes human motion sequences conditioned on natural language. It requires the model to satisfy textual descriptions under varying conditional inputs, while generating…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Xingyu Chen

In this paper, we address the challenging problem of long-term 3D human motion generation. Specifically, we aim to generate a long sequence of smoothly connected actions from a stream of multiple sentences (i.e., paragraph). Previous…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Taeryung Lee , Fabien Baradel , Thomas Lucas , Kyoung Mu Lee , Gregory Rogez

Text-to-motion generation, which converts motion language descriptions into coherent 3D human motion sequences, has attracted increasing attention in fields, such as avatar animation and humanoid robotic interaction. Though existing models…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Xingzu Zhan , Chen Xie , Honghang Chen , Yixun Lin , Xiaochun Mai

Text-guided motion synthesis aims to generate 3D human motion that not only precisely reflects the textual description but reveals the motion details as much as possible. Pioneering methods explore the diffusion model for text-to-motion…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Zhenyu Xie , Yang Wu , Xuehao Gao , Zhongqian Sun , Wei Yang , Xiaodan Liang