English
Related papers

Related papers: ReMoMask: Retrieval-Augmented Masked Motion Genera…

200 papers

3D human motion generation is crucial for creative industry. Recent advances rely on generative models with domain knowledge for text-driven motion generation, leading to substantial progress in capturing common motions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Mingyuan Zhang , Xinying Guo , Liang Pan , Zhongang Cai , Fangzhou Hong , Huirong Li , Lei Yang , Ziwei Liu

Despite the significant role text-to-motion (T2M) generation plays across various applications, current methods involve a large number of parameters and suffer from slow inference speeds, leading to high usage costs. To address this, we aim…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Ling-An Zeng , Guohong Huang , Gaojie Wu , Wei-Shi Zheng

Prior masked modeling motion generation methods predominantly study text-to-motion. We present DiMo, a discrete diffusion-style framework, which extends masked modeling to bidirectional text--motion understanding and generation. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Ning Zhang , Zhengyu Li , Kwong Weng Loh , Mingxi Xu , Qi Wang , Zhengyu Wen , Xiaoyu He , Wei Zhao , Kehong Gong , Mingyuan Zhang

Text-to-motion (T2M) generation aims to control the behavior of a target character via textual descriptions. Leveraging text-motion paired datasets, existing T2M models have achieved impressive performance in generating high-quality motions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiakun Zheng , Ting Xiao , Shiqin Cao , Xinran Li , Zhe Wang , Chenjia Bai

We introduce MoRAG, a novel multi-part fusion based retrieval-augmented generation strategy for text-based human motion generation. The method enhances motion diffusion models by leveraging additional knowledge obtained through an improved…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Sai Shashank Kalakonda , Shubh Maheshwari , Ravi Kiran Sarvadevabhatla

Bilingual text-to-motion generation, which synthesizes 3D human motions from bilingual text inputs, holds immense potential for cross-linguistic applications in gaming, film, and robotics. However, this task faces critical challenges: the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Wanjiang Weng , Xiaofeng Tan , Hongsong Wang , Pan Zhou

Text-to-motion (T2M) generation with diffusion backbones achieves strong realism and alignment. Safety concerns in T2M methods have been raised in recent years; existing methods replace discrete VQ-VAE codebook entries to steer the model…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Yiling Wang , Zeyu Zhang , Yiran Wang , Hao Tang

Recent advances in text-to-motion generation using diffusion and autoregressive models have shown promising results. However, these models often suffer from a trade-off between real-time performance, high fidelity, and motion editability.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Ekkasit Pinyoanuntapong , Pu Wang , Minwoo Lee , Chen Chen

Generating 3D human motion from text descriptions remains challenging due to the diverse and complex nature of human motion. While existing methods excel within the training distribution, they often struggle with out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Zongye Zhang , Bohan Kong , Qingjie Liu , Yunhong Wang

Generating human motion from text has been dominated by denoising motion models either through diffusion or generative masking process. However, these models face great limitations in usability by requiring prior knowledge of the motion…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ekkasit Pinyoanuntapong , Muhammad Usama Saleem , Pu Wang , Minwoo Lee , Srijan Das , Chen Chen

We introduce MoMask, a novel masked modeling framework for text-driven 3D human motion generation. In MoMask, a hierarchical quantization scheme is employed to represent human motion as multi-layer discrete motion tokens with high-fidelity…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Chuan Guo , Yuxuan Mu , Muhammad Gohar Javed , Sen Wang , Li Cheng

Generating 3D human motion based on textual descriptions has been a research focus in recent years. It requires the generated motion to be diverse, natural, and conform to the textual description. Due to the complex spatio-temporal nature…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Chongyang Zhong , Lei Hu , Zihao Zhang , Shihong Xia

Text-driven human motion generation is a multimodal task that synthesizes human motion sequences conditioned on natural language. It requires the model to satisfy textual descriptions under varying conditional inputs, while generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Xingyu Chen

Text-to-Motion (T2M) generation aims to synthesize realistic human motion sequences from natural language descriptions. While two-stage frameworks leveraging discrete motion representations have advanced T2M research, they often neglect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hongsong Wang , Wenjing Yan , Qiuxia Lai , Xin Geng

In recent years, the fashion industry has increasingly adopted AI technologies to enhance customer experience, driven by the proliferation of e-commerce platforms and virtual applications. Among the various tasks, virtual try-on and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fulvio Sanguigni , Davide Morelli , Marcella Cornia , Rita Cucchiara

Discrete masked diffusion language models such as LLaDA generate text through iterative denoising, where mask tokens are progressively replaced with predicted tokens. LLaDA2.1 introduced a Token-to-Token (T2T) editing mechanism that…

Computation and Language · Computer Science 2026-05-27 Lin Yao

Although existing text-to-motion (T2M) methods can produce realistic human motion from text description, it is still difficult to align the generated motion with the desired postures since using text alone is insufficient for precisely…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Ling-An Zeng , Gaojie Wu , Ancong Wu , Jian-Fang Hu , Wei-Shi Zheng

Enabling humanoid robots to synthesize complex, physically coherent motions from natural language commands is a cornerstone of autonomous robotics and human-robot interaction. While diffusion models have shown promise in this text-to-motion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Wenshuo Chen , Haozhe Jia , Songning Lai , Lei Wang , Yuqi Lin , Hongru Xiao , Lijie Hu , Yutao Yue

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Wanjiang Weng , Xiaofeng Tan , Junbo Wang , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Text-to-motion generation has attracted increasing attention in the research community recently, with potential applications in animation, virtual reality, robotics, and human-computer interaction. Diffusion and autoregressive models are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Kang Ding , Hongsong Wang , Jie Gui , Liang Wang
‹ Prev 1 2 3 10 Next ›