English
Related papers

Related papers: Exploring Motion-Language Alignment for Text-drive…

200 papers

Generating human motions from textual descriptions has gained growing research interest due to its wide range of applications. However, only a few works consider human-scene interactions together with text conditions, which is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zhi Cen , Huaijin Pi , Sida Peng , Zehong Shen , Minghui Yang , Shuai Zhu , Hujun Bao , Xiaowei Zhou

This research delves into the problem of interactive editing of human motion generation. Previous motion diffusion models lack explicit modeling of the word-level text-motion correspondence and good explainability, hence restricting their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Ling-Hao Chen , Shunlin Lu , Wenxun Dai , Zhiyang Dou , Xuan Ju , Jingbo Wang , Taku Komura , Lei Zhang

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Wanjiang Weng , Xiaofeng Tan , Junbo Wang , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Recent advances in generative motion synthesis have enabled the production of realistic human motions from diverse input modalities. However, synthesizing compound actions from texts, which integrate multiple concurrent actions into…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yue Jiang , Mingyu Yang , Liuyuxin Yang , Yang Xu , Bingxin Yun , Yuhe Zhang

Text-to-motion generative models span a wide range of 3D human actions but struggle with nuanced stylistic attributes such as a "Chicken" style. Due to the scarcity of style-specific data, existing approaches pull the generative prior…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Haim Sawdayee , Chuan Guo , Guy Tevet , Bing Zhou , Jian Wang , Amit H. Bermano

Text-driven human motion generation, as one of the vital tasks in computer-aided content creation, has recently attracted increasing attention. While pioneering research has largely focused on improving numerical performance metrics on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Yunyao Mao , Xiaoyang Liu , Wengang Zhou , Zhenbo Lu , Houqiang Li

In text-to-motion generation, controllability as well as generation quality and speed has become increasingly critical. The controllability challenges include generating a motion of a length that matches the given textual description and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kengo Uchida , Takashi Shibuya , Yuhta Takida , Naoki Murata , Julian Tanke , Shusuke Takahashi , Yuki Mitsufuji

State-of-the-art text-to-motion generation models rely on the kinematic-aware, local-relative motion representation popularized by HumanML3D, which encodes motion relative to the pelvis and to the previous frame with built-in redundancy.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zichong Meng , Zeyu Han , Xiaogang Peng , Yiming Xie , Huaizu Jiang

The input and output of most text generation tasks can be transformed to two sequences of tokens and they can be modeled using sequence-to-sequence learning modeling tools such as Transformers. These models are usually trained by maximizing…

Computation and Language · Computer Science 2022-12-09 Xingxing Zhang , Yiran Liu , Xun Wang , Pengcheng He , Yang Yu , Si-Qing Chen , Wayne Xiong , Furu Wei

Text-to-Motion (T2M) generation aims to synthesize realistic human motion sequences from natural language descriptions. While two-stage frameworks leveraging discrete motion representations have advanced T2M research, they often neglect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hongsong Wang , Wenjing Yan , Qiuxia Lai , Xin Geng

Recent advances in motion-aware large language models have shown remarkable promise for unifying motion understanding and generation tasks. However, these models typically treat understanding and generation separately, limiting the mutual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yuan-Ming Li , Qize Yang , Nan Lei , Shenghao Fu , Ling-An Zeng , Jian-Fang Hu , Xihan Wei , Wei-Shi Zheng

Human motion generation aims to generate natural human pose sequences and shows immense potential for real-world applications. Substantial progress has been made recently in motion data collection technologies and generation methods, laying…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Wentao Zhu , Xiaoxuan Ma , Dongwoo Ro , Hai Ci , Jinlu Zhang , Jiaxin Shi , Feng Gao , Qi Tian , Yizhou Wang

Text-driven human motion generation has recently attracted considerable attention, allowing models to generate human motions based on textual descriptions. However, current methods neglect the influence of human attributes-such as age,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinghan Wang , Kun Xu , Fei Li , Cao Sheng , Jiazhong Yu , Yadong Mu

Recent motion-aware large language models have demonstrated promising potential in unifying motion comprehension and generation. However, existing approaches primarily focus on coarse-grained motion-text modeling, where text describes the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Bizhu Wu , Jinheng Xie , Keming Shen , Zhe Kong , Jianfeng Ren , Ruibin Bai , Rong Qu , Linlin Shen

We present a generative model that learns to synthesize human motion from limited training sequences. Our framework provides conditional generation and blending across multiple temporal resolutions. The model adeptly captures human motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 David Eduardo Moreno-Villamarín , Anna Hilsmann , Peter Eisert

Language plays a vital role in the realm of human motion. Existing methods have largely depended on CLIP text embeddings for motion generation, yet they fall short in effectively aligning language and motion due to CLIP's pretraining on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zhe Li , Weihao Yuan , Yisheng He , Lingteng Qiu , Shenhao Zhu , Xiaodong Gu , Weichao Shen , Yuan Dong , Zilong Dong , Laurence T. Yang

Text-driven human motion generation is a multimodal task that synthesizes human motion sequences conditioned on natural language. It requires the model to satisfy textual descriptions under varying conditional inputs, while generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Xingyu Chen

Text-guided human motion generation has drawn significant interest because of its impactful applications spanning animation and robotics. Recently, application of diffusion models for motion generation has enabled improvements in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Samaneh Azadi , Akbar Shah , Thomas Hayes , Devi Parikh , Sonal Gupta

This work introduces MotionLCM, extending controllable motion generation to a real-time level. Existing methods for spatial-temporal control in text-conditioned motion generation suffer from significant runtime inefficiency. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Wenxun Dai , Ling-Hao Chen , Jingbo Wang , Jinpeng Liu , Bo Dai , Yansong Tang

Text-to-motion (T2M) generation aims to control the behavior of a target character via textual descriptions. Leveraging text-motion paired datasets, existing T2M models have achieved impressive performance in generating high-quality motions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiakun Zheng , Ting Xiao , Shiqin Cao , Xinran Li , Zhe Wang , Chenjia Bai