English
Related papers

Related papers: SnapMoGen: Human Motion Generation from Expressive…

200 papers

Diverse human motion generation is an increasingly important task, having various applications in computer vision, human-computer interaction and animation. While text-to-motion synthesis using diffusion models has shown success in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Heechang Kim , Gwanghyun Kim , Se Young Chun

Text-driven human motion generation is an emerging task in animation and humanoid robot design. Existing algorithms directly generate the full sequence which is computationally expensive and prone to errors as it does not pay special…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Zichen Geng , Caren Han , Zeeshan Hayder , Jian Liu , Mubarak Shah , Ajmal Mian

Generating diverse and natural human motion sequences based on textual descriptions constitutes a fundamental and challenging research area within the domains of computer vision, graphics, and robotics. Despite significant advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Ke Fan , Shunlin Lu , Minyue Dai , Runyi Yu , Lixing Xiao , Zhiyang Dou , Junting Dong , Lizhuang Ma , Jingbo Wang

Generating 3D human motions from textual descriptions is an important research problem with broad applications in video games, virtual reality, and augmented reality. Recent methods align the textual description with human motion at the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Bowen Dang , Lin Wu , Xiaohang Yang , Zheng Yuan , Zhixiang Chen

This paper addresses the problem of generating 3D interactive human motion from text. Given a textual description depicting the actions of different body parts in contact with static objects, we synthesize sequences of 3D body poses that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Sihan Ma , Qiong Cao , Jing Zhang , Dacheng Tao

Generating natural human motion from a story has the potential to transform the landscape of animation, gaming, and film industries. A new and challenging task, Story-to-Motion, arises when characters are required to move to various…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Zhongfei Qing , Zhongang Cai , Zhitao Yang , Lei Yang

Text-to-motion generation holds potential for film, gaming, and robotics, yet current methods often prioritize short motion generation, making it challenging to produce long motion sequences effectively: (1) Current methods struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zeyu Zhang , Akide Liu , Qi Chen , Feng Chen , Ian Reid , Richard Hartley , Bohan Zhuang , Hao Tang

Text-to-motion generation has recently garnered significant research interest, primarily focusing on generating human motion sequences in blank backgrounds. However, human motions commonly occur within diverse 3D scenes, which has prompted…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Ziyan Guo , Haoxuan Qu , Hossein Rahmani , Dewen Soh , Ping Hu , Qiuhong Ke , Jun Liu

Text-to-motion generation, which translates textual descriptions into human motions, faces the challenge that users often struggle to precisely convey their intended motions through text alone. To address this issue, this paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Tao Wang , Lei Jin , Zhihua Wu , Qiaozhi He , Jiaming Chu , Yu Cheng , Junliang Xing , Jian Zhao , Shuicheng Yan , Li Wang

Generating 3D human motion based on textual descriptions has been a research focus in recent years. It requires the generated motion to be diverse, natural, and conform to the textual description. Due to the complex spatio-temporal nature…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Chongyang Zhong , Lei Hu , Zihao Zhang , Shihong Xia

Text-driven human motion generation, as one of the vital tasks in computer-aided content creation, has recently attracted increasing attention. While pioneering research has largely focused on improving numerical performance metrics on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Yunyao Mao , Xiaoyang Liu , Wengang Zhou , Zhenbo Lu , Houqiang Li

In this paper, we address the challenging problem of long-term 3D human motion generation. Specifically, we aim to generate a long sequence of smoothly connected actions from a stream of multiple sentences (i.e., paragraph). Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Taeryung Lee , Fabien Baradel , Thomas Lucas , Kyoung Mu Lee , Gregory Rogez

Our paper aims to generate diverse and realistic animal motion sequences from textual descriptions, without a large-scale animal text-motion dataset. While the task of text-driven human motion synthesis is already extensively studied and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Zhangsihao Yang , Mingyuan Zhou , Mengyi Shan , Bingbing Wen , Ziwei Xuan , Mitch Hill , Junjie Bai , Guo-Jun Qi , Yalin Wang

We present DiverseMotion, a new approach for synthesizing high-quality human motions conditioned on textual descriptions while preserving motion diversity.Despite the recent significant process in text-based human motion generation,existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yunhong Lou , Linchao Zhu , Yaxiong Wang , Xiaohan Wang , Yi Yang

Embodied human communication encompasses both verbal (speech) and non-verbal information (e.g., gesture and head movements). Recent advances in machine learning have substantially improved the technologies for generating synthetic versions…

Machine Learning · Computer Science 2021-01-15 Simon Alexanderson , Éva Székely , Gustav Eje Henter , Taras Kucherenko , Jonas Beskow

Modeling and generating human reactions poses a significant challenge with broad applications for computer vision and human-computer interaction. Existing methods either treat multiple individuals as a single entity, directly generating…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xiyan Xu , Sirui Xu , Yu-Xiong Wang , Liang-Yan Gui

Although existing text-to-motion (T2M) methods can produce realistic human motion from text description, it is still difficult to align the generated motion with the desired postures since using text alone is insufficient for precisely…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Ling-An Zeng , Gaojie Wu , Ancong Wu , Jian-Fang Hu , Wei-Shi Zheng

Human motion is highly expressive and naturally aligned with language, yet prevailing methods relying heavily on joint text-motion embeddings struggle to synthesize temporally accurate, detailed motions and often lack explainability. To…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Junkun Jiang , Ho Yin Au , Jingyu Xiang , Jie Chen

Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multi-modal data, such as motion, remains challenging and untouched so far. Fortunately, human motion…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Biao Jiang , Xin Chen , Wen Liu , Jingyi Yu , Gang Yu , Tao Chen

This paper addresses the challenge of learning semantically and functionally meaningful 3D motion priors from real-world videos, in order to enable prediction of future 3D scene motion from a single input image. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Jiahui Lei , Kyle Genova , George Kopanas , Noah Snavely , Leonidas Guibas