English
Related papers

Related papers: MoGenTS: Motion Generation based on Spatial-Tempor…

200 papers

We present a generative model that learns to synthesize human motion from limited training sequences. Our framework provides conditional generation and blending across multiple temporal resolutions. The model adeptly captures human motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 David Eduardo Moreno-Villamarín , Anna Hilsmann , Peter Eisert

Long-term motion generation is a challenging task that requires producing coherent and realistic sequences over extended durations. Current methods primarily rely on framewise motion representations, which capture only static spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Yifei Yang , Zikai Huang , Chenshu Xu , Shengfeng He

We propose a novel task for generating 3D dance movements that simultaneously incorporate both text and music modalities. Unlike existing works that generate dance movements using a single modality such as music, our goal is to produce…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Kehong Gong , Dongze Lian , Heng Chang , Chuan Guo , Zihang Jiang , Xinxin Zuo , Michael Bi Mi , Xinchao Wang

Stylized motion generation is actively studied in computer graphics, especially benefiting from the rapid advances in diffusion models. The goal of this task is to produce a novel motion respecting both the motion content and the desired…

Graphics · Computer Science 2026-01-27 Lei Zhong , Yi Yang , Changjian Li

Human motion is a continuous physical process in 3D space, governed by complex dynamic and kinematic constraints. Existing methods typically represent the human pose as an abstract graph structure, neglecting the intrinsic physical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Shuaijin Wan

With the rapid progress of large language models (LLMs), multimodal frameworks that unify understanding and generation have become promising, yet they face increasing complexity as the number of modalities and tasks grows. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Bingfan Zhu , Biao Jiang , Sunyi Wang , Shixiang Tang , Tao Chen , Linjie Luo , Youyi Zheng , Xin Chen

Generating 3D human motion from text descriptions remains challenging due to the diverse and complex nature of human motion. While existing methods excel within the training distribution, they often struggle with out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Zongye Zhang , Bohan Kong , Qingjie Liu , Yunhong Wang

Text-driven human motion generation based on diffusion strategies establishes a reliable foundation for multimodal applications in human-computer interactions. However, existing advances face significant efficiency challenges due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Mengxian Hu , Minghao Zhu , Xun Zhou , Qingqing Yan , Shu Li , Chengju Liu , Qijun Chen

3D multi-person motion prediction is a highly complex task, primarily due to the dependencies on both individual past movements and the interactions between agents. Moreover, effectively modeling these interactions often incurs substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yuanhong Zheng , Ruixuan Yu , Jian Sun

Temporal realism remains a central weakness of current generative video models, as most evaluation metrics prioritize spatial appearance and offer limited sensitivity to motion. We introduce a scalable, model-agnostic framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Mert Onur Cakiroglu , Idil Bilge Altun , Zhihe Lu , Mehmet Dalkilic , Hasan Kurban

Text-to-motion generation is driven by learning motion representations for semantic alignment with language. Existing methods rely on either continuous or discrete motion representations. However, continuous representations entangle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Dawei Guan , Di Yang , Chengjie Jin , Jiangtao Wang

We introduce MoLingo, a text-to-motion (T2M) model that generates realistic, lifelike human motion by denoising in a continuous latent space. Recent works perform latent space diffusion, either on the whole latent at once or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yannan He , Garvita Tiwari , Xiaohan Zhang , Pankaj Bora , Tolga Birdal , Jan Eric Lenssen , Gerard Pons-Moll

People may perform diverse gestures affected by various mental and physical factors when speaking the same sentences. This inherent one-to-many relationship makes co-speech gesture generation from audio particularly challenging.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Jing Li , Di Kang , Wenjie Pei , Xuefei Zhe , Ying Zhang , Linchao Bao , Zhenyu He

Imitation learning method has shown immense promise for robotic manipulation, yet its practical deployment is fundamentally constrained by the data scarcity. Despite prior work on collecting large-scale datasets, there still remains a…

Recent advances in transformer-based text-to-motion generation have led to impressive progress in synthesizing high-quality human motion. Nevertheless, jointly achieving high fidelity, streaming capability, real-time responsiveness, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongjie Fu , Tengjiao Sun , Pengcheng Fang , Xiaohao Cai , Hansung Kim

As a unique biometric that can be perceived at a distance, gait has broad applications in person authentication, social security, and so on. Existing gait recognition methods suffer from changes in viewpoint and clothing and barely consider…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingqi Li , Jiaqi Gao , Yuzhen Zhang , Hongming Shan , Junping Zhang

Recent progress in video diffusion models has markedly advanced character animation, which synthesizes motioned videos by animating a static identity image according to a driving video. Explicit methods represent motion using skeleton,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zhufeng Xu , Xuan Gao , Feng-Lin Liu , Haoxian Zhang , Zhixue Fang , Yu-Kun Lai , Xiaoqiang Liu , Pengfei Wan , Lin Gao

Generating 3D human motions from text is a challenging yet valuable task. The key aspects of this task are ensuring text-motion consistency and achieving generation diversity. Although recent advancements have enabled the generation of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zheng Qin , Yabing Wang , Minghui Yang , Sanping Zhou , Ming Yang , Le Wang

Although two-stage Vector Quantized (VQ) generative models allow for synthesizing high-fidelity and high-resolution images, their quantization operator encodes similar patches within an image into the same index, resulting in a repeated…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Chuanxia Zheng , Long Tung Vuong , Jianfei Cai , Dinh Phung

Text-driven motion generation has attracted increasing attention due to its broad applications in virtual reality, animation, and robotics. While existing methods typically model human and animal motion separately, a joint cross-species…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xuan Wang , Kai Ruan , Liyang Qian , Zhizhi Guo , Chang Su , Gaoang Wang