English
Related papers

Related papers: Scaling Large Motion Models with Million-Level Hum…

200 papers

Despite transformative advances in generative motion synthesis, real-time interactive motion control remains dominated by traditional techniques. In this work, we identify two key challenges in bridging research and production: 1) Real-time…

Generating realistic human motion from given action descriptions has experienced significant advancements because of the emerging requirement of digital humans. While recent works have achieved impressive results in generating motion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yaqi Zhang , Di Huang , Bin Liu , Shixiang Tang , Yan Lu , Lu Chen , Lei Bai , Qi Chu , Nenghai Yu , Wanli Ouyang

As wearable sensing becomes increasingly pervasive, a key challenge remains: how can we generate natural language summaries from raw physiological signals such as actigraphy - minute-level movement data collected via accelerometers? In this…

Machine Learning · Computer Science 2025-12-29 Aiwei Zhang , Arvind Pillai , Andrew Campbell , Nicholas C. Jacobson

This work introduces MotionLCM, extending controllable motion generation to a real-time level. Existing methods for spatial-temporal control in text-conditioned motion generation suffer from significant runtime inefficiency. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Wenxun Dai , Ling-Hao Chen , Jingbo Wang , Jinpeng Liu , Bo Dai , Yansong Tang

Recent advances in large language models (LLMs) have enabled breakthroughs in many multimodal generation tasks, but a significant performance gap still exists in text-to-motion generation, where LLM-based methods lag far behind non-LLM…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Chuhao Jin , Haosen Li , Bingzi Zhang , Che Liu , Xiting Wang , Ruihua Song , Wenbing Huang , Ying Qin , Fuzheng Zhang , Di Zhang

The proliferation of wearable technology enables the generation of vast amounts of sensor data, offering significant opportunities for advancements in health monitoring, activity recognition, and personalized medicine. However, the…

Human-Computer Interaction · Computer Science 2024-08-02 Emilio Ferrara

In this paper, we introduce a novel path to $\textit{general}$ human motion generation by focusing on 2D space. Traditional methods have primarily generated human motions in 3D, which, while detailed and realistic, are often limited by the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yuan Wang , Zhao Wang , Junhao Gong , Di Huang , Tong He , Wanli Ouyang , Jile Jiao , Xuetao Feng , Qi Dou , Shixiang Tang , Dan Xu

Large language models (LLMs) have unified diverse linguistic tasks within a single framework, yet such unification remains unexplored in human motion generation. Existing methods are confined to isolated tasks, limiting flexibility for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Wendong Bu , Kaihang Pan , Yuze Lin , Jiacheng Li , Kai Shen , Wenqiao Zhang , Juncheng Li , Jun Xiao , Siliang Tang

Large language models (LLMs) are, by design, inherently capable of multi-task learning: through a unified next-token prediction paradigm, they can naturally address a wide variety of downstream tasks. Prior work in the motion domain has…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zeyu Ling , Bo Han , Shiyang Li , Jikang Cheng , Hongdeng Shen , Changqing Zou

Human motion generation is a critical task with a wide range of applications. Achieving high realism in generated motions requires naturalness, smoothness, and plausibility. Despite rapid advancements in the field, current generation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Haoru Wang , Wentao Zhu , Luyi Miao , Yishu Xu , Feng Gao , Qi Tian , Yizhou Wang

The success of foundation models in language has inspired a new wave of general-purpose models for human mobility. However, existing approaches struggle to scale effectively due to two fundamental limitations: a failure to use meaningful…

Artificial Intelligence · Computer Science 2025-11-25 Chonghua Han , Yuan Yuan , Jingtao Ding , Jie Feng , Fanjin Meng , Yong Li

This paper presents an in-depth survey on the use of multimodal Generative Artificial Intelligence (GenAI) and autoregressive Large Language Models (LLMs) for human motion understanding and generation, offering insights into emerging…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Muhammad Islam , Tao Huang , Euijoon Ahn , Usman Naseem

We propose a new representation of human body motion which encodes a full motion in a sequence of latent motion primitives. Recently, task generic motion priors have been introduced and propose a coherent representation of human motion…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Mathieu Marsot , Stefanie Wuhrer , Jean-Sebastien Franco , Anne Hélène Olivier

Large-scale human mobility simulation is critical for many science domains such as urban science, epidemiology, and transportation analysis. Recent works treat large language models (LLMs) as human agents to simulate realistic mobility…

Multiagent Systems · Computer Science 2026-02-20 Hua Yan , Heng Tan , Yu Yang

We present DiverseMotion, a new approach for synthesizing high-quality human motions conditioned on textual descriptions while preserving motion diversity.Despite the recent significant process in text-based human motion generation,existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yunhong Lou , Linchao Zhu , Yaxiong Wang , Xiaohan Wang , Yi Yang

We introduce SensorLLM, a two-stage framework that enables Large Language Models (LLMs) to perform human activity recognition (HAR) from sensor time-series data. Despite their strong reasoning and generalization capabilities, LLMs remain…

Computation and Language · Computer Science 2025-08-26 Zechen Li , Shohreh Deldari , Linyao Chen , Hao Xue , Flora D. Salim

Accurate human mobility prediction underpins many important applications across a variety of domains, including epidemic modelling, transport planning, and emergency responses. Due to the sparsity of mobility data and the stochastic nature…

Artificial Intelligence · Computer Science 2024-01-10 Xinglei Wang , Meng Fang , Zichao Zeng , Tao Cheng

Large Language Models (LLMs) have demonstrated remarkable capabilities in various domains, including data augmentation and synthetic data generation. This work explores the use of LLMs to generate rich textual descriptions for motion…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Radu Chivereanu , Adrian Cosma , Andy Catruna , Razvan Rughinis , Emilian Radoi

Motion generation, the task of synthesizing realistic motion sequences from various conditioning inputs, has become a central problem in computer vision, computer graphics, and robotics, with applications ranging from animation and virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Aliasghar Khani , Arianna Rampini , Bruno Roy , Larasika Nadela , Noa Kaplan , Evan Atherton , Derek Cheung , Jacky Bibliowicz

Success in generative modeling across language, image, and video demonstrates that large, well-curated datasets are the key driver for building capable models. 3D Human motion, however, has lagged behind, constrained by an unsatisfying…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jiahao Zhang , Joseph Liu , Young-Yoon Lee , Seonghyeon Moon , Victor Zordan , Guy Tevet , Karen Liu , Stephen Gould , Oren Jacob , Haomiao Jiang , Mubbasir Kapadia , Yizhak Ben-Shabat