English
Related papers

Related papers: Aligning Human Motion Generation with Human Percep…

200 papers

3D human interaction generation has emerged as a key research area, focusing on producing dynamic and contextually relevant interactions between humans and various interactive entities. Recent rapid advancements in 3D model representation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Siyuan Fan , Wenke Huang , Xiantao Cai , Bo Du

Generating realistic human motion is essential for many computer vision and graphics applications. The wide variety of human body shapes and sizes greatly impacts how people move. However, most existing motion models ignore these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Shashank Tripathi , Omid Taheri , Christoph Lassner , Michael J. Black , Daniel Holden , Carsten Stoll

In-betweening human motion generation aims to synthesize intermediate motions that transition between user-specified keyframes. In addition to maintaining smooth transitions, a crucial requirement of this task is to generate diverse motion…

Graphics · Computer Science 2025-08-05 Hua Yu , Jiao Liu , Xu Gui , Melvin Wong , Yaqing Hou , Yew-Soon Ong

Human motion prediction is an essential component for enabling closer human-robot collaboration. The task of accurately predicting human motion is non-trivial. It is compounded by the variability of human motion, both at a skeletal level…

Robotics · Computer Science 2021-07-02 Mohammad Samin Yasar , Tariq Iqbal

Recent advancements have brought generated music closer to human-created compositions, yet evaluating these models remains challenging. While human preference is the gold standard for assessing quality, translating these subjective…

Machine Learning · Computer Science 2025-06-25 Florian Grötschla , Ahmet Solak , Luca A. Lanzendörfer , Roger Wattenhofer

3D Human motion generation is pivotal across film, animation, gaming, and embodied intelligence. Traditional 3D motion synthesis relies on costly motion capture, while recent work shows that 2D videos provide rich, temporally coherent…

Graphics · Computer Science 2026-05-20 Yi-Yang Zhang , Tengjiao Sun , Pengcheng Fang , Deng-Bao Wang , Xiaohao Cai , Min-Ling Zhang , Hansung Kim

Human trajectory data, which plays a crucial role in various applications such as crowd management and epidemic prevention, is challenging to obtain due to practical constraints and privacy concerns. In this context, synthetic human…

Machine Learning · Computer Science 2025-05-20 Bangchao Deng , Xin Jing , Tianyue Yang , Bingqing Qu , Dingqi Yang , Philippe Cudre-Mauroux

Real-time in-between motion generation is universally required in games and highly desirable in existing animation pipelines. Its core challenge lies in the need to satisfy three critical conditions simultaneously: quality, controllability…

Graphics · Computer Science 2022-05-06 Xiangjun Tang , He Wang , Bo Hu , Xu Gong , Ruifan Yi , Qilong Kou , Xiaogang Jin

Virtual human animations have a wide range of applications in virtual and augmented reality. While automatic generation methods of animated virtual humans have been developed, assessing their quality remains challenging. Recently,…

Graphics · Computer Science 2025-11-17 Rim Rekik , Stefanie Wuhrer , Ludovic Hoyet , Katja Zibrek , Anne-Hélène Olivier

Human emotion synthesis is a crucial aspect of affective computing. It involves using computational methods to mimic and convey human emotions through various modalities, with the goal of enabling more natural and effective human-computer…

Machine Learning · Computer Science 2024-12-11 Fei Ma , Yukan Li , Yifan Xie , Ying He , Yi Zhang , Hongwei Ren , Zhou Liu , Wei Yao , Fuji Ren , Fei Richard Yu , Shiguang Ni

Modeling crowd behavior relies on accurate data of pedestrian movements at a high level of detail. Imaging sensors such as cameras provide a good basis for capturing such detailed pedestrian motion data. However, currently available…

Computer Vision and Pattern Recognition · Computer Science 2012-10-11 Stefan Seer , Norbert Brändle , Carlo Ratti

Human-motion video generation has been a challenging task, primarily due to the difficulty inherent in learning human body movements. While some approaches have attempted to drive human-centric video generation explicitly through pose…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Boyuan Wang , Xiaofeng Wang , Chaojun Ni , Guosheng Zhao , Zhiqin Yang , Zheng Zhu , Muyang Zhang , Yukun Zhou , Xinze Chen , Guan Huang , Lihong Liu , Xingang Wang

This paper presents an exploration of preference learning in text-to-motion generation. We find that current improvements in text-to-motion generation still rely on datasets requiring expert labelers with motion capture systems. Instead,…

Machine Learning · Computer Science 2024-04-16 Jenny Sheng , Matthieu Lin , Andrew Zhao , Kevin Pruvost , Yu-Hui Wen , Yangguang Li , Gao Huang , Yong-Jin Liu

Video generation models have developed rapidly in recent years, where generating natural human motion plays a pivotal role. However, accurately evaluating the quality of generated human motion video remains a significant challenge. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Bingzi Zhang , Kaisi Guan , Ruihua Song

Personalized image generation, where reference images of one or more subjects are used to generate their image according to a scene description, has gathered significant interest in the community. However, such generated images suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Parul Gupta , Abhinav Dhall , Thanh-Toan Do

Body and face motion play an integral role in communication. They convey crucial information on the participants. Advances in generative modeling and multi-modal learning have enabled motion generation from signals such as speech,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Lownish Rai Sookha , Nikhil Pakhale , Mudasir Ganaie , Abhinav Dhall

Text-conditioned motion synthesis has made remarkable progress with the emergence of diffusion models. However, the majority of these motion diffusion models are primarily designed for a single character and overlook multi-human…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Zhenzhi Wang , Jingbo Wang , Yixuan Li , Dahua Lin , Bo Dai

Pedestrian motion, due to its causal nature, is strongly influenced by domain gaps arising from discrepancies between training and testing data distributions. Focusing on 3D human pose estimation, this work presents a controllable human…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Xinhao Hu , Yiyi Zhang , Liqing Zhang , Jianfu Zhang

Generating sequences of human-like motions for humanoid robots presents challenges in collecting and analyzing reference human motions, synthesizing new motions based on these reference motions, and mapping the generated motion onto…

Robotics · Computer Science 2025-08-19 Rhea Malhotra , William Chong , Catie Cuan , Oussama Khatib

Generating diverse and natural human motion is one of the long-standing goals for creating intelligent characters in the animated world. In this paper, we propose a self-supervised method for generating long-range, diverse and plausible…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jingwei Xu , Huazhe Xu , Bingbing Ni , Xiaokang Yang , Xiaolong Wang , Trevor Darrell