中文
相关论文

相关论文: Aligning Human Motion Generation with Human Percep…

200 篇论文

Human motion video generation has garnered significant research interest due to its broad applications, enabling innovations such as photorealistic singing heads or dynamic avatars that seamlessly dance to music. However, existing surveys…

Recent success with large language models has sparked a new wave of verbal human-AI interaction. While such models support users in a variety of creative tasks, they lack the embodied nature of human interaction. Dance, as a primal form of…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Alexander Okupnik , Johannes Schneider , Kyriakos Flouris

Human motion generation and editing are key components of computer vision. However, current approaches in this field tend to offer isolated solutions tailored to specific tasks, which can be inefficient and impractical for real-world…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Ziyan Guo , Zeyu Hu , De Wen Soh , Na Zhao

Human motion generation has made tremendous progress in recent years, with state-of-the-art approaches surpassing ground truth data in leading evaluation benchmarks. However, visual inspection of the generated motions paints a different…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Pascal Herrmann , Maarten Bieshaar , Dennis Mack , Robert Herzog , Juergen Gall

Generative models often use human evaluations to measure the perceived quality of their outputs. Automated metrics are noisy indirect proxies, because they rely on heuristics or pretrained embeddings. However, up until now, direct human…

计算机视觉与模式识别 · 计算机科学 2019-11-04 Sharon Zhou , Mitchell L. Gordon , Ranjay Krishna , Austin Narcomey , Li Fei-Fei , Michael S. Bernstein

We present DiverseMotion, a new approach for synthesizing high-quality human motions conditioned on textual descriptions while preserving motion diversity.Despite the recent significant process in text-based human motion generation,existing…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Yunhong Lou , Linchao Zhu , Yaxiong Wang , Xiaohan Wang , Yi Yang

Human motion modeling is important for many modern graphics applications, which typically require professional skills. In order to remove the skill barriers for laymen, recent motion generation methods can directly generate human motions…

计算机视觉与模式识别 · 计算机科学 2022-09-01 Mingyuan Zhang , Zhongang Cai , Liang Pan , Fangzhou Hong , Xinying Guo , Lei Yang , Ziwei Liu

We introduce the Cross Human Motion Diffusion Model (CrossDiff), a novel approach for generating high-quality human motion based on textual descriptions. Our method integrates 3D and 2D information using a shared transformer network within…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Zeping Ren , Shaoli Huang , Xiu Li

Human motion modeling traditionally separates motion generation and estimation into distinct tasks with specialized models. Motion generation models focus on creating diverse, realistic motions from inputs like text, audio, or keyframes,…

图形学 · 计算机科学 2025-05-05 Jiefeng Li , Jinkun Cao , Haotian Zhang , Davis Rempe , Jan Kautz , Umar Iqbal , Ye Yuan

Human motion prediction is an essential part for human-robot collaboration. Unlike most of the existing methods mainly focusing on improving the effectiveness of spatiotemporal modeling for accurate prediction, we take effectiveness and…

计算机视觉与模式识别 · 计算机科学 2020-12-24 Jin Liu , Jianqin Yin

Generative models have made immense progress in recent years, particularly in their ability to generate high quality images. However, that quality has been difficult to evaluate rigorously, with evaluation dominated by heuristic approaches…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Y. Alex Kolchinski , Sharon Zhou , Shengjia Zhao , Mitchell Gordon , Stefano Ermon

We address the challenging problem of robotic grasping and manipulation in the presence of uncertainty. This uncertainty is due to noisy sensing, inaccurate models and hard-to-predict environment dynamics. We quantify the importance of…

Understanding individual-level human mobility is critical for a wide range of applications. As such, real-world trajectory datasets provide valuable insights into actual movement behaviors and patterns of life but are often constrained by…

软件工程 · 计算机科学 2026-01-22 Hossein Amiri , Joon-Seok Kim , Hamdi Kavak , Andrew Crooks , Dieter Pfoser , Carola Wenk , Andreas Züfle

Human motion generation has been widely studied due to its crucial role in areas such as digital humans and humanoid robot control. However, many current motion generation approaches disregard physics constraints, frequently resulting in…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Zhuo Li , Mingshuang Luo , Ruibing Hou , Xin Zhao , Hao Liu , Hong Chang , Zimo Liu , Chen Li

Recent advancements in visual generation technologies have markedly increased the scale and availability of video datasets, which are crucial for training effective video generation models. However, a significant lack of high-quality,…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Hui Li , Mingwang Xu , Yun Zhan , Shan Mu , Jiaye Li , Kaihui Cheng , Yuxuan Chen , Tan Chen , Mao Ye , Jingdong Wang , Siyu Zhu

Human evaluation is critical for validating the performance of text-to-image generative models, as this highly cognitive process requires deep comprehension of text and images. However, our survey of 37 recent papers reveals that many works…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Mayu Otani , Riku Togashi , Yu Sawai , Ryosuke Ishigami , Yuta Nakashima , Esa Rahtu , Janne Heikkilä , Shin'ichi Satoh

Character animation in real-world scenarios necessitates a variety of constraints, such as trajectories, key-frames, interactions, etc. Existing methodologies typically treat single or a finite set of these constraint(s) as separate control…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Hanchao Liu , Xiaohang Zhan , Shaoli Huang , Tai-Jiang Mu , Ying Shan

Video generation assessment is essential for ensuring that generative models produce visually realistic, high-quality videos while aligning with human expectations. Current video generation benchmarks fall into two main categories:…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Hui Han , Siyuan Li , Jiaqi Chen , Yiwen Yuan , Yuling Wu , Chak Tou Leong , Hanwen Du , Junchen Fu , Youhua Li , Jie Zhang , Chi Zhang , Li-jia Li , Yongxin Ni

Long-range human movement generation remains a central challenge in computer vision and graphics. Generating coherent transitions across semantically distinct motion domains remains largely unexplored. This capability is particularly…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Haichao Wang , Alexander Okupnik , Yuxing Han , Gene Wen , Johannes Schneider , Kyriakos Flouris

Human motion generation involves creating natural sequences of human body poses, widely used in gaming, virtual reality, and human-computer interaction. It aims to produce lifelike virtual characters with realistic movements, enhancing…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Jiayi Zhao , Dongdong Weng , Qiuxin Du , Zeyu Tian