中文
相关论文

相关论文: Motion-Adapter: A Diffusion Model Adapter for Text…

200 篇论文

Multi-person interactive motion generation, a critical yet under-explored domain in computer character animation, poses significant challenges such as intricate modeling of inter-human interactions beyond individual motions and generating…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Boyuan Li , Xihua Wang , Ruihua Song , Wenbing Huang

We introduce MoLingo, a text-to-motion (T2M) model that generates realistic, lifelike human motion by denoising in a continuous latent space. Recent works perform latent space diffusion, either on the whole latent at once or…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Yannan He , Garvita Tiwari , Xiaohan Zhang , Pankaj Bora , Tolga Birdal , Jan Eric Lenssen , Gerard Pons-Moll

This paper introduces Motion Personalization, a new task that generates personalized motions aligned with text descriptions using several basic motions containing Persona. To support this novel task, we introduce a new large-scale motion…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Boeun Kim , Hea In Jeong , JungHoon Sung , Yihua Cheng , Jeongmin Lee , Ju Yong Chang , Sang-Il Choi , Younggeun Choi , Saim Shin , Jungho Kim , Hyung Jin Chang

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Text-based motion generation models are drawing a surge of interest for their potential for automating the motion-making process in the game, animation, or robot industries. In this paper, we propose a diffusion-based motion synthesis and…

计算机视觉与模式识别 · 计算机科学 2023-01-03 Jihoon Kim , Jiseob Kim , Sungjoon Choi

Text-driven human motion generation aims to synthesize realistic motion sequences that follow textual descriptions. Despite recent advances, accurately aligning motion dynamics with textual semantics remains a fundamental challenge. In this…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Ruxi Gu , Zilei Wang , Wei Wang

We present TeSMo, a method for text-controlled scene-aware motion generation based on denoising diffusion models. Previous text-to-motion methods focus on characters in isolation without considering scenes due to the limited availability of…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Hongwei Yi , Justus Thies , Michael J. Black , Xue Bin Peng , Davis Rempe

We have recently seen tremendous progress in realistic text-to-motion generation. Yet, the existing methods often fail or produce implausible motions with unseen text inputs, which limits the applications. In this paper, we present OMG, a…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Han Liang , Jiacheng Bao , Ruichi Zhang , Sihan Ren , Yuecheng Xu , Sibei Yang , Xin Chen , Jingyi Yu , Lan Xu

Recent work has demonstrated the significant potential of denoising diffusion models for generating human motion, including text-to-motion capabilities. However, these methods are restricted by the paucity of annotated motion data, a focus…

计算机视觉与模式识别 · 计算机科学 2023-08-31 Yonatan Shafir , Guy Tevet , Roy Kapon , Amit H. Bermano

3D human motion generation is crucial for creative industry. Recent advances rely on generative models with domain knowledge for text-driven motion generation, leading to substantial progress in capturing common motions. However, the…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Mingyuan Zhang , Xinying Guo , Liang Pan , Zhongang Cai , Fangzhou Hong , Huirong Li , Lei Yang , Ziwei Liu

While previous approaches to 3D human motion generation have achieved notable success, they often rely on extensive training and are limited to specific tasks. To address these challenges, we introduce Motion-Agent, an efficient…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Qi Wu , Yubo Zhao , Yifan Wang , Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

Human motions are compositional: complex behaviors can be described as combinations of simpler primitives. However, existing approaches primarily focus on forward modeling, e.g., learning holistic mappings from text to motion or composing a…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Jianrong Zhang , Hehe Fan , Yi Yang

In text-to-motion generation, controllability as well as generation quality and speed has become increasingly critical. The controllability challenges include generating a motion of a length that matches the given textual description and…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Kengo Uchida , Takashi Shibuya , Yuhta Takida , Naoki Murata , Julian Tanke , Shusuke Takahashi , Yuki Mitsufuji

Diverse human motion generation is an increasingly important task, having various applications in computer vision, human-computer interaction and animation. While text-to-motion synthesis using diffusion models has shown success in…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Heechang Kim , Gwanghyun Kim , Se Young Chun

Driven by the scalable diffusion models trained on large-scale datasets, text-to-image synthesis methods have shown compelling results. However, these models still fail to precisely follow the text prompt involving multiple objects,…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Quynh Phung , Songwei Ge , Jia-Bin Huang

Lightweight, controllable, and physically plausible human motion synthesis is crucial for animation, virtual reality, robotics, and human-computer interaction applications. Existing methods often compromise between computational efficiency,…

计算机视觉与模式识别 · 计算机科学 2025-01-29 Arvin Tashakori , Arash Tashakori , Gongbo Yang , Z. Jane Wang , Peyman Servati

Human motion generation from text prompts has made remarkable progress in recent years. However, existing methods primarily rely on either sequence-level or action-level descriptions due to the absence of fine-grained, part-level motion…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Chuqiao Li , Xianghui Xie , Yong Cao , Andreas Geiger , Gerard Pons-Moll

Generating natural human motion from a story has the potential to transform the landscape of animation, gaming, and film industries. A new and challenging task, Story-to-Motion, arises when characters are required to move to various…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Zhongfei Qing , Zhongang Cai , Zhitao Yang , Lei Yang

Text-to-Image (T2I) Diffusion Models have achieved remarkable performance in generating high quality images. However, enabling precise control of continuous attributes, especially multiple attributes simultaneously, in a new domain (e.g.,…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Wonwoong Cho , Yan-Ying Chen , Matthew Klenk , David I. Inouye , Yanxia Zhang

Text-to-Motion (T2M) generation aims to synthesize realistic and semantically aligned human motion sequences from natural language descriptions. However, current approaches face dual challenges: Generative models (e.g., diffusion models)…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Zhengdao Li , Siheng Wang , Zeyu Zhang , Hao Tang