中文
相关论文

相关论文: Motion Generation from Fine-grained Textual Descri…

200 篇论文

In this paper, we address the challenging problem of long-term 3D human motion generation. Specifically, we aim to generate a long sequence of smoothly connected actions from a stream of multiple sentences (i.e., paragraph). Previous…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Taeryung Lee , Fabien Baradel , Thomas Lucas , Kyoung Mu Lee , Gregory Rogez

Diverse human motion generation is an increasingly important task, having various applications in computer vision, human-computer interaction and animation. While text-to-motion synthesis using diffusion models has shown success in…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Heechang Kim , Gwanghyun Kim , Se Young Chun

Text-driven human motion generation is an emerging task in animation and humanoid robot design. Existing algorithms directly generate the full sequence which is computationally expensive and prone to errors as it does not pay special…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Zichen Geng , Caren Han , Zeeshan Hayder , Jian Liu , Mubarak Shah , Ajmal Mian

Motion synthesis plays a vital role in various fields of artificial intelligence. Among the various conditions of motion generation, text can describe motion details elaborately and is easy to acquire, making text-to-motion(T2M) generation…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Yu Jiang , Yixing Chen , Xingyang Li

Human motion generation from text prompts has made remarkable progress in recent years. However, existing methods primarily rely on either sequence-level or action-level descriptions due to the absence of fine-grained, part-level motion…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Chuqiao Li , Xianghui Xie , Yong Cao , Andreas Geiger , Gerard Pons-Moll

Generating realistic human motion from given action descriptions has experienced significant advancements because of the emerging requirement of digital humans. While recent works have achieved impressive results in generating motion…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Yaqi Zhang , Di Huang , Bin Liu , Shixiang Tang , Yan Lu , Lu Chen , Lei Bai , Qi Chu , Nenghai Yu , Wanli Ouyang

Text-driven content creation has evolved to be a transformative technique that revolutionizes creativity. Here we study the task of text-driven human video generation, where a video sequence is synthesized from texts describing the…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Yuming Jiang , Shuai Yang , Tong Liang Koh , Wayne Wu , Chen Change Loy , Ziwei Liu

Generating human motion guided by conditions such as textual descriptions is challenging due to the need for datasets with pairs of high-quality motion and their corresponding conditions. The difficulty increases when aiming for finer…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Pablo Ruiz-Ponce , German Barquero , Cristina Palmero , Sergio Escalera , José García-Rodríguez

Existing text-driven 3D human motion editing methods have demonstrated significant progress, but are still difficult to precisely control over detailed, part-specific motions due to their global modeling nature. In this paper, we propose…

图形学 · 计算机科学 2026-01-01 Yujie Yang , Zhichao Zhang , Jiazhou Chen , Zichao Wu

Text to Motion aims to generate human motions from texts. Existing settings rely on limited Action Texts that include action labels, which limits flexibility and practicability in scenarios difficult to describe directly. This paper extends…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Runqi Wang , Caoyuan Ma , Guopeng Li , Hanrui Xu , Yuke Li , Zheng Wang

Prior motion generation largely follows two paradigms: continuous diffusion models that excel at kinematic control, and discrete token-based generators that are effective for semantic conditioning. To combine their strengths, we propose a…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Chenyang Gu , Mingyuan Zhang , Haozhe Xie , Zhongang Cai , Lei Yang , Ziwei Liu

Text-to-motion generation has gained increasing attention, but most existing methods are limited to generating short-term motions that correspond to a single sentence describing a single action. However, when a text stream describes a…

计算机视觉与模式识别 · 计算机科学 2023-08-04 Zhao Yang , Bing Su , Ji-Rong Wen

Human communication is inherently multimodal, involving a combination of verbal and non-verbal cues such as speech, facial expressions, and body gestures. Modeling these behaviors is essential for understanding human interaction and for…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Changan Chen , Juze Zhang , Shrinidhi K. Lakshmikanth , Yusu Fang , Ruizhi Shao , Gordon Wetzstein , Li Fei-Fei , Ehsan Adeli

Stochastic human motion prediction aims to forecast multiple plausible future motions given a single pose sequence from the past. Most previous works focus on designing elaborate losses to improve the accuracy, while the diversity is…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Dong Wei , Huaijiang Sun , Bin Li , Jianfeng Lu , Weiqing Li , Xiaoning Sun , Shengxiang Hu

Recent advances in text-to-motion generation using diffusion and autoregressive models have shown promising results. However, these models often suffer from a trade-off between real-time performance, high fidelity, and motion editability.…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Ekkasit Pinyoanuntapong , Pu Wang , Minwoo Lee , Chen Chen

We introduce MotionScript, a novel framework for generating highly detailed, natural language descriptions of 3D human motions. Unlike existing motion datasets that rely on broad action labels or generic captions, MotionScript provides…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Payam Jome Yazdian , Rachel Lagasse , Hamid Mohammadi , Eric Liu , Li Cheng , Angelica Lim

Text-guided dynamic 3D character generation has advanced rapidly, yet producing high-quality motion that faithfully reflects rich textual descriptions remains challenging. Existing methods tend to generate limited sub-actions or incoherent…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Miaowei Wang , Qingxuan Yan , Zhi Cao , Yayuan Li , Oisin Mac Aodha , Jason J. Corso , Amir Vaxman

Enabling humanoid robots to synthesize complex, physically coherent motions from natural language commands is a cornerstone of autonomous robotics and human-robot interaction. While diffusion models have shown promise in this text-to-motion…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Wenshuo Chen , Haozhe Jia , Songning Lai , Lei Wang , Yuqi Lin , Hongru Xiao , Lijie Hu , Yutao Yue

We present Lang2Motion, a framework for language-guided point trajectory generation by aligning motion manifolds with joint embedding spaces. Unlike prior work focusing on human motion or video synthesis, we generate explicit trajectories…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Bishoy Galoaa , Xiangyu Bai , Sarah Ostadabbas

Text-driven person image generation is an emerging and challenging task in cross-modality image generation. Controllable person image generation promotes a wide range of applications such as digital human interaction and virtual try-on.…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Kaiduo Zhang , Muyi Sun , Jianxin Sun , Binghao Zhao , Kunbo Zhang , Zhenan Sun , Tieniu Tan