English
Related papers

Related papers: MoReact: Generating Reactive Motion from Textual D…

200 papers

Modeling human-human interactions from text remains challenging because it requires not only realistic individual dynamics but also precise, text-consistent spatiotemporal coupling between agents. Currently, progress is hindered by 1)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Qingxuan Wu , Zhiyang Dou , Chuan Guo , Yiming Huang , Qiao Feng , Bing Zhou , Jian Wang , Lingjie Liu

Human behaviors in real-world environments are inherently interactive, with an individual's motion shaped by surrounding agents and the scene. Such capabilities are essential for applications in virtual avatars, interactive animation, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Yaoqin Ye , Yiteng Xu , Qin Sun , Xinge Zhu , Yujing Sun , Yuexin Ma

Conversational scenarios are very common in real-world settings, yet existing co-speech motion synthesis approaches often fall short in these contexts, where one person's audio and gestures will influence the other's responses.…

Sound · Computer Science 2024-12-04 Mingyi Shi , Dafei Qin , Leo Ho , Zhouyingcheng Liao , Yinghao Huang , Junichi Yamagishi , Taku Komura

Recent success with large language models has sparked a new wave of verbal human-AI interaction. While such models support users in a variety of creative tasks, they lack the embodied nature of human interaction. Dance, as a primal form of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Alexander Okupnik , Johannes Schneider , Kyriakos Flouris

Text-guided human motion generation has drawn significant interest because of its impactful applications spanning animation and robotics. Recently, application of diffusion models for motion generation has enabled improvements in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Samaneh Azadi , Akbar Shah , Thomas Hayes , Devi Parikh , Sonal Gupta

Generating human-human motion interactions conditioned on textual descriptions is a very useful application in many areas such as robotics, gaming, animation, and the metaverse. Alongside this utility also comes a great difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Pablo Ruiz Ponce , German Barquero , Cristina Palmero , Sergio Escalera , Jose Garcia-Rodriguez

The way humans interact with each other, including interpersonal distances, spatial configuration, and motion, varies significantly across different situations. To enable machines to understand such complex, context-dependent behaviors, it…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Jeonghyeon Na , Sangwon Baik , Inhee Lee , Junyoung Lee , Hanbyul Joo

Recent advances in generative motion synthesis have enabled the production of realistic human motions from diverse input modalities. However, synthesizing compound actions from texts, which integrate multiple concurrent actions into…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yue Jiang , Mingyu Yang , Liuyuxin Yang , Yang Xu , Bingxin Yun , Yuhe Zhang

Current approaches for 3D human motion synthesis generate high quality animations of digital humans performing a wide variety of actions and gestures. However, a notable technological gap exists in addressing the complex dynamics of multi…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Anindita Ghosh , Rishabh Dabral , Vladislav Golyanik , Christian Theobalt , Philipp Slusallek

Humans inhabit a world defined by interactions -- with other humans, objects, and environments. These interactive movements not only convey our relationships with our surroundings but also demonstrate how we perceive and communicate with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Kewei Sui , Anindita Ghosh , Inwoo Hwang , Bing Zhou , Jian Wang , Chuan Guo

Verbal and non-verbal human reaction generation is a challenging task, as different reactions could be appropriate for responding to the same behaviour. This paper proposes the first multiple and multimodal (verbal and nonverbal)…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Jiaqi Xu , Cheng Luo , Weicheng Xie , Linlin Shen , Xiaofeng Liu , Lu Liu , Hatice Gunes , Siyang Song

Text-driven human motion generation has recently attracted considerable attention, allowing models to generate human motions based on textual descriptions. However, current methods neglect the influence of human attributes-such as age,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinghan Wang , Kun Xu , Fei Li , Cao Sheng , Jiazhong Yu , Yadong Mu

The body movements accompanying speech aid speakers in expressing their ideas. Co-speech motion generation is one of the important approaches for synthesizing realistic avatars. Due to the intricate correspondence between speech and motion,…

Multimedia · Computer Science 2024-08-28 Sen Wang , Jiangning Zhang , Xin Tan , Zhifeng Xie , Chengjie Wang , Lizhuang Ma

Motion generation, the task of synthesizing realistic motion sequences from various conditioning inputs, has become a central problem in computer vision, computer graphics, and robotics, with applications ranging from animation and virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Aliasghar Khani , Arianna Rampini , Bruno Roy , Larasika Nadela , Noa Kaplan , Evan Atherton , Derek Cheung , Jacky Bibliowicz

Generating realistic human motions that naturally respond to both spoken language and physical objects is crucial for interactive digital experiences. Current methods, however, address speech-driven gestures or object interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Sreehari Rajan , Kunal Bhosikar , Charu Sharma

Text to Motion aims to generate human motions from texts. Existing settings rely on limited Action Texts that include action labels, which limits flexibility and practicability in scenarios difficult to describe directly. This paper extends…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Runqi Wang , Caoyuan Ma , Guopeng Li , Hanrui Xu , Yuke Li , Zheng Wang

Diverse human motion generation is an increasingly important task, having various applications in computer vision, human-computer interaction and animation. While text-to-motion synthesis using diffusion models has shown success in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Heechang Kim , Gwanghyun Kim , Se Young Chun

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Wanjiang Weng , Xiaofeng Tan , Junbo Wang , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Understanding and generating multi-person interactions is a fundamental challenge with broad implications for robotics and social computing. While humans naturally coordinate in groups, modeling such interactions remains difficult due to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Vongani H. Maluleke , Kie Horiuchi , Lea Wilken , Evonne Ng , Jitendra Malik , Angjoo Kanazawa

While text-to-video (T2V) generation has achieved remarkable progress in photorealism, generating intent-aligned videos that faithfully obey physics principles remains a core challenge. In this work, we systematically study Newtonian…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Xiangyu Bai , He Liang , Bishoy Galoaa , Utsav Nandi , Shayda Moezzi , Yuhang He , Sarah Ostadabbas