English
Related papers

Related papers: InterControl: Zero-shot Human Interaction Generati…

200 papers

We have recently seen tremendous progress in diffusion advances for generating realistic human motions. Yet, they largely disregard the multi-human interactions. In this paper, we present InterGen, an effective diffusion-based approach that…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Han Liang , Wenqian Zhang , Wenxuan Li , Jingyi Yu , Lan Xu

Text-conditioned human motion generation has experienced significant advancements with diffusion models trained on extensive motion capture data and corresponding textual annotations. However, extending such success to 3D dynamic…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Sirui Xu , Ziyin Wang , Yu-Xiong Wang , Liang-Yan Gui

This paper tackles the problem of physics-aware human motion synthesis in a dynamic scene. Unlike existing works which mainly tend to generate physically unrealistic motions due to limited contact modeling, typically restricted to hands, in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Chaoyue Xing , Wei Mao , Miaomiao Liu

Human motion generation has shown great advances thanks to the recent diffusion models trained on large-scale motion capture data. Most of existing works, however, currently target animation of isolated people in empty scenes. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yangsong Zhang , Abdul Ahad Butt , Gül Varol , Ivan Laptev

We present a novel approach named OmniControl for incorporating flexible spatial control signals into a text-conditioned human motion generation model based on the diffusion process. Unlike previous methods that can only control the pelvis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yiming Xie , Varun Jampani , Lei Zhong , Deqing Sun , Huaizu Jiang

Lightweight, controllable, and physically plausible human motion synthesis is crucial for animation, virtual reality, robotics, and human-computer interaction applications. Existing methods often compromise between computational efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Arvin Tashakori , Arash Tashakori , Gongbo Yang , Z. Jane Wang , Peyman Servati

Text-driven motion generation offers a powerful and intuitive way to create human movements directly from natural language. By removing the need for predefined motion inputs, it provides a flexible and accessible approach to controlling…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Ali Rida Sahili , Najett Neji , Hedi Tabia

We present TeSMo, a method for text-controlled scene-aware motion generation based on denoising diffusion models. Previous text-to-motion methods focus on characters in isolation without considering scenes due to the limited availability of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Hongwei Yi , Justus Thies , Michael J. Black , Xue Bin Peng , Davis Rempe

Modeling and generating human reactions poses a significant challenge with broad applications for computer vision and human-computer interaction. Existing methods either treat multiple individuals as a single entity, directly generating…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xiyan Xu , Sirui Xu , Yu-Xiong Wang , Liang-Yan Gui

Human motion generation is a significant pursuit in generative computer vision with widespread applications in film-making, video games, AR/VR, and human-robot interaction. Current methods mainly utilize either diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Canxuan Gang

Generating realistic human-human interactions is a challenging task that requires not only high-quality individual body and hand motions, but also coherent coordination among all interactants. Due to limitations in available data and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Pablo Ruiz-Ponce , Sergio Escalera , José García-Rodríguez , Jiankang Deng , Rolandos Alexandros Potamias

Multi-person interactive motion generation, a critical yet under-explored domain in computer character animation, poses significant challenges such as intricate modeling of inter-human interactions beyond individual motions and generating…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Boyuan Li , Xihua Wang , Ruihua Song , Wenbing Huang

Generating human-human motion interactions conditioned on textual descriptions is a very useful application in many areas such as robotics, gaming, animation, and the metaverse. Alongside this utility also comes a great difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Pablo Ruiz Ponce , German Barquero , Cristina Palmero , Sergio Escalera , Jose Garcia-Rodriguez

Generating diverse and natural human motion is one of the long-standing goals for creating intelligent characters in the animated world. In this paper, we propose a self-supervised method for generating long-range, diverse and plausible…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jingwei Xu , Huazhe Xu , Bingbing Ni , Xiaokang Yang , Xiaolong Wang , Trevor Darrell

Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate realistic human behaviors. In this work, we address the challenging problem of generating synchronized object motion and human motion guided by…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jiaman Li , Alexander Clegg , Roozbeh Mottaghi , Jiajun Wu , Xavier Puig , C. Karen Liu

Character Animation aims to generating character videos from still images through driving signals. Currently, diffusion models have become the mainstream in visual generation research, owing to their robust generative capabilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Li Hu , Xin Gao , Peng Zhang , Ke Sun , Bang Zhang , Liefeng Bo

Specifying nuanced and compelling camera motion remains a significant hurdle for non-expert creators using generative tools, creating an "expressive gap" where generic text prompts fail to capture cinematic vision. This barrier limits…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Pooja Guhan , Divya Kothandaraman , Geonsun Lee , Tsung-Wei Huang , Guan-Ming Su , Dinesh Manocha

Generating realistic human motion with high-level controls is a crucial task for social understanding, robotics, and animation. With high-quality MOCAP data becoming more available recently, a wide range of data-driven approaches have been…

Graphics · Computer Science 2025-07-29 Wenning Xu , Shiyu Fan , Paul Henderson , Edmond S. L. Ho

Generating high-quality whole-body human object interaction motion sequences is becoming increasingly important in various fields such as animation, VR/AR, and robotics. The main challenge of this task lies in determining the level of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yonghao Zhang , Qiang He , Yanguang Wan , Yinda Zhang , Xiaoming Deng , Cuixia Ma , Hongan Wang

This work aims to generate natural and diverse group motions of multiple humans from textual descriptions. While single-person text-to-motion generation is extensively studied, it remains challenging to synthesize motions for more than one…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Mengyi Shan , Lu Dong , Yutao Han , Yuan Yao , Tao Liu , Ifeoma Nwogu , Guo-Jun Qi , Mitch Hill
‹ Prev 1 2 3 10 Next ›