English
Related papers

Related papers: Scene Synthesis from Human Motion

200 papers

The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications. Previous approaches for scene-aware motion synthesis are constrained by pre-defined target objects or positions and thus…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jingbo Wang , Yu Rong , Jingyuan Liu , Sijie Yan , Dahua Lin , Bo Dai

We revisit human motion synthesis, a task useful in various real world applications, in this paper. Whereas a number of methods have been developed previously for this task, they are often limited in two aspects: focusing on the poses while…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jingbo Wang , Sijie Yan , Bo Dai , Dahua LIn

Humans interact with an object in many different ways by making contact at different locations, creating a highly complex motion space that can be difficult to learn, particularly when synthesizing such human interactions in a controllable…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xiaohan Zhang , Bharat Lal Bhatnagar , Vladimir Guzov , Sebastian Starke , Gerard Pons-Moll

Creating scenes for captured motions that achieve realistic human-scene interaction is crucial for 3D animation in movies or video games. As character motion is often captured in a blue-screened studio without real furniture or objects in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Jianan Li , Tao Huang , Qingxu Zhu , Tien-Tsin Wong

We introduce a method to synthesize animator guided human motion across 3D scenes. Given a set of sparse (3 or 4) joint locations (such as the location of a person's hand and two feet) and a seed motion sequence in a 3D scene, our method…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Aymen Mir , Xavier Puig , Angjoo Kanazawa , Gerard Pons-Moll

Synthesizing 3D human motion plays an important role in many graphics applications as well as understanding human activity. While many efforts have been made on generating realistic and natural human motion, most approaches neglect the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jiashun Wang , Huazhe Xu , Jingwei Xu , Sifei Liu , Xiaolong Wang

Human motion synthesis in 3D scenes relies heavily on scene comprehension, while current methods focus mainly on scene structure but ignore the semantic understanding. In this paper, we propose a human motion synthesis framework that take…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Gong Jingyu , Tong Kunkun , Chen Zhuoran , Yuan Chuanhan , Chen Mingang , Zhang Zhizhong , Tan Xin , Xie Yuan

We present a novel method for populating 3D indoor scenes with virtual humans that can navigate in the environment and interact with objects in a realistic manner. Existing approaches rely on training sequences that contain captured human…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Kaifeng Zhao , Yan Zhang , Shaofei Wang , Thabo Beeler , Siyu Tang

Generating good quality and geometrically plausible synthetic images of humans with the ability to control appearance, pose and shape parameters, has become increasingly important for a variety of tasks ranging from photo editing, fashion…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Mihai Zanfir , Elisabeta Oneata , Alin-Ionut Popa , Andrei Zanfir , Cristian Sminchisescu

This paper tackles the problem of physics-aware human motion synthesis in a dynamic scene. Unlike existing works which mainly tend to generate physically unrealistic motions due to limited contact modeling, typically restricted to hands, in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Chaoyue Xing , Wei Mao , Miaomiao Liu

Synthesizing natural interactions between virtual humans and their 3D environments is critical for numerous applications, such as computer games and AR/VR experiences. Our goal is to synthesize humans interacting with a given 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Kaifeng Zhao , Shaofei Wang , Yan Zhang , Thabo Beeler , Siyu Tang

Synthesizing human motions in 3D environments, particularly those with complex activities such as locomotion, hand-reaching, and human-object interaction, presents substantial demands for user-defined waypoints and stage transitions. These…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Nan Jiang , Zimo He , Zi Wang , Hongjie Li , Yixin Chen , Siyuan Huang , Yixin Zhu

Modeling human behaviors in contextual environments has a wide range of applications in character animation, embodied AI, VR/AR, and robotics. In real-world scenarios, humans frequently interact with the environment and manipulate various…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Jiaman Li , Jiajun Wu , C. Karen Liu

Complex scenes present significant challenges for predicting human behaviour due to the abundance of interaction information, such as human-human and humanenvironment interactions. These factors complicate the analysis and understanding of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Caiyi Sun , Yujing Sun , Xiao Han , Zemin Yang , Jiawei Liu , Xinge Zhu , Siu Ming Yiu , Yuexin Ma

Human movement is goal-directed and influenced by the spatial layout of the objects in the scene. To plan future human motion, it is crucial to perceive the environment -- imagine how hard it is to navigate a new room with lights off.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Zhe Cao , Hang Gao , Karttikeya Mangalam , Qi-Zhi Cai , Minh Vo , Jitendra Malik

In this paper, we tackle the task of scene-aware 3D human motion forecasting, which consists of predicting future human poses given a 3D scene and a past human motion. A key challenge of this task is to ensure consistency between the human…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wei Mao , Miaomiao Liu , Richard Hartley , Mathieu Salzmann

Learning to generate diverse scene-aware and goal-oriented human motions in 3D scenes remains challenging due to the mediocre characteristics of the existing datasets on Human-Scene Interaction (HSI); they only have limited scale/quality…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Zan Wang , Yixin Chen , Tengyu Liu , Yixin Zhu , Wei Liang , Siyuan Huang

We present a physics-based character control framework for synthesizing human-scene interactions. Recent advances adopt physics simulation to mitigate artifacts produced by data-driven kinematic approaches. However, existing physics-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Liang Pan , Jingbo Wang , Buzhen Huang , Junyu Zhang , Haofan Wang , Xu Tang , Yangang Wang

Human motion synthesis is an important problem with applications in graphics, gaming and simulation environments for robotics. Existing methods require accurate motion capture data for training, which is costly to obtain. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Kevin Xie , Tingwu Wang , Umar Iqbal , Yunrong Guo , Sanja Fidler , Florian Shkurti

Generating realistic human videos remains a challenging task, with the most effective methods currently relying on a human motion sequence as a control signal. Existing approaches often use existing motion extracted from other videos, which…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Hsin-Ping Huang , Yang Zhou , Jui-Hsien Wang , Difan Liu , Feng Liu , Ming-Hsuan Yang , Zhan Xu
‹ Prev 1 2 3 10 Next ›