English
Related papers

Related papers: Synthesizing Physical Character-Scene Interactions

200 papers

We present a novel method for populating 3D indoor scenes with virtual humans that can navigate in the environment and interact with objects in a realistic manner. Existing approaches rely on training sequences that contain captured human…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Kaifeng Zhao , Yan Zhang , Shaofei Wang , Thabo Beeler , Siyu Tang

We present a physics-based character control framework for synthesizing human-scene interactions. Recent advances adopt physics simulation to mitigate artifacts produced by data-driven kinematic approaches. However, existing physics-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Liang Pan , Jingbo Wang , Buzhen Huang , Junyu Zhang , Haofan Wang , Xu Tang , Yangang Wang

Synthesizing human motions in 3D environments, particularly those with complex activities such as locomotion, hand-reaching, and human-object interaction, presents substantial demands for user-defined waypoints and stage transitions. These…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Nan Jiang , Zimo He , Zi Wang , Hongjie Li , Yixin Chen , Siyuan Huang , Yixin Zhu

Creating realistic characters that can react to the users' or another character's movement can benefit computer graphics, games and virtual reality hugely. However, synthesizing such reactive motions in human-human interactions is a…

Graphics · Computer Science 2021-10-04 Qianhui Men , Hubert P. H. Shum , Edmond S. L. Ho , Howard Leung

The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications. Previous approaches for scene-aware motion synthesis are constrained by pre-defined target objects or positions and thus…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jingbo Wang , Yu Rong , Jingyuan Liu , Sijie Yan , Dahua Lin , Bo Dai

We revisit human motion synthesis, a task useful in various real world applications, in this paper. Whereas a number of methods have been developed previously for this task, they are often limited in two aspects: focusing on the poses while…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jingbo Wang , Sijie Yan , Bo Dai , Dahua LIn

Humans interact with an object in many different ways by making contact at different locations, creating a highly complex motion space that can be difficult to learn, particularly when synthesizing such human interactions in a controllable…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xiaohan Zhang , Bharat Lal Bhatnagar , Vladimir Guzov , Sebastian Starke , Gerard Pons-Moll

A long-standing goal in computer vision is to capture, model, and realistically synthesize human behavior. Specifically, by learning from data, our goal is to enable virtual humans to navigate within cluttered indoor scenes and naturally…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Mohamed Hassan , Duygu Ceylan , Ruben Villegas , Jun Saito , Jimei Yang , Yi Zhou , Michael Black

Synthesizing natural interactions between virtual humans and their 3D environments is critical for numerous applications, such as computer games and AR/VR experiences. Our goal is to synthesize humans interacting with a given 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Kaifeng Zhao , Shaofei Wang , Yan Zhang , Thabo Beeler , Siyu Tang

Creating scenes for captured motions that achieve realistic human-scene interaction is crucial for 3D animation in movies or video games. As character motion is often captured in a blue-screened studio without real furniture or objects in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Jianan Li , Tao Huang , Qingxu Zhu , Tien-Tsin Wong

Scenes are continuously undergoing dynamic changes in the real world. However, existing human-scene interaction generation methods typically treat the scene as static, which deviates from reality. Inspired by world models, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yin Wang , Zhiying Leng , Haitian Liu , Frederick W. B. Li , Mu Li , Xiaohui Liang

Deploying humanoid robots to interact with real-world environments--such as carrying objects or sitting on chairs--requires generalizable, lifelike motions and robust scene perception. Although prior approaches have advanced each capability…

Interactive applications demand believable characters that respond naturally to dynamic environments. Traditional character animation techniques often struggle to handle arbitrary situations, leading to a growing trend of dynamically…

Graphics · Computer Science 2025-10-28 Jose Luis Ponton , Sheldon Andrews , Carlos Andujar , Nuria Pelechano

We present a simple and intuitive approach for interactive control of physically simulated characters. Our work builds upon generative adversarial networks (GAN) and reinforcement learning, and introduces an imitation learning framework…

Graphics · Computer Science 2022-01-03 Pei Xu , Ioannis Karamouzas

Simulating realistic interaction and motions for physics-based characters is of great interest for interactive applications, and automatic secondary character animation in the movie and video game industries. Recent works in reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Mohamed Younes , Ewa Kijak , Richard Kulpa , Simon Malinowski , Franck Multon

Generating and representing human behavior are of major importance for various computer vision applications. Commonly, human video synthesis represents behavior as sequences of postures while directly predicting their likely progressions or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Andreas Blattmann , Timo Milbich , Michael Dorkenwald , Björn Ommer

There has been an increasing interest in 3D indoor navigation, where a robot in an environment moves to a target according to an instruction. To deploy a robot for navigation in the physical world, lots of training data is required to learn…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fengda Zhu , Linchao Zhu , Yi Yang

Synthesizing graceful and life-like behaviors for physically simulated characters has been a fundamental challenge in computer animation. Data-driven methods that leverage motion tracking are a prominent class of techniques for producing…

Graphics · Computer Science 2022-05-13 Xue Bin Peng , Ze Ma , Pieter Abbeel , Sergey Levine , Angjoo Kanazawa

This paper tackles the problem of physics-aware human motion synthesis in a dynamic scene. Unlike existing works which mainly tend to generate physically unrealistic motions due to limited contact modeling, typically restricted to hands, in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Chaoyue Xing , Wei Mao , Miaomiao Liu

A core challenge for an agent learning to interact with the world is to predict how its actions affect objects in its environment. Many existing methods for learning the dynamics of physical interactions require labeled object information.…

Machine Learning · Computer Science 2016-10-19 Chelsea Finn , Ian Goodfellow , Sergey Levine
‹ Prev 1 2 3 10 Next ›