English
Related papers

Related papers: PhysReaction: Physically Plausible Real-Time Human…

200 papers

In this paper, we discuss a framework for teaching bimanual manipulation tasks by imitation. To this end, we present a system and algorithms for learning compliant and contact-rich robot behavior from human demonstrations. The presented…

Robotics · Computer Science 2022-08-02 Simon Stepputtis , Maryam Bandari , Stefan Schaal , Heni Ben Amor

This report reviews recent advancements in human motion prediction, reconstruction, and generation. Human motion prediction focuses on forecasting future poses and movements from historical data, addressing challenges like nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Canxuan Gang , Yiran Wang

Predicting human motion plays a crucial role in ensuring a safe and effective human-robot close collaboration in intelligent remanufacturing systems of the future. Existing works can be categorized into two groups: those focusing on…

Robotics · Computer Science 2023-08-01 Sibo Tian , Minghui Zheng , Xiao Liang

With momentum increasing in the use of social robots as long-term assistive and collaborative partners, humans developing social bonds with these artificial agents appears to be inevitable. In human-human dyads, social bonding plays a…

Robotics · Computer Science 2023-10-18 Imran Khan

There has been an increasing interest in 3D indoor navigation, where a robot in an environment moves to a target according to an instruction. To deploy a robot for navigation in the physical world, lots of training data is required to learn…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fengda Zhu , Linchao Zhu , Yi Yang

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

We address the problem of generating realistic 3D motions of humans interacting with objects in a scene. Our key idea is to create a neural interaction field attached to a specific object, which outputs the distance to the valid interaction…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Nilesh Kulkarni , Davis Rempe , Kyle Genova , Abhijit Kundu , Justin Johnson , David Fouhey , Leonidas Guibas

Natural co-speech gestures are essential components to improve the experience of Human-robot interaction (HRI). However, current gesture generation approaches have many limitations of not being natural, not aligning with the speech and…

Robotics · Computer Science 2024-09-10 Shiyi Tang , Christian Dondrup

Despite substantial progress in text-driven 3D human motion synthesis, generating realistic multi-person interaction sequences remains challenging. Notably, body inter-penetration is a pervasive issue from both data acquisition to the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Nan Lei , Yuan-Ming Li , Ling-An Zeng , Liang Xu , Zhi-Wei Xia , Hui-Wen Huang , Fa-Ting Hong , Wei-Shi Zheng

We present a generative approach to forecast long-term future human behavior in 3D, requiring only weak supervision from readily available 2D human action data. This is a fundamental task enabling many downstream applications. The required…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Christian Diller , Thomas Funkhouser , Angela Dai

Recent advances in 3D content generation have amplified demand for dynamic models that are both visually realistic and physically consistent. However, state-of-the-art video diffusion models frequently produce implausible results such as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Siwei Meng , Yawei Luo , Ping Liu

Human-robot interaction benefits greatly from multimodal sensor inputs as they enable increased robustness and generalization accuracy. Despite this observation, few HRI methods are capable of efficiently performing inference for multimodal…

Robotics · Computer Science 2019-08-15 Joseph Campbell , Simon Stepputtis , Heni Ben Amor

Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate realistic human behaviors. In this work, we address the challenging problem of generating synchronized object motion and human motion guided by…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jiaman Li , Alexander Clegg , Roozbeh Mottaghi , Jiajun Wu , Xavier Puig , C. Karen Liu

Humanoid robots dynamically navigate an environment by interacting with it via contact wrenches exerted at intermittent contact poses. Therefore, it is important to consider dynamics when planning a contact sequence. Traditional contact…

Robotics · Computer Science 2019-03-04 Yu-Chi Lin , Brahayam Ponton , Ludovic Righetti , Dmitry Berenson

Understanding the intentions of robots is essential for natural and seamless human-robot collaboration. Ensuring that robots have means for non-verbal communication is a basis for intuitive and implicit interaction. For this, we contribute…

Robotics · Computer Science 2024-10-03 Jan Leusmann , Steeven Villa , Thomas Liang , Chao Wang , Albrecht Schmidt , Sven Mayer

The integration of humanoid and animal-shaped robots into specialized domains, such as healthcare, multi-terrain operations, and psychotherapy, necessitates a deep understanding of proxemics--the study of spatial behavior that governs…

Human-Computer Interaction · Computer Science 2025-10-03 Xiangmin Xu , Zhen Meng , Emma Li , Mohamed Khamis , Philip G. Zhao , Robin Bretin

Animating an avatar that reflects a user's action in the VR world enables natural interactions with the virtual environment. It has the potential to allow remote users to communicate and collaborate in a way as if they met in person.…

Graphics · Computer Science 2022-09-14 Yongjing Ye , Libin Liu , Lei Hu , Shihong Xia

Incorporating accurate physics-based simulation into interactive design tools is challenging. However, adding the physics accurately becomes crucial to several emerging technologies. For example, in virtual/augmented reality (VR/AR) videos,…

Human-Computer Interaction · Computer Science 2017-12-05 Dingzeyu Li

Generating realistic human-human interactions is a challenging task that requires not only high-quality individual body and hand motions, but also coherent coordination among all interactants. Due to limitations in available data and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Pablo Ruiz-Ponce , Sergio Escalera , José García-Rodríguez , Jiankang Deng , Rolandos Alexandros Potamias

Despite the fact that robotic platforms can provide both consistent practice and objective assessments of users over the course of their training, there are relatively few instances where physical human robot interaction has been…

Robotics · Computer Science 2019-11-20 Kathleen Fitzsimons , Aleksandra Kalinowska , Julius P. A. Dewald , Todd Murphey