English
Related papers

Related papers: Real-time and Controllable Reactive Motion Synthes…

200 papers

Predicting future human pose is a fundamental application for machine intelligence, which drives robots to plan their behavior and paths ahead of time to seamlessly accomplish human-robot collaboration in real-world 3D scenarios. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhenyu Lou , Qiongjie Cui , Haofan Wang , Xu Tang , Hong Zhou

Supporting real-time interactions between human controllers and remote devices remains a challenging goal in the Metaverse due to the stringent requirements on computing workload, communication throughput, and round-trip latency. In this…

Robotics · Computer Science 2024-07-24 Kan Chen , Zhen Meng , Xiangmin Xu , Changyang She , Philip G. Zhao

Creating believable motions for various characters has long been a goal in computer graphics. Current learning-based motion synthesis methods depend on extensive motion datasets, which are often challenging, if not impossible, to obtain. On…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Qingqing Zhao , Peizhuo Li , Wang Yifan , Olga Sorkine-Hornung , Gordon Wetzstein

In real-world industrial environments, modern robots often rely on human operators for crucial decision-making and mission synthesis from individual tasks. Effective and safe collaboration between humans and robots requires systems that can…

Robotics · Computer Science 2024-06-26 Mike Allenspach , Michael Pantic , Rik Girod , Lionel Ott , Roland Siegwart

Generating and representing human behavior are of major importance for various computer vision applications. Commonly, human video synthesis represents behavior as sequences of postures while directly predicting their likely progressions or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Andreas Blattmann , Timo Milbich , Michael Dorkenwald , Björn Ommer

The identification of intentionally delivered commands is a challenge in Brain Computer Interfaces (BCIs) based on Sensory-Motor Rhythms (SMR). It is of fundamental importance that BCI systems controlling a robotic device (i.e., upper limb…

Human-Computer Interaction · Computer Science 2019-05-27 Tortora Stefano , Beraldo Gloria , Tonin Luca , Menegatti Emanuele

Shared control can help in teleoperated object manipulation by assisting with the execution of the user's intention. To this end, robust and prompt intention estimation is needed, which relies on behavioral observations. Here, an intention…

Robotics · Computer Science 2022-08-19 Anna Belardinelli , Anirudh Reddy Kondapally , Dirk Ruiken , Daniel Tanneberg , Tomoki Watabe

Haptic guidance in a shared steering assistance system has drawn significant attention in intelligent vehicle fields, owing to its mutual communication ability for vehicle control. By exerting continuous torque on the steering wheel, both…

Robotics · Computer Science 2020-11-17 Zhanhong Yan , Kaiming Yang , Zheng Wang , Bo Yang , Tsutomu Kaizuka , Kimihiko Nakano

Effective human-robot interaction requires robots to identify human intentions and generate expressive, socially appropriate motions in real-time. Existing approaches often rely on fixed motion libraries or computationally expensive…

Robotics · Computer Science 2025-09-30 Lingfan Bao , Yan Pan , Tianhu Peng , Dimitrios Kanoulas , Chengxu Zhou

Anticipating human intention by observing one's actions has many applications. For instance, picking up a cellphone, then a charger (actions) implies that one wants to charge the cellphone (intention). By anticipating the intention, an…

Computer Vision and Pattern Recognition · Computer Science 2017-10-23 Tz-Ying Wu , Ting-An Chien , Cheng-Sheng Chan , Chan-Wei Hu , Min Sun

This paper tackles the problem of physics-aware human motion synthesis in a dynamic scene. Unlike existing works which mainly tend to generate physically unrealistic motions due to limited contact modeling, typically restricted to hands, in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Chaoyue Xing , Wei Mao , Miaomiao Liu

Scene-aware motion synthesis has been widely researched recently due to its numerous applications. Prevailing methods rely heavily on paired motion-scene data, while it is difficult to generalize to diverse scenes when trained only on a few…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jingyu Gong , Chong Zhang , Fengqi Liu , Ke Fan , Qianyu Zhou , Xin Tan , Zhizhong Zhang , Yuan Xie

Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate realistic human behaviors. In this work, we address the challenging problem of generating synchronized object motion and human motion guided by…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jiaman Li , Alexander Clegg , Roozbeh Mottaghi , Jiajun Wu , Xavier Puig , C. Karen Liu

Within this work, we explore intention inference for user actions in the context of a handheld robot setup. Handheld robots share the shape and properties of handheld tools while being able to process task information and aid manipulation.…

Robotics · Computer Science 2019-03-21 Janis Stolzenwald , Walterio W. Mayol-Cuevas

Humans interact with an object in many different ways by making contact at different locations, creating a highly complex motion space that can be difficult to learn, particularly when synthesizing such human interactions in a controllable…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xiaohan Zhang , Bharat Lal Bhatnagar , Vladimir Guzov , Sebastian Starke , Gerard Pons-Moll

Recommender systems have been actively and extensively studied over past decades. In the meanwhile, the boom of Big Data is driving fundamental changes in the development of recommender systems. In this paper, we propose a dynamic…

Information Retrieval · Computer Science 2017-03-13 Shuai Zhang , Lina Yao

Human motion synthesis is an important problem with applications in graphics, gaming and simulation environments for robotics. Existing methods require accurate motion capture data for training, which is costly to obtain. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Kevin Xie , Tingwu Wang , Umar Iqbal , Yunrong Guo , Sanja Fidler , Florian Shkurti

Movement is how people interact with and affect their environment. For realistic character animation, it is necessary to synthesize such interactions between virtual characters and their surroundings. Despite recent progress in character…

Graphics · Computer Science 2023-02-03 Mohamed Hassan , Yunrong Guo , Tingwu Wang , Michael Black , Sanja Fidler , Xue Bin Peng

We propose a physics-based method for synthesizing dexterous hand-object interactions in a full-body setting. While recent advancements have addressed specific facets of human-object interactions, a comprehensive physics-based approach…

Robotics · Computer Science 2023-09-15 Jona Braun , Sammy Christen , Muhammed Kocabas , Emre Aksan , Otmar Hilliges

Current approaches for 3D human motion synthesis generate high quality animations of digital humans performing a wide variety of actions and gestures. However, a notable technological gap exists in addressing the complex dynamics of multi…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Anindita Ghosh , Rishabh Dabral , Vladislav Golyanik , Christian Theobalt , Philipp Slusallek