English
Related papers

Related papers: Learning Dynamic Robot-to-Human Object Handover fr…

200 papers

Humans frequently grasp, manipulate, and move objects. Interactive systems assist humans in these tasks, enabling applications in Embodied AI, human-robot interaction, and virtual reality. However, current methods in hand-object synthesis…

Robotics · Computer Science 2025-03-10 Sammy Christen

Object handover is a common human collaboration behavior that attracts attention from researchers in Robotics and Cognitive Science. Though visual perception plays an important role in the object handover task, the whole handover process…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Ruolin Ye , Wenqiang Xu , Zhendong Xue , Tutian Tang , Yanfeng Wang , Cewu Lu

We propose the first framework to learn control policies for vision-based human-to-robot handovers, a critical task for human-robot interaction. While research in Embodied AI has made significant progress in training robot agents in…

Robotics · Computer Science 2023-03-31 Sammy Christen , Wei Yang , Claudia Pérez-D'Arpino , Otmar Hilliges , Dieter Fox , Yu-Wei Chao

Robots are required to autonomously respond to changing situations. Imitation learning is a promising candidate for achieving generalization performance, and extensive results have been demonstrated in object manipulation. However,…

Robotics · Computer Science 2021-01-21 Ayumu Sasagawa , Kazuki Fujimoto , Sho Sakaino , Toshiaki Tsuji

Humans leverage multiple sensor modalities when interacting with objects and discovering their intrinsic properties. Using the visual modality alone is insufficient for deriving intuition behind object properties (e.g., which of two boxes…

Robotics · Computer Science 2023-07-07 Gyan Tatiya , Jonathan Francis , Jivko Sinapov

Human-robot teaming (HRT) systems often rely on large-scale datasets of human and robot interactions, especially for close-proximity collaboration tasks such as human-robot handovers. Learning robot manipulation policies from raw,…

Robotics · Computer Science 2025-08-14 Yuekun Wu , Yik Lung Pang , Andrea Cavallaro , Changjae Oh

Robots must move legibly around people for safety reasons, especially for tasks where physical contact is possible. One such task is handovers, which requires implicit communication on where and when physical contact (object transfer)…

Wheelchair-mounted robotic arms (and other assistive robots) should help their users perform everyday tasks. One way robots can provide this assistance is shared autonomy. Within shared autonomy, both the human and robot maintain control…

Robotics · Computer Science 2021-09-29 Ananth Jonnavittula , Dylan P. Losey

We introduce a new simulation benchmark "HandoverSim" for human-to-robot object handovers. To simulate the giver's motion, we leverage a recent motion capture dataset of hand grasping of objects. We create training and evaluation…

To facilitate human-robot interaction and gain human trust, a robot should recognize and adapt to changes in human behavior. This work documents different human behaviors observed while taking objects from an interactive robot in an…

Robotics · Computer Science 2025-01-07 Parag Khanna , Elmira Yadollahi , Iolanda Leite , Mårten Björkman , Christian Smith

The ability to learn from human demonstration endows robots with the ability to automate various tasks. However, directly learning from human demonstration is challenging since the structure of the human hand can be very different from the…

Robotics · Computer Science 2022-12-09 Xingyu Liu , Deepak Pathak , Kris M. Kitani

Collaborative space robots are an emerging technology with high impact as robots facilitate servicing functions in collaboration with astronauts with higher precision during lengthy tasks, under tight operational schedules, with less risk…

Robotics · Computer Science 2020-09-22 Adriana Fernandes , Rodrigo Ventura

Object handover is an important skill that we use daily when interacting with other humans. To deploy robots in collaborative setting, like houses, being able to receive and handing over objects safely and efficiently becomes a crucial…

Robotics · Computer Science 2025-06-23 Daniel Frau-Alfaro , Julio Castaño-Amoros , Santiago Puente , Pablo Gil , Roberto Calandra

In recent years, there has been a significant effort dedicated to developing efficient, robust, and general human-to-robot handover systems. However, the area of flexible handover in the context of complex and continuous objects' motion…

Robotics · Computer Science 2023-08-31 Gu Zhang , Hao-Shu Fang , Hongjie Fang , Cewu Lu

During a robot to human object handover task, several intended or unintended events may occur with the object - it may be pulled, pushed, bumped or simply held - by the human receiver. We show that it is possible to differentiate between…

Robotics · Computer Science 2019-09-17 Mohammad-Javad Davari , Michael Hegedus , Kamal Gupta , Mehran Mehrandezh

Vision-based human-to-robot handover is an important and challenging task in human-robot interaction. Recent work has attempted to train robot policies by interacting with dynamic virtual humans in simulated environments, where the policies…

Robotics · Computer Science 2025-01-03 Sammy Christen , Lan Feng , Wei Yang , Yu-Wei Chao , Otmar Hilliges , Jie Song

One of the first and foremost non-verbal interactions that humans perform is a handshake. It has an impact on first impressions as touch can convey complex emotions. This makes handshaking an important skill for the repertoire of a social…

Robotics · Computer Science 2021-03-29 Vignesh Prasad , Ruth Stock-Homburg , Jan Peters

This paper introduces MobileH2R, a framework for learning generalizable vision-based human-to-mobile-robot (H2MR) handover skills. Unlike traditional fixed-base handovers, this task requires a mobile robot to reliably receive objects in a…

Robotics · Computer Science 2025-01-10 Zifan Wang , Ziqing Chen , Junyu Chen , Jilong Wang , Yuxin Yang , Yunze Liu , Xueyi Liu , He Wang , Li Yi

Human-to-Robot handovers are useful for many Human-Robot Interaction scenarios. It is important to recognize when a human intends to initiate handovers, so that the robot does not try to take objects from humans when a handover is not…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jun Kwan , Chinkye Tan , Akansel Cosgun

Existing approaches to direct robot-to-human handovers are typically implemented on fixed-base robot arms, or on mobile manipulators that come to a full stop before performing the handover. We propose "on-the-go" handovers which permit a…

Robotics · Computer Science 2022-10-04 Kerry He , Pradeepsundar Simini , Wesley Chan , Dana Kulić , Elizabeth Croft , Akansel Cosgun