English

Hands-On Robotics: Enabling Communication Through Direct Gesture Control

Human-Computer Interaction 2024-01-18 v1 Robotics

Abstract

Effective Human-Robot Interaction (HRI) is fundamental to seamlessly integrating robotic systems into our daily lives. However, current communication modes require additional technological interfaces, which can be cumbersome and indirect. This paper presents a novel approach, using direct motion-based communication by moving a robot's end effector. Our strategy enables users to communicate with a robot by using four distinct gestures -- two handshakes ('formal' and 'informal') and two letters ('W' and 'S'). As a proof-of-concept, we conducted a user study with 16 participants, capturing subjective experience ratings and objective data for training machine learning classifiers. Our findings show that the four different gestures performed by moving the robot's end effector can be distinguished with close to 100% accuracy. Our research offers implications for the design of future HRI interfaces, suggesting that motion-based interaction can empower human operators to communicate directly with robots, removing the necessity for additional hardware.

Keywords

Cite

@article{arxiv.2401.09077,
  title  = {Hands-On Robotics: Enabling Communication Through Direct Gesture Control},
  author = {Max Pascher and Alia Saad and Jonathan Liebers and Roman Heger and Jens Gerken and Stefan Schneegass and Uwe Gruene},
  journal= {arXiv preprint arXiv:2401.09077},
  year   = {2024}
}

Comments

Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction

R2 v1 2026-06-28T14:19:05.169Z