English

Omnipotent Virtual Giant for Remote Human-Swarm Interaction

Robotics 2019-04-03 v2

Abstract

This paper proposes an intuitive human-swarm interaction framework inspired by our childhood memory in which we interacted with living ants by changing their positions and environments as if we were omnipotent relative to the ants. In virtual reality, analogously, we can be a super-powered virtual giant who can supervise a swarm of mobile robots in a vast and remote environment by flying over or resizing the world and coordinate them by picking and placing a robot or creating virtual walls. This work implements this idea by using Virtual Reality along with Leap Motion, which is then validated by proof-of-concept experiments using real and virtual mobile robots in mixed reality. We conduct a usability analysis to quantify the effectiveness of the overall system as well as the individual interfaces proposed in this work. The results revealed that the proposed method is intuitive and feasible for interaction with swarm robots, but may require appropriate training for the new end-user interface device.

Keywords

Cite

@article{arxiv.1903.10064,
  title  = {Omnipotent Virtual Giant for Remote Human-Swarm Interaction},
  author = {Inmo Jang and Junyan Hu and Farshad Arvin and Joaquin Carrasco and Barry Lennox},
  journal= {arXiv preprint arXiv:1903.10064},
  year   = {2019}
}

Comments

Submitted to IROS2019. The full demo video is available in https://youtu.be/LOIJPFM8YRA

R2 v1 2026-06-23T08:17:36.506Z