This paper presents a research platform that supports spoken dialogue interaction with multiple robots. The demonstration showcases our crafted MultiBot testing scenario in which users can verbally issue search, navigate, and follow instructions to two robotic teammates: a simulated ground robot and an aerial robot. This flexible language and robotic platform takes advantage of existing tools for speech recognition and dialogue management that are compatible with new domains, and implements an inter-agent communication protocol (tactical behavior specification), where verbal instructions are encoded for tasks assigned to the appropriate robot.
@article{arxiv.1910.05624,
title = {A Research Platform for Multi-Robot Dialogue with Humans},
author = {Matthew Marge and Stephen Nogar and Cory J. Hayes and Stephanie M. Lukin and Jesse Bloecker and Eric Holder and Clare Voss},
journal= {arXiv preprint arXiv:1910.05624},
year = {2019}
}
Comments
Accepted for publication at NAACL 2019; also presented at AI-HRI 2019 (arXiv:1909.04812)