We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.
Cite
@article{arxiv.1803.02124,
title = {MIRIAM: A Multimodal Chat-Based Interface for Autonomous Systems},
author = {Helen Hastie and Francisco J. Chiyah Garcia and David A. Robb and Pedro Patron and Atanas Laskov},
journal= {arXiv preprint arXiv:1803.02124},
year = {2018}
}
Comments
2 pages, ICMI'17, 19th ACM International Conference on Multimodal Interaction, November 13-17 2017, Glasgow, UK