Demonstration is an effective end-user development paradigm for teaching robots how to perform new tasks. In this paper, we posit that demonstration is useful not only as a teaching tool, but also as a way to understand and assist end-user developers in thinking about a task at hand. As a first step toward gaining this understanding, we constructed a lightweight web interface to crowdsource step-by-step instructions of common household tasks, leveraging the imaginations and past experiences of potential end-user developers. As evidence of the utility of our interface, we deployed the interface on Amazon Mechanical Turk and collected 207 task traces that span 18 different task categories. We describe our vision for how these task traces can be operationalized as task models within end-user development tools and provide a roadmap for future work.
@article{arxiv.2403.14014,
title = {Crowdsourcing Task Traces for Service Robotics},
author = {David Porfirio and Allison Sauppé and Maya Cakmak and Aws Albarghouthi and Bilge Mutlu},
journal= {arXiv preprint arXiv:2403.14014},
year = {2024}
}
Comments
Published in the companion proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction