Virtual assistant technology has the potential to make a significant impact in the field of software engineering. However, few SE-related datasets exist that would be suitable for the design or training of a virtual assistant. To help lay the groundwork for a hypothetical virtual assistant for API usage, we designed and conducted a Wizard-of-Oz study to gather this crucial data. We hired 30 professional programmers to complete a series of programming tasks by interacting with a simulated virtual assistant. Unbeknownst to the programmers, the virtual assistant was actually operated by another human expert. In this report, we describe our experimental methodology and summarize the results of the study.
@article{arxiv.2001.09925,
title = {The Apiza Corpus: API Usage Dialogues with a Simulated Virtual Assistant},
author = {Zachary Eberhart and Aakash Bansal and Collin McMillan},
journal= {arXiv preprint arXiv:2001.09925},
year = {2020}
}
Comments
Preview of an upcoming TSE submission. 3 Pages + references. The Apiza corpus and relevant data can be found at https://github.com/ApizaCorpus/ApizaCorpus