Building a Pilot Software Quality-in-Use Benchmark Dataset
Software Engineering
2015-09-21 v1 Computation and Language
Abstract
Prepared domain specific datasets plays an important role to supervised learning approaches. In this article a new sentence dataset for software quality-in-use is proposed. Three experts were chosen to annotate the data using a proposed annotation scheme. Then the data were reconciled in a (no match eliminate) process to reduce bias. The Kappa, k statistics revealed an acceptable level of agreement; moderate to substantial agreement between the experts. The built data can be used to evaluate software quality-in-use models in sentiment analysis models. Moreover, the annotation scheme can be used to extend the current dataset.
Cite
@article{arxiv.1509.05736,
title = {Building a Pilot Software Quality-in-Use Benchmark Dataset},
author = {Issa Atoum and Chih How Bong and Narayanan Kulathuramaiyer},
journal= {arXiv preprint arXiv:1509.05736},
year = {2015}
}
Comments
6 pages,3 figures, conference Proceedings of 9th International Conference on IT in Asia CITA (2015)