English

Perceived Usability of Collaborative Modeling Tools

Human-Computer Interaction 2024-08-27 v1 Software Engineering

Abstract

Context: Online collaborative creation of models is becoming commonplace. Collaborative modeling using chatbots and natural language may lower the barriers to modeling for users from different domains. Objective: We compare the perceived usability of two similarly online collaborative modeling tools, the SOCIO chatbot and the Creately web-based tool. Method: We conducted a crossover experiment with 66 participants. The evaluation instrument was based on the System Usability Scale (SUS). We performed a quantitative and qualitative exploration, employing inferential statistics and thematic analysis. Results: The results indicate that chatbots enabling natural language communication enhance communication and collaboration efficiency and improve the user experience. Conclusion: Chatbots need to improve guidance and help for novices, but they appear beneficial for enhancing user experience.

Keywords

Cite

@article{arxiv.2408.14088,
  title  = {Perceived Usability of Collaborative Modeling Tools},
  author = {Ranci Ren and John W. Castro and Santiago R. Acuña and Oscar Dieste and Silvia T. Acuña},
  journal= {arXiv preprint arXiv:2408.14088},
  year   = {2024}
}
R2 v1 2026-06-28T18:23:41.354Z