English

Building chatbots from large scale domain-specific knowledge bases: challenges and opportunities

Computation and Language 2020-01-03 v1

Abstract

Popular conversational agents frameworks such as Alexa Skills Kit (ASK) and Google Actions (gActions) offer unprecedented opportunities for facilitating the development and deployment of voice-enabled AI solutions in various verticals. Nevertheless, understanding user utterances with high accuracy remains a challenging task with these frameworks. Particularly, when building chatbots with large volume of domain-specific entities. In this paper, we describe the challenges and lessons learned from building a large scale virtual assistant for understanding and responding to equipment-related complaints. In the process, we describe an alternative scalable framework for: 1) extracting the knowledge about equipment components and their associated problem entities from short texts, and 2) learning to identify such entities in user utterances. We show through evaluation on a real dataset that the proposed framework, compared to off-the-shelf popular ones, scales better with large volume of entities being up to 30% more accurate, and is more effective in understanding user utterances with domain-specific entities.

Keywords

Cite

@article{arxiv.2001.00100,
  title  = {Building chatbots from large scale domain-specific knowledge bases: challenges and opportunities},
  author = {Walid Shalaby and Adriano Arantes and Teresa GonzalezDiaz and Chetan Gupta},
  journal= {arXiv preprint arXiv:2001.00100},
  year   = {2020}
}
R2 v1 2026-06-23T13:00:31.796Z