English

Disentangling Language and Knowledge in Task-Oriented Dialogs

Machine Learning 2019-04-08 v3 Computation and Language Machine Learning

Abstract

The Knowledge Base (KB) used for real-world applications, such as booking a movie or restaurant reservation, keeps changing over time. End-to-end neural networks trained for these task-oriented dialogs are expected to be immune to any changes in the KB. However, existing approaches breakdown when asked to handle such changes. We propose an encoder-decoder architecture (BoSsNet) with a novel Bag-of-Sequences (BoSs) memory, which facilitates the disentangled learning of the response's language model and its knowledge incorporation. Consequently, the KB can be modified with new knowledge without a drop in interpretability. We find that BoSsNet outperforms state-of-the-art models, with considerable improvements (> 10\%) on bAbI OOV test sets and other human-human datasets. We also systematically modify existing datasets to measure disentanglement and show BoSsNet to be robust to KB modifications.

Keywords

Cite

@article{arxiv.1805.01216,
  title  = {Disentangling Language and Knowledge in Task-Oriented Dialogs},
  author = {Dinesh Raghu and Nikhil Gupta and Mausam},
  journal= {arXiv preprint arXiv:1805.01216},
  year   = {2019}
}

Comments

Published in NAACL-HLT 2019

R2 v1 2026-06-23T01:43:50.482Z