English

Show Us the Way: Learning to Manage Dialog from Demonstrations

Computation and Language 2020-04-20 v1 Machine Learning Neural and Evolutionary Computing

Abstract

We present our submission to the End-to-End Multi-Domain Dialog Challenge Track of the Eighth Dialog System Technology Challenge. Our proposed dialog system adopts a pipeline architecture, with distinct components for Natural Language Understanding, Dialog State Tracking, Dialog Management and Natural Language Generation. At the core of our system is a reinforcement learning algorithm which uses Deep Q-learning from Demonstrations to learn a dialog policy with the help of expert examples. We find that demonstrations are essential to training an accurate dialog policy where both state and action spaces are large. Evaluation of our Dialog Management component shows that our approach is effective - beating supervised and reinforcement learning baselines.

Keywords

Cite

@article{arxiv.2004.08114,
  title  = {Show Us the Way: Learning to Manage Dialog from Demonstrations},
  author = {Gabriel Gordon-Hall and Philip John Gorinski and Gerasimos Lampouras and Ignacio Iacobacci},
  journal= {arXiv preprint arXiv:2004.08114},
  year   = {2020}
}

Comments

8 pages + 2 pages references, 4 figures, 4 tables, accepted to DSTC8 Workshop at AAAI2020

R2 v1 2026-06-23T14:54:57.189Z