English

Dialog Flow Induction for Constrainable LLM-Based Chatbots

Computation and Language 2024-08-06 v1

Abstract

LLM-driven dialog systems are used in a diverse set of applications, ranging from healthcare to customer service. However, given their generalization capability, it is difficult to ensure that these chatbots stay within the boundaries of the specialized domains, potentially resulting in inaccurate information and irrelevant responses. This paper introduces an unsupervised approach for automatically inducing domain-specific dialog flows that can be used to constrain LLM-based chatbots. We introduce two variants of dialog flow based on the availability of in-domain conversation instances. Through human and automatic evaluation over various dialog domains, we demonstrate that our high-quality data-guided dialog flows achieve better domain coverage, thereby overcoming the need for extensive manual crafting of such flows.

Keywords

Cite

@article{arxiv.2408.01623,
  title  = {Dialog Flow Induction for Constrainable LLM-Based Chatbots},
  author = {Stuti Agrawal and Nishi Uppuluri and Pranav Pillai and Revanth Gangi Reddy and Zoey Li and Gokhan Tur and Dilek Hakkani-Tur and Heng Ji},
  journal= {arXiv preprint arXiv:2408.01623},
  year   = {2024}
}

Comments

Accepted at SIGDIAL 2024

R2 v1 2026-06-28T18:02:50.185Z