English
Related papers

Related papers: CoCo: Controllable Counterfactuals for Evaluating …

200 papers

In task-oriented multi-turn dialogue systems, dialogue state refers to a compact representation of the user goal in the context of dialogue history. Dialogue state tracking (DST) is to estimate the dialogue state at each turn. Due to the…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Yanbin Zhao , Su Zhu , Kai Yu

Dialogue state tracking (DST) is at the heart of task-oriented dialogue systems. However, the scarcity of labeled data is an obstacle to building accurate and robust state tracking systems that work across a variety of domains. Existing…

Computation and Language · Computer Science 2020-04-14 Shuyang Gao , Sanchit Agarwal , Tagyoung Chung , Di Jin , Dilek Hakkani-Tur

While several state-of-the-art approaches to dialogue state tracking (DST) have shown promising performances on several benchmarks, there is still a significant performance gap between seen slot values (i.e., values that occur in both…

Computation and Language · Computer Science 2020-02-25 Xiaohui Song , Liangjun Zang , Yipeng Su , Xing Wu , Jizhong Han , Songlin Hu

While communicating with a user, a task-oriented dialogue system has to track the user's needs at each turn according to the conversation history. This process called dialogue state tracking (DST) is crucial because it directly informs the…

Computation and Language · Computer Science 2022-08-01 Léo Jacqmin , Lina M. Rojas-Barahona , Benoit Favre

This paper introduces a novel approach to Dialogue State Tracking (DST) that leverages Large Language Models (LLMs) to generate natural language descriptions of dialogue states, moving beyond traditional slot-value representations.…

Computation and Language · Computer Science 2025-03-13 Rafael Carranza , Mateo Alejandro Rojas

Counterfactual examples have proven to be valuable in the field of natural language processing (NLP) for both evaluating and improving the robustness of language models to spurious correlations in datasets. Despite their demonstrated…

Machine Learning · Computer Science 2023-11-01 Tiep Le , Vasudev Lal , Phillip Howard

Sequence-to-sequence state-of-the-art systems for dialogue state tracking (DST) use the full dialogue history as input, represent the current state as a list with all the slots, and generate the entire state from scratch at each dialogue…

Computation and Language · Computer Science 2024-10-17 Pietro Lesci , Yoshinari Fujinuma , Momchil Hardalov , Chao Shang , Yassine Benajiba , Lluis Marquez

Existing approaches to dialogue state tracking rely on pre-defined ontologies consisting of a set of all possible slot types and values. Though such approaches exhibit promising performance on single-domain benchmarks, they suffer from…

Artificial Intelligence · Computer Science 2019-10-21 Liliang Ren , Jianmo Ni , Julian McAuley

Multi-domain dialogue state tracking (DST) is a critical component for conversational AI systems. The domain ontology (i.e., specification of domains, slots, and values) of a conversational AI system is generally incomplete, making the…

Computation and Language · Computer Science 2020-06-23 Li Zhou , Kevin Small

Dialogue state tracking (DST) is a key component of task-oriented dialogue systems. DST estimates the user's goal at each user turn given the interaction until then. State of the art approaches for state tracking rely on deep learning…

Computation and Language · Computer Science 2018-01-03 Abhinav Rastogi , Dilek Hakkani-Tur , Larry Heck

Dialogue state tracking (DST) is an essential component in task-oriented dialogue systems, which estimates user goals at every dialogue turn. However, most previous approaches usually suffer from the following problems. Many discriminative…

Computation and Language · Computer Science 2019-08-22 Qingbin Liu , Shizhu He , Kang Liu , Shengping Liu , Jun Zhao

A Dialogue State Tracker is a key component in dialogue systems which estimates the beliefs of possible user goals at each dialogue turn. Deep learning approaches using recurrent neural networks have shown state-of-the-art performance for…

Computation and Language · Computer Science 2019-11-04 Vevake Balaraman , Bernardo Magnini

Dialogue state tracking (DST) is an essential sub-task for task-oriented dialogue systems. Recent work has focused on deep neural models for DST. However, the neural models require a large dataset for training. Furthermore, applying them to…

Computation and Language · Computer Science 2022-10-06 Hyunmin Jeon , Gary Geunbae Lee

Task-oriented dialogue (TOD) systems are required to identify key information from conversations for the completion of given tasks. Such information is conventionally specified in terms of intents and slots contained in task-specific…

Computation and Language · Computer Science 2022-01-25 Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu

Recent studies in dialogue state tracking (DST) leverage historical information to determine states which are generally represented as slot-value pairs. However, most of them have limitations to efficiently exploit relevant context due to…

Computation and Language · Computer Science 2020-12-22 Yong Shan , Zekang Li , Jinchao Zhang , Fandong Meng , Yang Feng , Cheng Niu , Jie Zhou

As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogue states are…

Computation and Language · Computer Science 2022-08-05 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

Dialogue state tracking (DST) aims at estimating the current dialogue state given all the preceding conversation. For multi-domain DST, the data sparsity problem is a major obstacle due to increased numbers of state candidates and dialogue…

Computation and Language · Computer Science 2020-10-08 Su Zhu , Jieyu Li , Lu Chen , Kai Yu

Dialogue State Tracking (DST) is primarily evaluated using Joint Goal Accuracy (JGA) defined as the fraction of turns where the ground-truth dialogue state exactly matches the prediction. Generally in DST, the dialogue state or belief state…

Computation and Language · Computer Science 2022-04-08 Suvodip Dey , Ramamohan Kummara , Maunendra Sankar Desarkar

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger…

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

Computation and Language · Computer Science 2024-06-14 James D. Finch , Jinho D. Choi