English
Related papers

Related papers: Out-of-Task Training for Dialog State Tracking Mod…

200 papers

Dialogue State Tracking (DST) is critical for comprehensively interpreting user and system utterances, thereby forming the cornerstone of efficient dialogue systems. Despite past research efforts focused on enhancing DST performance through…

Computation and Language · Computer Science 2023-07-25 Yukyung Lee , Takyoung Kim , Hoonsang Yoon , Pilsung Kang , Junseong Bang , Misuk Kim

Dialogue state tracking (DST) is evaluated by exact matching methods, which rely on large amounts of labeled data and ignore semantic consistency, leading to over-evaluation. Currently, leveraging large language models (LLM) in evaluating…

Computation and Language · Computer Science 2024-06-18 Ming Gu , Yan Yang

A typical conversation comprises of multiple turns between participants where they go back-and-forth between different topics. At each user turn, dialogue state tracking (DST) aims to estimate user's goal by processing the current…

Computation and Language · Computer Science 2019-04-08 Sanuj Sharma , Prafulla Kumar Choubey , Ruihong Huang

Tracking the state of the conversation is a central component in task-oriented spoken dialogue systems. One such approach for tracking the dialogue state is slot carryover, where a model makes a binary decision if a slot from the context is…

Computation and Language · Computer Science 2019-06-05 Tongfei Chen , Chetan Naik , Hua He , Pushpendre Rastogi , Lambert Mathias

This paper describes our approach in DSTC 8 Track 4: Schema-Guided Dialogue State Tracking. The goal of this task is to predict the intents and slots in each user turn to complete the dialogue state tracking (DST) based on the information…

Computation and Language · Computer Science 2020-02-04 Yue Ma , Zengfeng Zeng , Dawei Zhu , Xuan Li , Yiying Yang , Xiaoyuan Yao , Kaijie Zhou , Jianping Shen

Dialogue state tracking (DST) aims to convert the dialogue history into dialogue states which consist of slot-value pairs. As condensed structural information memorizing all history information, the dialogue state in the last turn is…

Computation and Language · Computer Science 2023-06-21 Haoning Zhang , Junwei Bao , Haipeng Sun , Youzheng Wu , Wenye Li , Shuguang Cui , Xiaodong He

As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogue states are…

Computation and Language · Computer Science 2022-08-05 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

We present our work on Track 4 in the Dialogue System Technology Challenges 8 (DSTC8). The DSTC8-Track 4 aims to perform dialogue state tracking (DST) under the zero-shot settings, in which the model needs to generalize on unseen service…

Computation and Language · Computer Science 2020-02-04 Yu-Ping Ruan , Zhen-Hua Ling , Jia-Chen Gu , Quan Liu

Dialog state tracking is used to estimate the current belief state of a dialog given all the preceding conversation. Machine reading comprehension, on the other hand, focuses on building systems that read passages of text and answer…

Computation and Language · Computer Science 2019-08-16 Shuyang Gao , Abhishek Sethi , Sanchit Agarwal , Tagyoung Chung , Dilek Hakkani-Tur

Dialogue systems benefit greatly from optimizing on detailed annotations, such as transcribed utterances, internal dialogue state representations and dialogue act labels. However, collecting these annotations is expensive and…

Computation and Language · Computer Science 2019-11-27 Bo-Hsiang Tseng , Marek Rei , Paweł Budzianowski , Richard E. Turner , Bill Byrne , Anna Korhonen

Tracking dialogue states to better interpret user goals and feed downstream policy learning is a bottleneck in dialogue management. Common practice has been to treat it as a problem of classifying dialogue content into a set of pre-defined…

Artificial Intelligence · Computer Science 2020-06-04 Lizi Liao , Yunshan Ma , Wenqiang Lei , Tat-Seng Chua

Generative model has been one of the most common approaches for solving the Dialog State Tracking Problem with the capabilities to model the dialog hypotheses in an explicit manner. The most important task in such Bayesian networks models…

Artificial Intelligence · Computer Science 2017-02-22 Quan Nguyen

RST-style discourse parsing plays a vital role in many NLP tasks, revealing the underlying semantic/pragmatic structure of potentially complex and diverse documents. Despite its importance, one of the most prevailing limitations in modern…

Computation and Language · Computer Science 2021-12-14 Patrick Huber , Linzi Xing , Giuseppe Carenini

Large, human-annotated datasets are central to the development of natural language processing models. Collecting these datasets can be the most challenging part of the development process. We address this problem by introducing a general…

Computation and Language · Computer Science 2020-04-29 Alana Marzoev , Samuel Madden , M. Frans Kaashoek , Michael Cafarella , Jacob Andreas

Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses increasingly important for understanding their relative…

Much of NLP research has focused on crowdsourced static datasets and the supervised learning paradigm of training once and then evaluating test performance. As argued in de Vries et al. (2020), crowdsourced data has the issues of lack of…

Artificial Intelligence · Computer Science 2020-08-20 Kurt Shuster , Jack Urbanek , Emily Dinan , Arthur Szlam , Jason Weston

Task-Oriented Dialogue (TOD) systems are designed to carry out specific tasks by tracking dialogue states and generating appropriate responses to help users achieve defined goals. Recently, end-to-end dialogue models pre-trained based on…

Computation and Language · Computer Science 2023-06-01 Namo Bang , Jeehyun Lee , Myoung-Wan Koo

Augmentation of task-oriented dialogues has followed standard methods used for plain-text such as back-translation, word-level manipulation, and paraphrasing despite its richly annotated structure. In this work, we introduce an augmentation…

Computation and Language · Computer Science 2022-03-23 Taha Aksu , Zhengyuan Liu , Min-Yen Kan , Nancy F. Chen

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

Computation and Language · Computer Science 2024-06-14 James D. Finch , Jinho D. Choi

Most recently proposed approaches in dialogue state tracking (DST) leverage the context and the last dialogue states to track current dialogue states, which are often slot-value pairs. Although the context contains the complete dialogue…

Computation and Language · Computer Science 2021-07-13 Jingyao Zhou , Haipang Wu , Zehao Lin , Guodun Li , Yin Zhang