English
Related papers

Related papers: Annotation Inconsistency and Entity Bias in MultiW…

200 papers

MultiWOZ is a well-known task-oriented dialogue dataset containing over 10,000 annotated dialogues spanning 8 domains. It is extensively used as a benchmark for dialogue state tracking. However, recent works have reported presence of…

Computation and Language · Computer Science 2020-07-28 Xiaoxue Zang , Abhinav Rastogi , Srinivas Sunkara , Raghav Gupta , Jianguo Zhang , Jindong Chen

MultiWOZ 2.0 (Budzianowski et al., 2018) is a recently released multi-domain dialogue dataset spanning 7 distinct domains and containing over 10,000 dialogues. Though immensely useful and one of the largest resources of its kind to-date,…

Computation and Language · Computer Science 2019-12-05 Mihail Eric , Rahul Goel , Shachi Paul , Adarsh Kumar , Abhishek Sethi , Peter Ku , Anuj Kumar Goyal , Sanchit Agarwal , Shuyang Gao , Dilek Hakkani-Tur

The MultiWOZ 2.0 dataset has greatly stimulated the research of task-oriented dialogue systems. However, its state annotations contain substantial noise, which hinders a proper evaluation of model performance. To address this issue, massive…

Computation and Language · Computer Science 2022-07-12 Fanghua Ye , Jarana Manotumruksa , Emine Yilmaz

Task-oriented dialogue systems have made unprecedented progress with multiple state-of-the-art (SOTA) models underpinned by a number of publicly available MultiWOZ datasets. Dialogue state annotations are error-prone, leading to sub-optimal…

Computation and Language · Computer Science 2021-06-15 Ting Han , Ximing Liu , Ryuichi Takanobu , Yixin Lian , Chongxuan Huang , Dazhen Wan , Wei Peng , Minlie Huang

Task oriented dialog agents provide a natural language interface for users to complete their goal. Dialog State Tracking (DST), which is often a core component of these systems, tracks the system's understanding of the user's goal…

Computation and Language · Computer Science 2020-02-21 Adarsh Kumar , Peter Ku , Anuj Kumar Goyal , Angeliki Metallinou , Dilek Hakkani-Tur

Dialogue state tracking (DST) aims to extract essential information from multi-turn dialogue situations and take appropriate actions. A belief state, one of the core pieces of information, refers to the subject and its specific content, and…

Computation and Language · Computer Science 2022-04-01 Takyoung Kim , Hoonsang Yoon , Yukyung Lee , Pilsung Kang , Misuk Kim

As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogue states are…

Computation and Language · Computer Science 2022-08-05 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

Recent studies in dialogue state tracking (DST) leverage historical information to determine states which are generally represented as slot-value pairs. However, most of them have limitations to efficiently exploit relevant context due to…

Computation and Language · Computer Science 2020-12-22 Yong Shan , Zekang Li , Jinchao Zhang , Fandong Meng , Yang Feng , Cheng Niu , Jie Zhou

Multi-domain dialogue state tracking (DST) is a critical component for conversational AI systems. The domain ontology (i.e., specification of domains, slots, and values) of a conversational AI system is generally incomplete, making the…

Computation and Language · Computer Science 2020-06-23 Li Zhou , Kevin Small

Dialogue State Tracking (DST), which is the process of inferring user goals by estimating belief states given the dialogue history, plays a critical role in task-oriented dialogue systems. A coreference phenomenon observed in multi-turn…

Computation and Language · Computer Science 2021-06-17 Ting Han , Chongxuan Huang , Wei Peng

The MultiWOZ 2.0 dataset has greatly boosted the research on dialogue state tracking (DST). However, substantial noise has been discovered in its state annotations. Such noise brings about huge challenges for training DST models robustly.…

Computation and Language · Computer Science 2022-03-15 Fanghua Ye , Yue Feng , Emine Yilmaz

Slot filling is a fundamental task in dialog state tracking in task-oriented dialog systems. In multi-domain task-oriented dialog system, user utterances and system responses may mention multiple named entities and attributes values. A…

Computation and Language · Computer Science 2021-08-26 Yuhao Ding , Yik-Cheung Tam

Dialogue State Tracking is central to multi-domain task-oriented dialogue systems, responsible for extracting information from user utterances. We present a novel hybrid architecture that augments GPT-2 with representations derived from…

Computation and Language · Computer Science 2021-09-24 Weizhe Lin , Bo-Hsiang Tseng , Bill Byrne

Dialog State Tracking (DST), an integral part of modern dialog systems, aims to track user preferences and constraints (slots) in task-oriented dialogs. In real-world settings with constantly changing services, DST systems must generalize…

Computation and Language · Computer Science 2021-01-22 Shuyang Li , Jin Cao , Mukund Sridhar , Henghui Zhu , Shang-Wen Li , Wael Hamza , Julian McAuley

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

Computation and Language · Computer Science 2024-06-14 James D. Finch , Jinho D. Choi

Dialogue systems benefit greatly from optimizing on detailed annotations, such as transcribed utterances, internal dialogue state representations and dialogue act labels. However, collecting these annotations is expensive and…

Computation and Language · Computer Science 2019-11-27 Bo-Hsiang Tseng , Marek Rei , Paweł Budzianowski , Richard E. Turner , Bill Byrne , Anna Korhonen

Existing dialogue state tracking (DST) models require plenty of labeled data. However, collecting high-quality labels is costly, especially when the number of domains increases. In this paper, we address a practical DST problem that is…

Computation and Language · Computer Science 2020-10-28 Chien-Sheng Wu , Steven Hoi , Caiming Xiong

Dialogue state tracking (DST) is at the heart of task-oriented dialogue systems. However, the scarcity of labeled data is an obstacle to building accurate and robust state tracking systems that work across a variety of domains. Existing…

Computation and Language · Computer Science 2020-04-14 Shuyang Gao , Sanchit Agarwal , Tagyoung Chung , Di Jin , Dilek Hakkani-Tur

Dialogue state tracking (DST) aims at estimating the current dialogue state given all the preceding conversation. For multi-domain DST, the data sparsity problem is a major obstacle due to increased numbers of state candidates and dialogue…

Computation and Language · Computer Science 2020-10-08 Su Zhu , Jieyu Li , Lu Chen , Kai Yu

Creating multilingual task-oriented dialogue (TOD) agents is challenging due to the high cost of training data acquisition. Following the research trend of improving training data efficiency, we show for the first time, that in-context…

‹ Prev 1 2 3 10 Next ›