English
Related papers

Related papers: Comprehensive Study: How the Context Information o…

200 papers

Dialogue state trackers have made significant progress on benchmark datasets, but their generalization capability to novel and realistic scenarios beyond the held-out conversations is less understood. We propose controllable counterfactuals…

Computation and Language · Computer Science 2021-03-29 Shiyang Li , Semih Yavuz , Kazuma Hashimoto , Jia Li , Tong Niu , Nazneen Rajani , Xifeng Yan , Yingbo Zhou , Caiming Xiong

Dialogue State Tracking (DST) is a key part of task-oriented dialogue systems, identifying important information in conversations. However, its accuracy drops significantly in spoken dialogue environments due to named entity errors from…

Computation and Language · Computer Science 2025-10-31 Jihyun Lee , Solee Im , Wonjun Lee , Gary Geunbae Lee

We present our work on Track 4 in the Dialogue System Technology Challenges 8 (DSTC8). The DSTC8-Track 4 aims to perform dialogue state tracking (DST) under the zero-shot settings, in which the model needs to generalize on unseen service…

Computation and Language · Computer Science 2020-02-04 Yu-Ping Ruan , Zhen-Hua Ling , Jia-Chen Gu , Quan Liu

The recent abundance of conversational data on the Web and elsewhere calls for effective NLP systems for dialog understanding. Complete utterance-level understanding often requires context understanding, defined by nearby utterances. In…

Computation and Language · Computer Science 2020-10-23 Deepanway Ghosal , Navonil Majumder , Rada Mihalcea , Soujanya Poria

A practical dialogue system requires the capacity for ongoing skill acquisition and adaptability to new tasks while preserving prior knowledge. However, current methods for Continual Dialogue State Tracking (DST), a crucial function of…

Computation and Language · Computer Science 2024-09-01 Yujie Feng , Xu Chu , Yongxin Xu , Guangyuan Shi , Bo Liu , Xiao-Ming Wu

In dialogue systems, a dialogue state tracker aims to accurately find a compact representation of the current dialogue status, based on the entire dialogue history. While previous approaches often define dialogue states as a combination of…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Zihan Xu , Yanbin Zhao , Su Zhu , Kai Yu

Dialogue state tracking (DST) aims to record user queries and goals during a conversational interaction achieved by maintaining a predefined set of slots and their corresponding values. Current approaches decide slot values opaquely, while…

Computation and Language · Computer Science 2024-03-12 Lin Xu , Ningxin Peng , Daquan Zhou , See-Kiong Ng , Jinlan Fu

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

Computation and Language · Computer Science 2024-06-14 James D. Finch , Jinho D. Choi

Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses increasingly important for understanding their relative…

The Dialog State Tracking Challenge 4 (DSTC 4) differentiates itself from the previous three editions as follows: the number of slot-value pairs present in the ontology is much larger, no spoken language understanding output is given, and…

Computation and Language · Computer Science 2016-05-10 Franck Dernoncourt , Ji Young Lee , Trung H. Bui , Hung H. Bui

Dialogue state tracking (DST) is evaluated by exact matching methods, which rely on large amounts of labeled data and ignore semantic consistency, leading to over-evaluation. Currently, leveraging large language models (LLM) in evaluating…

Computation and Language · Computer Science 2024-06-18 Ming Gu , Yan Yang

Dialogue state tracking is an important component in task-oriented dialogue systems to identify users' goals and requests as a dialogue proceeds. However, as most previous models are dependent on dialogue slots, the model complexity soars…

Computation and Language · Computer Science 2019-09-27 Chenguang Zhu , Michael Zeng , Xuedong Huang

In task-oriented dialogue systems, recent dialogue state tracking methods tend to perform one-pass generation of the dialogue state based on the previous dialogue state. The mistakes of these models made at the current turn are prone to be…

Computation and Language · Computer Science 2021-11-01 Xin Tian , Liankai Huang , Yingzhan Lin , Siqi Bao , Huang He , Yunyi Yang , Hua Wu , Fan Wang , Shuqi Sun

We present a novel approach to dialogue state tracking and referring expression resolution tasks. Successful contextual understanding of multi-turn spoken dialogues requires resolving referring expressions across turns and tracking the…

Computation and Language · Computer Science 2019-04-02 Pushpendre Rastogi , Arpit Gupta , Tongfei Chen , Lambert Mathias

Spoken language understanding (SLU) is an essential component in conversational systems. Considering that contexts provide informative cues for better understanding, history can be leveraged for contextual SLU. However, most prior work only…

Computation and Language · Computer Science 2018-11-02 Shang-Yu Su , Pei-Chieh Yuan , Yun-Nung Chen

While several state-of-the-art approaches to dialogue state tracking (DST) have shown promising performances on several benchmarks, there is still a significant performance gap between seen slot values (i.e., values that occur in both…

Computation and Language · Computer Science 2020-02-25 Xiaohui Song , Liangjun Zang , Yipeng Su , Xing Wu , Jizhong Han , Songlin Hu

Previous zero-shot dialogue state tracking (DST) methods only apply transfer learning, ignoring unlabelled data in the target domain. We transform zero-shot DST into few-shot DST by utilising such unlabelled data via joint and self-training…

Computation and Language · Computer Science 2024-04-04 Chuang Li , Yan Zhang , Min-Yen Kan , Haizhou Li

Recently, research on open domain dialogue systems have attracted extensive interests of academic and industrial researchers. The goal of an open domain dialogue system is to imitate humans in conversations. Previous works on single turn…

Computation and Language · Computer Science 2024-10-29 Wei-Nan Zhang , Yiming Cui , Kaiyan Zhang , Yifa Wang , Qingfu Zhu , Lingzhi Li , Ting Liu

Stochastic sampling strategies such as top-k and top-p have been widely used in dialogue generation task. However, as an open-domain chatting system, there will be two different conversation scenarios, i.e. chit-chat and knowledge-based…

Computation and Language · Computer Science 2024-06-13 Yiwei Li , Fei Mi , Yitong Li , Yasheng Wang , Bin Sun , Shaoxiong Feng , Kan Li

The dependencies between system and user utterances in the same turn and across different turns are not fully considered in existing multidomain dialogue state tracking (MDST) models. In this study, we argue that the incorporation of these…

Computation and Language · Computer Science 2020-10-23 Junfan Chen , Richong Zhang , Yongyi Mao , Jie Xu