English
Related papers

Related papers: Mismatch between Multi-turn Dialogue and its Evalu…

200 papers

Recently, resources and tasks were proposed to go beyond state tracking in dialogue systems. An example is the frame tracking task, which requires recording multiple frames, one for each user goal set during the dialogue. This allows a…

Computation and Language · Computer Science 2017-06-07 Hannes Schulz , Jeremie Zumer , Layla El Asri , Shikhar Sharma

Dialogue State Tracking (DST) is a core component of virtual assistants such as Alexa or Siri. To accomplish various tasks, these assistants need to support an increasing number of services and APIs. The Schema-Guided State Tracking track…

Computation and Language · Computer Science 2020-02-10 Pavel Gulyaev , Eugenia Elistratova , Vasily Konovalov , Yuri Kuratov , Leonid Pugachev , Mikhail Burtsev

Dialogue state tracking (DST) is a crucial module in dialogue management. It is usually cast as a supervised training problem, which is not convenient for on-line optimization. In this paper, a novel companion teaching based deep…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Xiang Zhou , Kai Yu

Task-oriented dialogue systems aim to help users achieve their goals in specific domains. Recent neural dialogue systems use the entire dialogue history for abundant contextual information accumulated over multiple conversational turns.…

Computation and Language · Computer Science 2021-03-12 Hyunmin Jeon , Gary Geunbae Lee

In dialogue systems, a dialogue state tracker aims to accurately find a compact representation of the current dialogue status, based on the entire dialogue history. While previous approaches often define dialogue states as a combination of…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Zihan Xu , Yanbin Zhao , Su Zhu , Kai Yu

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger…

Dialogue state tracking (DST) is evaluated by exact matching methods, which rely on large amounts of labeled data and ignore semantic consistency, leading to over-evaluation. Currently, leveraging large language models (LLM) in evaluating…

Computation and Language · Computer Science 2024-06-18 Ming Gu , Yan Yang

Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses increasingly important for understanding their relative…

There has been significant interest in zero and few-shot learning for dialogue state tracking (DST) due to the high cost of collecting and annotating task-oriented dialogues. Recent work has demonstrated that in-context learning requires…

Computation and Language · Computer Science 2023-07-06 Brendan King , Jeffrey Flanigan

Goal-oriented chatbots are essential for automating user tasks, such as booking flights or making restaurant reservations. A key component of these systems is Dialogue State Tracking (DST), which interprets user intent and maintains the…

Computation and Language · Computer Science 2025-03-28 Sejin Lee , Dongha Kim , Min Song

Over-dependence on domain ontology and lack of knowledge sharing across domains are two practical and yet less studied problems of dialogue state tracking. Existing approaches generally fall short in tracking unknown slot values during…

Computation and Language · Computer Science 2019-05-28 Chien-Sheng Wu , Andrea Madotto , Ehsan Hosseini-Asl , Caiming Xiong , Richard Socher , Pascale Fung

Zero-shot Dialogue State Tracking (DST) addresses the challenge of acquiring and annotating task-oriented dialogues, which can be time-consuming and costly. However, DST extends beyond simple slot-filling and requires effective updating…

Computation and Language · Computer Science 2023-11-28 Yuxiang Wu , Guanting Dong , Weiran Xu

Dialogue State Tracking (DST) is core research in dialogue systems and has received much attention. In addition, it is necessary to define a new problem that can deal with dialogue between users as a step toward the conversational AI that…

Computation and Language · Computer Science 2023-01-19 Hyungtak Choi , Hyeonmok Ko , Gurpreet Kaur , Lohith Ravuru , Kiranmayi Gandikota , Manisha Jhawar , Simma Dharani , Pranamya Patil

Within Dialogue Modeling research in AI and NLP, considerable attention has been spent on ``dialogue state tracking'' (DST), which is the ability to update the representations of the speaker's needs at each turn in the dialogue by taking…

Task-oriented dialogue (TOD) systems are required to identify key information from conversations for the completion of given tasks. Such information is conventionally specified in terms of intents and slots contained in task-specific…

Computation and Language · Computer Science 2022-01-25 Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu

Dialogue state tracking (DST) aims at estimating the current dialogue state given all the preceding conversation. For multi-domain DST, the data sparsity problem is a major obstacle due to increased numbers of state candidates and dialogue…

Computation and Language · Computer Science 2020-10-08 Su Zhu , Jieyu Li , Lu Chen , Kai Yu

We investigate the problem of multi-domain Dialogue State Tracking (DST) with open vocabulary, which aims to extract the state from the dialogue. Existing approaches usually concatenate previous dialogue state with dialogue history as the…

Computation and Language · Computer Science 2020-10-22 Yan Zeng , Jian-Yun Nie

Dialogue state tracking (DST) plays an essential role in task-oriented dialogue systems. However, user's input may contain implicit information, posing significant challenges for DST tasks. Additionally, DST data includes complex…

Computation and Language · Computer Science 2024-12-05 Zihao Yi , Zhe Xu , Ying Shen

We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog. By formulating DST as a semantic parsing task over hierarchical representations, we can incorporate semantic…

Zero-shot dialogue state tracking (DST) transfers knowledge to unseen domains, reducing the cost of annotating new datasets. Previous zero-shot DST models mainly suffer from domain transferring and partial prediction problems. To address…

Computation and Language · Computer Science 2024-04-15 Tianwen Tang , Tong Zhu , Haodong Liu , Yin Bai , Jia Cheng , Wenliang Chen
‹ Prev 1 3 4 5 6 7 10 Next ›