English
Related papers

Related papers: Mismatch between Multi-turn Dialogue and its Evalu…

200 papers

Dialog state tracking (DST) is a core component in task-oriented dialog systems. Existing approaches for DST mainly fall into one of two categories, namely, ontology-based and ontology-free methods. An ontology-based method selects a value…

Computation and Language · Computer Science 2020-10-29 Jian-Guo Zhang , Kazuma Hashimoto , Chien-Sheng Wu , Yao Wan , Philip S. Yu , Richard Socher , Caiming Xiong

Existing approaches to Dialogue State Tracking (DST) rely on turn level dialogue state annotations, which are expensive to acquire in large scale. In call centers, for tasks like managing bookings or subscriptions, the user goal can be…

Computation and Language · Computer Science 2021-01-29 Shuailong Liang , Lahari Poddar , Gyuri Szarvas

Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services in diminishing performance on previously learnt services. Motivated by the insight that…

Computation and Language · Computer Science 2025-09-30 Hyundong Cho , Andrea Madotto , Zhaojiang Lin , Khyathi Raghavi Chandu , Satwik Kottur , Jing Xu , Jonathan May , Chinnadhurai Sankar

The performance of task-oriented dialogue models is strongly tied to how well they track dialogue states, which records and updates user information across multi-turn interactions. However, current multi-domain DST encounters two key…

Computation and Language · Computer Science 2026-03-12 Haoxiang Su , Ruiyu Fang , Liting Jiang , Xiaomeng Huang , Shuangyong Song

Tracking the state of the conversation is a central component in task-oriented spoken dialogue systems. One such approach for tracking the dialogue state is slot carryover, where a model makes a binary decision if a slot from the context is…

Computation and Language · Computer Science 2019-06-05 Tongfei Chen , Chetan Naik , Hua He , Pushpendre Rastogi , Lambert Mathias

We tackle the Dialogue Belief State Tracking(DST) problem of task-oriented conversational systems. Recent approaches to this problem leveraging Transformer-based models have yielded great results. However, training these models is…

Computation and Language · Computer Science 2022-04-19 Debjoy Saha , Bishal Santra , Pawan Goyal

This paper introduces a novel approach to Dialogue State Tracking (DST) that leverages Large Language Models (LLMs) to generate natural language descriptions of dialogue states, moving beyond traditional slot-value representations.…

Computation and Language · Computer Science 2025-03-13 Rafael Carranza , Mateo Alejandro Rojas

Augmentation of task-oriented dialogues has followed standard methods used for plain-text such as back-translation, word-level manipulation, and paraphrasing despite its richly annotated structure. In this work, we introduce an augmentation…

Computation and Language · Computer Science 2022-03-23 Taha Aksu , Zhengyuan Liu , Min-Yen Kan , Nancy F. Chen

While communicating with a user, a task-oriented dialogue system has to track the user's needs at each turn according to the conversation history. This process called dialogue state tracking (DST) is crucial because it directly informs the…

Computation and Language · Computer Science 2022-08-01 Léo Jacqmin , Lina M. Rojas-Barahona , Benoit Favre

Dialogue state trackers have made significant progress on benchmark datasets, but their generalization capability to novel and realistic scenarios beyond the held-out conversations is less understood. We propose controllable counterfactuals…

Computation and Language · Computer Science 2021-03-29 Shiyang Li , Semih Yavuz , Kazuma Hashimoto , Jia Li , Tong Niu , Nazneen Rajani , Xifeng Yan , Yingbo Zhou , Caiming Xiong

Task-oriented dialogue systems often employ a Dialogue State Tracker (DST) to successfully complete conversations. Recent state-of-the-art DST implementations rely on schemata of diverse services to improve model robustness and handle…

Computation and Language · Computer Science 2022-07-05 Eleftherios Kapelonis , Efthymios Georgiou , Alexandros Potamianos

Task-oriented dialog systems rely on dialog state tracking (DST) to monitor the user's goal during the course of an interaction. Multi-domain and open-vocabulary settings complicate the task considerably and demand scalable solutions. In…

Computation and Language · Computer Science 2020-09-28 Michael Heck , Carel van Niekerk , Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Marco Moresi , Milica Gašić

Previous zero-shot dialogue state tracking (DST) methods only apply transfer learning, ignoring unlabelled data in the target domain. We transform zero-shot DST into few-shot DST by utilising such unlabelled data via joint and self-training…

Computation and Language · Computer Science 2024-04-04 Chuang Li , Yan Zhang , Min-Yen Kan , Haizhou Li

In task-oriented multi-turn dialogue systems, dialogue state refers to a compact representation of the user goal in the context of dialogue history. Dialogue state tracking (DST) is to estimate the dialogue state at each turn. Due to the…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Yanbin Zhao , Su Zhu , Kai Yu

Although there have been remarkable advances in dialogue systems through the dialogue systems technology competition (DSTC), it remains one of the key challenges to building a robust task-oriented dialogue system with a speech interface.…

Computation and Language · Computer Science 2024-01-10 Jaeseok Yoon , Seunghyun Hwang , Ran Han , Jeonguk Bang , Kee-Eung Kim

The ability to accurately track what happens during a conversation is essential for the performance of a dialogue system. Current state-of-the-art multi-domain dialogue state trackers achieve just over 55% accuracy on the current go-to…

Computation and Language · Computer Science 2020-11-24 Carel van Niekerk , Michael Heck , Christian Geishauser , Hsien-Chin Lin , Nurul Lubis , Marco Moresi , Milica Gašić

Annotating task-oriented dialogues is notorious for the expensive and difficult data collection process. Few-shot dialogue state tracking (DST) is a realistic solution to this problem. In this paper, we hypothesize that dialogue summaries…

Computation and Language · Computer Science 2022-03-04 Jamin Shin , Hangyeol Yu , Hyeongdon Moon , Andrea Madotto , Juneyoung Park

This paper proposes an improvement to the existing data-driven Neural Belief Tracking (NBT) framework for Dialogue State Tracking (DST). The existing NBT model uses a hand-crafted belief state update mechanism which involves an expensive…

Computation and Language · Computer Science 2018-05-30 Nikola Mrkšić , Ivan Vulić

Dialogue State Tracking (DST), a crucial component of task-oriented dialogue (ToD) systems, keeps track of all important information pertaining to dialogue history: filling slots with the most probable values throughout the conversation.…

Computation and Language · Computer Science 2023-02-28 Han Zhou , Ignacio Iacobacci , Pasquale Minervini

Zero-shot cross-domain dialogue state tracking (DST) enables us to handle task-oriented dialogue in unseen domains without the expense of collecting in-domain data. In this paper, we propose a slot description enhanced generative approach…

Computation and Language · Computer Science 2021-05-11 Zhaojiang Lin , Bing Liu , Seungwhan Moon , Paul Crook , Zhenpeng Zhou , Zhiguang Wang , Zhou Yu , Andrea Madotto , Eunjoon Cho , Rajen Subba