English
Related papers

Related papers: Towards LLM-driven Dialogue State Tracking

200 papers

In-context learning with Large Language Models (LLMs) has emerged as a promising avenue of research in Dialog State Tracking (DST). However, the best-performing in-context learning methods involve retrieving and adding similar examples to…

Computation and Language · Computer Science 2024-02-06 Atharva Kulkarni , Bo-Hsiang Tseng , Joel Ruben Antony Moniz , Dhivya Piraviperumal , Hong Yu , Shruti Bhargava

Few-shot dialogue state tracking (DST) with Large Language Models (LLM) relies on an effective and efficient conversation retriever to find similar in-context examples for prompt learning. Previous works use raw dialogue context as search…

Computation and Language · Computer Science 2024-04-04 Seanie Lee , Jianpeng Cheng , Joris Driesen , Alexandru Coca , Anders Johannsen

Dialogue State Tracking (DST) is an essential element of conversational AI with the objective of deeply understanding the conversation context and leading it toward answering user requests. Due to high demands for open-domain and multi-turn…

Computation and Language · Computer Science 2025-10-02 Samin Mahdipour Aghabagher , Saeedeh Momtazi

Dialogue State Tracking (DST) is core research in dialogue systems and has received much attention. In addition, it is necessary to define a new problem that can deal with dialogue between users as a step toward the conversational AI that…

Computation and Language · Computer Science 2023-01-19 Hyungtak Choi , Hyeonmok Ko , Gurpreet Kaur , Lohith Ravuru , Kiranmayi Gandikota , Manisha Jhawar , Simma Dharani , Pranamya Patil

End-to-end spoken dialogue state tracking (DST) is made difficult by the tandem of having to handle speech input and data scarcity. Combining speech foundation encoders and large language models has been proposed in recent work as to…

Computation and Language · Computer Science 2025-12-01 Katia Vendrame , Bolaji Yusuf , Santosh Kesiraju , Šimon Sedláček , Oldřich Plchot , Jan Černocký

In this work, we approach spoken Dialogue State Tracking (DST) by bridging the representation spaces of speech encoders and LLMs via a small connector module, with a focus on fully open-sourced and open-data components (WavLM-large, OLMo).…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-11 Šimon Sedláček , Bolaji Yusuf , Ján Švec , Pradyoth Hegde , Santosh Kesiraju , Oldřich Plchot , Jan Černocký

We present our work on Track 4 in the Dialogue System Technology Challenges 8 (DSTC8). The DSTC8-Track 4 aims to perform dialogue state tracking (DST) under the zero-shot settings, in which the model needs to generalize on unseen service…

Computation and Language · Computer Science 2020-02-04 Yu-Ping Ruan , Zhen-Hua Ling , Jia-Chen Gu , Quan Liu

Dialog State Tracking (DST) is one of the most crucial modules for goal-oriented dialogue systems. In this paper, we introduce FastSGT (Fast Schema Guided Tracker), a fast and robust BERT-based model for state tracking in goal-oriented…

Machine Learning · Computer Science 2020-08-31 Vahid Noroozi , Yang Zhang , Evelina Bakhturina , Tomasz Kornuta

We tackle the Dialogue Belief State Tracking(DST) problem of task-oriented conversational systems. Recent approaches to this problem leveraging Transformer-based models have yielded great results. However, training these models is…

Computation and Language · Computer Science 2022-04-19 Debjoy Saha , Bishal Santra , Pawan Goyal

Dialog State Tracking (DST), an integral part of modern dialog systems, aims to track user preferences and constraints (slots) in task-oriented dialogs. In real-world settings with constantly changing services, DST systems must generalize…

Computation and Language · Computer Science 2021-01-22 Shuyang Li , Jin Cao , Mukund Sridhar , Henghui Zhu , Shang-Wen Li , Wael Hamza , Julian McAuley

Task oriented dialog agents provide a natural language interface for users to complete their goal. Dialog State Tracking (DST), which is often a core component of these systems, tracks the system's understanding of the user's goal…

Computation and Language · Computer Science 2020-02-21 Adarsh Kumar , Peter Ku , Anuj Kumar Goyal , Angeliki Metallinou , Dilek Hakkani-Tur

Dialogue state tracking (DST) module is an important component for task-oriented dialog systems to understand users' goals and needs. Collecting dialogue state labels including slots and values can be costly, especially with the wide…

Computation and Language · Computer Science 2023-01-27 Yuting Yang , Wenqiang Lei , Pei Huang , Juan Cao , Jintao Li , Tat-Seng Chua

Dialogue state tracking (DST) is a crucial module in dialogue management. It is usually cast as a supervised training problem, which is not convenient for on-line optimization. In this paper, a novel companion teaching based deep…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Xiang Zhou , Kai Yu

This paper presents a novel approach for multi-task learning of language understanding (LU) and dialogue state tracking (DST) in task-oriented dialogue systems. Multi-task training enables the sharing of the neural network layers…

Computation and Language · Computer Science 2018-11-14 Abhinav Rastogi , Raghav Gupta , Dilek Hakkani-Tur

Dialogue State Tracking (DST) is a key part of task-oriented dialogue systems, identifying important information in conversations. However, its accuracy drops significantly in spoken dialogue environments due to named entity errors from…

Computation and Language · Computer Science 2025-10-31 Jihyun Lee , Solee Im , Wonjun Lee , Gary Geunbae Lee

Task-oriented dialogue (TOD) systems are required to identify key information from conversations for the completion of given tasks. Such information is conventionally specified in terms of intents and slots contained in task-specific…

Computation and Language · Computer Science 2022-01-25 Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu

A Dialogue State Tracker (DST) is a key component in a dialogue system aiming at estimating the beliefs of possible user goals at each dialogue turn. Most of the current DST trackers make use of recurrent neural networks and are based on…

Computation and Language · Computer Science 2019-10-23 Vevake Balaraman , Bernardo Magnini

Large language models (LLMs) have demonstrated self-improvement capabilities via feedback and refinement, but current small language models (SLMs) have had limited success in this area. Existing correction approaches often rely on…

Computation and Language · Computer Science 2024-10-25 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

This paper describes our approach in DSTC 8 Track 4: Schema-Guided Dialogue State Tracking. The goal of this task is to predict the intents and slots in each user turn to complete the dialogue state tracking (DST) based on the information…

Computation and Language · Computer Science 2020-02-04 Yue Ma , Zengfeng Zeng , Dawei Zhu , Xuan Li , Yiying Yang , Xiaoyuan Yao , Kaijie Zhou , Jianping Shen

Dialog state tracking (DST) suffers from severe data sparsity. While many natural language processing (NLP) tasks benefit from transfer learning and multi-task learning, in dialog these methods are limited by the amount of available data…

Computation and Language · Computer Science 2020-11-19 Michael Heck , Carel van Niekerk , Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Marco Moresi , Milica Gašić