English
Related papers

Related papers: Incremental LSTM-based Dialog State Tracker

200 papers

A key component of modern conversational systems is the Dialogue State Tracker (or DST), which models a user's goals and needs. Toward building more robust and reliable DSTs, we introduce a prompt-based learning approach to automatically…

Computation and Language · Computer Science 2023-06-08 Xiangjue Dong , Yun He , Ziwei Zhu , James Caverlee

In this work, we approach spoken Dialogue State Tracking (DST) by bridging the representation spaces of speech encoders and LLMs via a small connector module, with a focus on fully open-sourced and open-data components (WavLM-large, OLMo).…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-11 Šimon Sedláček , Bolaji Yusuf , Ján Švec , Pradyoth Hegde , Santosh Kesiraju , Oldřich Plchot , Jan Černocký

We recently developed SLM, a joint speech and language model, which fuses a pretrained foundational speech model and a large language model (LLM), while preserving the in-context learning capability intrinsic to the pretrained LLM. In this…

Computation and Language · Computer Science 2024-02-08 Mingqiu Wang , Izhak Shafran , Hagen Soltau , Wei Han , Yuan Cao , Dian Yu , Laurent El Shafey

In task-oriented dialogue systems the dialogue state tracker (DST) component is responsible for predicting the state of the dialogue based on the dialogue history. Current DST approaches rely on a predefined domain ontology, a fact that…

Computation and Language · Computer Science 2020-01-22 Vevake Balaraman , Bernardo Magnini

This paper presents a model for end-to-end learning of task-oriented dialog systems. The main component of the model is a recurrent neural network (an LSTM), which maps from raw dialog history directly to a distribution over system actions.…

Computation and Language · Computer Science 2016-06-07 Jason D. Williams , Geoffrey Zweig

The traditional Dialogue State Tracking (DST) problem aims to track user preferences and intents in user-agent conversations. While sufficient for task-oriented dialogue systems supporting narrow domain applications, the advent of Large…

Computation and Language · Computer Science 2023-09-19 Sarkar Snigdha Sarathi Das , Chirag Shah , Mengting Wan , Jennifer Neville , Longqi Yang , Reid Andersen , Georg Buscher , Tara Safavi

Dialog state tracking is used to estimate the current belief state of a dialog given all the preceding conversation. Machine reading comprehension, on the other hand, focuses on building systems that read passages of text and answer…

Computation and Language · Computer Science 2019-08-16 Shuyang Gao , Abhishek Sethi , Sanchit Agarwal , Tagyoung Chung , Dilek Hakkani-Tur

Dialogue State Tracking (DST) is core research in dialogue systems and has received much attention. In addition, it is necessary to define a new problem that can deal with dialogue between users as a step toward the conversational AI that…

Computation and Language · Computer Science 2023-01-19 Hyungtak Choi , Hyeonmok Ko , Gurpreet Kaur , Lohith Ravuru , Kiranmayi Gandikota , Manisha Jhawar , Simma Dharani , Pranamya Patil

Dialog state tracking (DST) suffers from severe data sparsity. While many natural language processing (NLP) tasks benefit from transfer learning and multi-task learning, in dialog these methods are limited by the amount of available data…

Computation and Language · Computer Science 2020-11-19 Michael Heck , Carel van Niekerk , Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Marco Moresi , Milica Gašić

Dialog state tracking (DST) is a crucial component in a task-oriented dialog system for conversational information access. A common practice in current dialog systems is to define the dialog state by a set of slot-value pairs. Such…

Computation and Language · Computer Science 2018-11-06 Yinpei Dai , Zhijian Ou , Dawei Ren , Pengfei Yu

End-to-end spoken dialogue state tracking (DST) is made difficult by the tandem of having to handle speech input and data scarcity. Combining speech foundation encoders and large language models has been proposed in recent work as to…

Computation and Language · Computer Science 2025-12-01 Katia Vendrame , Bolaji Yusuf , Santosh Kesiraju , Šimon Sedláček , Oldřich Plchot , Jan Černocký

Dialog State Tracking (DST) is one of the most crucial modules for goal-oriented dialogue systems. In this paper, we introduce FastSGT (Fast Schema Guided Tracker), a fast and robust BERT-based model for state tracking in goal-oriented…

Machine Learning · Computer Science 2020-08-31 Vahid Noroozi , Yang Zhang , Evelina Bakhturina , Tomasz Kornuta

There has been a rapid development in data-driven task-oriented dialogue systems with the benefit of large-scale datasets. However, the progress of dialogue systems in low-resource languages lags far behind due to the lack of high-quality…

Computation and Language · Computer Science 2021-01-28 Yen-Ting Lin , Yun-Nung Chen

Dialogue state tracking (DST) is an important step in dialogue management to keep track of users' beliefs. Existing works fine-tune all language model (LM) parameters to tackle the DST task, which requires significant data and computing…

Computation and Language · Computer Science 2023-05-31 Mingyu Derek Ma , Jiun-Yu Kao , Shuyang Gao , Arpit Gupta , Di Jin , Tagyoung Chung , Nanyun Peng

Designed for tracking user goals in dialogues, a dialogue state tracker is an essential component in a dialogue system. However, the research of dialogue state tracking has largely been limited to unimodality, in which slots and slot values…

Artificial Intelligence · Computer Science 2022-06-17 Hung Le , Nancy F. Chen , Steven C. H. Hoi

The rapid advancement of large language models (LLMs) has significantly propelled the development of text-based chatbots, demonstrating their capability to engage in coherent and contextually relevant dialogues. However, extending these…

Computation and Language · Computer Science 2024-08-23 Yinghao Aaron Li , Xilin Jiang , Jordan Darefsky , Ge Zhu , Nima Mesgarani

Recently, resources and tasks were proposed to go beyond state tracking in dialogue systems. An example is the frame tracking task, which requires recording multiple frames, one for each user goal set during the dialogue. This allows a…

Computation and Language · Computer Science 2017-06-07 Hannes Schulz , Jeremie Zumer , Layla El Asri , Shikhar Sharma

Dialogue state tracking is an important component in task-oriented dialogue systems to identify users' goals and requests as a dialogue proceeds. However, as most previous models are dependent on dialogue slots, the model complexity soars…

Computation and Language · Computer Science 2019-09-27 Chenguang Zhu , Michael Zeng , Xuedong Huang

Existing approaches to Dialogue State Tracking (DST) rely on turn level dialogue state annotations, which are expensive to acquire in large scale. In call centers, for tasks like managing bookings or subscriptions, the user goal can be…

Computation and Language · Computer Science 2021-01-29 Shuailong Liang , Lahari Poddar , Gyuri Szarvas

Large language models (LLMs) have demonstrated self-improvement capabilities via feedback and refinement, but current small language models (SLMs) have had limited success in this area. Existing correction approaches often rely on…

Computation and Language · Computer Science 2024-10-25 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf