English
Related papers

Related papers: Hybrid Dialog State Tracker with ASR Features

200 papers

Dialogue state tracking models play an important role in a task-oriented dialogue system. However, most of them model the slot types conditionally independently given the input. We discover that it may cause the model to be confused by slot…

Computation and Language · Computer Science 2021-11-16 Ting-Rui Chiang , Yi-Ting Yeh

Building Spoken Language Understanding (SLU) robust to Automatic Speech Recognition (ASR) errors is an essential issue for various voice-enabled virtual assistants. Considering that most ASR errors are caused by phonetic confusion between…

Computation and Language · Computer Science 2022-03-24 Zexun Wang , Yuquan Le , Yi Zhu , Yuming Zhao , Mingchao Feng , Meng Chen , Xiaodong He

The integration of pre-trained text-based large language models (LLM) with speech input has enabled instruction-following capabilities for diverse speech tasks. This integration requires the use of a speech encoder, a speech adapter, and an…

Computation and Language · Computer Science 2024-06-14 Suwon Shon , Kwangyoun Kim , Yi-Te Hsu , Prashant Sridhar , Shinji Watanabe , Karen Livescu

The performance of task-oriented dialogue models is strongly tied to how well they track dialogue states, which records and updates user information across multi-turn interactions. However, current multi-domain DST encounters two key…

Computation and Language · Computer Science 2026-03-12 Haoxiang Su , Ruiyu Fang , Liting Jiang , Xiaomeng Huang , Shuangyong Song

Dialogue state tracking (DST) module is an important component for task-oriented dialog systems to understand users' goals and needs. Collecting dialogue state labels including slots and values can be costly, especially with the wide…

Computation and Language · Computer Science 2023-01-27 Yuting Yang , Wenqiang Lei , Pei Huang , Juan Cao , Jintao Li , Tat-Seng Chua

Dialogue state tracking, which estimates user goals and requests given the dialogue context, is an essential part of task-oriented dialogue systems. In this paper, we propose the Global-Locally Self-Attentive Dialogue State Tracker (GLAD),…

Computation and Language · Computer Science 2018-09-10 Victor Zhong , Caiming Xiong , Richard Socher

Large language models (LLMs) have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. However, conventional DST benchmarks primarily focus on structured user-agent…

Computation and Language · Computer Science 2025-06-13 Sangmin Song , Juhwan Choi , JungMin Yun , YoungBin Kim

We highlight a practical yet rarely discussed problem in dialogue state tracking (DST), namely handling unknown slot values. Previous approaches generally assume predefined candidate lists and thus are not designed to output unknown values,…

Computation and Language · Computer Science 2018-05-07 Puyang Xu , Qi Hu

The goal of dialogue state tracking (DST) is to predict the current dialogue state given all previous dialogue contexts. Existing approaches generally predict the dialogue state at every turn from scratch. However, the overwhelming majority…

Computation and Language · Computer Science 2021-07-28 Jinyu Guo , Kai Shuang , Jijie Li , Zihan Wang

Dialogue state tracking (DST) is a crucial module in dialogue management. It is usually cast as a supervised training problem, which is not convenient for on-line optimization. In this paper, a novel companion teaching based deep…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Xiang Zhou , Kai Yu

In this work, we approach spoken Dialogue State Tracking (DST) by bridging the representation spaces of speech encoders and LLMs via a small connector module, with a focus on fully open-sourced and open-data components (WavLM-large, OLMo).…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-11 Šimon Sedláček , Bolaji Yusuf , Ján Švec , Pradyoth Hegde , Santosh Kesiraju , Oldřich Plchot , Jan Černocký

Combination approaches for speech recognition (ASR) systems cover structured sentence-level or word-based merging techniques as well as combination of model scores during beam search. In this work, we compare model combination across…

Sound · Computer Science 2025-08-14 Noureldin Bayoumi , Robin Schmitt , Tina Raissi , Albert Zeyer , Ralf Schlüter , Hermann Ney

Dialogue State Tracking (DST), a key component of task-oriented conversation systems, represents user intentions by determining the values of pre-defined slots in an ongoing dialogue. Existing approaches use hand-crafted templates and…

Computation and Language · Computer Science 2023-10-24 Praveen Venkateswaran , Evelyn Duesterwald , Vatche Isahagian

Most recently proposed approaches in dialogue state tracking (DST) leverage the context and the last dialogue states to track current dialogue states, which are often slot-value pairs. Although the context contains the complete dialogue…

Computation and Language · Computer Science 2021-07-13 Jingyao Zhou , Haipang Wu , Zehao Lin , Guodun Li , Yin Zhang

The paper presents an overview of the Spoken Language Translator (SLT) system's hybrid language-processing architecture, focussing on the way in which rule-based and statistical methods are combined to achieve robust and efficient…

cmp-lg · Computer Science 2008-02-03 Manny Rayner , David Carter

In task-oriented dialogue systems, spoken language understanding, or SLU, refers to the task of parsing natural language user utterances into semantic frames. Making use of context from prior dialogue history holds the key to more effective…

Computation and Language · Computer Science 2018-07-03 Raghav Gupta , Abhinav Rastogi , Dilek Hakkani-Tur

Dialogue systems dealing with multi-domain tasks are highly required. How to record the state remains a key problem in a task-oriented dialogue system. Normally we use human-defined features as dialogue states and apply a state tracker to…

Computation and Language · Computer Science 2020-05-27 Shuke Peng , Xinjing Huang , Zehao Lin , Feng Ji , Haiqing Chen , Yin Zhang

Dialog state tracking is a key component of many modern dialog systems, most of which are designed with a single, well-defined domain in mind. This paper shows that dialog data drawn from different dialog domains can be used to train a…

Computation and Language · Computer Science 2015-06-25 Nikola Mrkšić , Diarmuid Ó Séaghdha , Blaise Thomson , Milica Gašić , Pei-Hao Su , David Vandyke , Tsung-Hsien Wen , Steve Young

We present our work on Track 4 in the Dialogue System Technology Challenges 8 (DSTC8). The DSTC8-Track 4 aims to perform dialogue state tracking (DST) under the zero-shot settings, in which the model needs to generalize on unseen service…

Computation and Language · Computer Science 2020-02-04 Yu-Ping Ruan , Zhen-Hua Ling , Jia-Chen Gu , Quan Liu

Dialogue state tracking (DST) is a component of the task-oriented dialogue system. It is responsible for extracting and managing slot values according to dialogue utterances, where each slot represents an essential part of the information…

Computation and Language · Computer Science 2022-04-26 Zhoujian Sun , Zhengxing Huang , Nai Ding