English
Related papers

Related papers: Hybrid Dialog State Tracker with ASR Features

200 papers

Though Dialogue State Tracking (DST) is a core component of spoken dialogue systems, recent work on this task mostly deals with chat corpora, disregarding the discrepancies between spoken and written language.In this paper, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-01 Léo Jacqmin , Lucas Druart , Yannick Estève , Benoît Favre , Lina Maria Rojas-Barahona , Valentin Vielzeuf

The quality of automatic speech recognition (ASR) is critical to Dialogue Systems as ASR errors propagate to and directly impact downstream tasks such as language understanding (LU). In this paper, we propose multi-task neural approaches to…

This paper is concerned with dialogue state tracking (DST) in a task-oriented dialogue system. Building a DST module that is highly effective is still a challenging issue, although significant progresses have been made recently. This paper…

Computation and Language · Computer Science 2021-06-01 Yue Feng , Yang Wang , Hang Li

In task-oriented dialogue systems the dialogue state tracker (DST) component is responsible for predicting the state of the dialogue based on the dialogue history. Current DST approaches rely on a predefined domain ontology, a fact that…

Computation and Language · Computer Science 2020-01-22 Vevake Balaraman , Bernardo Magnini

Spoken language understanding (SLU) is a task aiming to extract high-level semantics from spoken utterances. Previous works have investigated the use of speech self-supervised models and textual pre-trained models, which have shown…

Computation and Language · Computer Science 2022-11-08 Jiatong Shi , Chan-Jan Hsu , Holam Chung , Dongji Gao , Paola Garcia , Shinji Watanabe , Ann Lee , Hung-yi Lee

Goal-oriented dialogue systems typically rely on components specifically developed for a single task or domain. This limits such systems in two different ways: If there is an update in the task domain, the dialogue system usually needs to…

Artificial Intelligence · Computer Science 2018-12-03 Rahul Goel , Shachi Paul , Tagyoung Chung , Jeremie Lecomte , Arindam Mandal , Dilek Hakkani-Tur

Spoken Language Understanding (SLU) systems parse speech into semantic structures like dialog acts and slots. This involves the use of an Automatic Speech Recognizer (ASR) to transcribe speech into multiple text alternatives (hypotheses).…

Computation and Language · Computer Science 2021-06-14 Karthik Ganesan , Pakhi Bamdev , Jaivarsan B , Amresh Venugopal , Abhinav Tushar

We present a novel end-to-end trainable neural network model for task-oriented dialog systems. The model is able to track dialog state, issue API calls to knowledge base (KB), and incorporate structured KB query results into system…

Computation and Language · Computer Science 2017-08-22 Bing Liu , Ian Lane

This paper addresses the problem of automatic speech recognition (ASR) error detection and their use for improving spoken language understanding (SLU) systems. In this study, the SLU task consists in automatically extracting, from ASR…

Computation and Language · Computer Science 2017-05-29 Edwin Simonnet , Sahar Ghannay , Nathalie Camelin , Yannick Estève , Renato De Mori

This paper introduces a novel approach to Dialogue State Tracking (DST) that leverages Large Language Models (LLMs) to generate natural language descriptions of dialogue states, moving beyond traditional slot-value representations.…

Computation and Language · Computer Science 2025-03-13 Rafael Carranza , Mateo Alejandro Rojas

This paper discusses models for dialogue state tracking using recurrent neural networks (RNN). We present experiments on the standard dialogue state tracking (DST) dataset, DSTC2. On the one hand, RNN models became the state of the art…

Computation and Language · Computer Science 2016-07-15 Ondřej Plátek , Petr Bělohlávek , Vojtěch Hudeček , Filip Jurčíček

Dialogue state tracking (DST) is at the heart of task-oriented dialogue systems. However, the scarcity of labeled data is an obstacle to building accurate and robust state tracking systems that work across a variety of domains. Existing…

Computation and Language · Computer Science 2020-04-14 Shuyang Gao , Sanchit Agarwal , Tagyoung Chung , Di Jin , Dilek Hakkani-Tur

Dialogue state tracking (DST) is a pivotal component in task-oriented dialogue systems. While it is relatively easy for a DST model to capture belief states in short conversations, the task of DST becomes more challenging as the length of a…

Computation and Language · Computer Science 2021-05-07 Ye Zhang , Yuan Cao , Mahdis Mahdieh , Jeffrey Zhao , Yonghui Wu

Dialogue State Tracking (DST) is a key part of task-oriented dialogue systems, identifying important information in conversations. However, its accuracy drops significantly in spoken dialogue environments due to named entity errors from…

Computation and Language · Computer Science 2025-10-31 Jihyun Lee , Solee Im , Wonjun Lee , Gary Geunbae Lee

Most research on task oriented dialog modeling is based on written text input. However, users interact with practical dialog systems often using speech as input. Typically, systems convert speech into text using an Automatic Speech…

Artificial Intelligence · Computer Science 2022-12-20 Hagen Soltau , Izhak Shafran , Mingqiu Wang , Abhinav Rastogi , Jeffrey Zhao , Ye Jia , Wei Han , Yuan Cao , Aramys Miranda

Dialogue state tracking is an important component in task-oriented dialogue systems to identify users' goals and requests as a dialogue proceeds. However, as most previous models are dependent on dialogue slots, the model complexity soars…

Computation and Language · Computer Science 2019-09-27 Chenguang Zhu , Michael Zeng , Xuedong Huang

Dialogue State Tracking is central to multi-domain task-oriented dialogue systems, responsible for extracting information from user utterances. We present a novel hybrid architecture that augments GPT-2 with representations derived from…

Computation and Language · Computer Science 2021-09-24 Weizhe Lin , Bo-Hsiang Tseng , Bill Byrne

Reinforcement learning has been applied to train the dialog systems in many works. Previous approaches divide the dialog system into multiple modules including DST (dialog state tracking) and DP (dialog policy), and train these modules…

Computation and Language · Computer Science 2023-05-10 Sai Zhang , Yuwei Hu , Xiaojie Wang , Caixia Yuan

Spoken Language Understanding (SLU) aims to extract structured semantic representations (e.g., slot-value pairs) from speech recognized texts, which suffers from errors of Automatic Speech Recognition (ASR). To alleviate the problem caused…

Computation and Language · Computer Science 2020-09-08 Chen Liu , Su Zhu , Lu Chen , Kai Yu

This paper describes our approach in DSTC 8 Track 4: Schema-Guided Dialogue State Tracking. The goal of this task is to predict the intents and slots in each user turn to complete the dialogue state tracking (DST) based on the information…

Computation and Language · Computer Science 2020-02-04 Yue Ma , Zengfeng Zeng , Dawei Zhu , Xuan Li , Yiying Yang , Xiaoyuan Yao , Kaijie Zhou , Jianping Shen