English
Related papers

Related papers: Oh My Mistake!: Toward Realistic Dialogue State Tr…

200 papers

Goal-oriented dialogue systems are now being widely adopted in industry where it is of key importance to maintain a rapid prototyping cycle for new products and domains. Data-driven dialogue system development has to be adapted to meet this…

Computation and Language · Computer Science 2019-10-04 Igor Shalyminov , Sungjin Lee , Arash Eshghi , Oliver Lemon

Speech-to-Speech Translation (S2ST) models transform speech from one language to another target language with the same linguistic information. S2ST is important for bridging the communication gap among communities and has diverse…

Computation and Language · Computer Science 2024-11-25 Mahendra Gupta , Maitreyee Dutta , Chandresh Kumar Maurya

Turn-taking is a fundamental mechanism in human communication that ensures smooth and coherent verbal interactions. Recent advances in Large Language Models (LLMs) have motivated their use in improving the turn-taking capabilities of Spoken…

Computation and Language · Computer Science 2024-10-22 Muhammad Umair , Vasanth Sarathy , JP de Ruiter

Despite recent improvements in open-domain dialogue models, state of the art models are trained and evaluated on short conversations with little context. In contrast, the long-term conversation setting has hardly been studied. In this work…

Computation and Language · Computer Science 2021-07-19 Jing Xu , Arthur Szlam , Jason Weston

Dialogue state tracking (DST) is an essential component in task-oriented dialogue systems, which estimates user goals at every dialogue turn. However, most previous approaches usually suffer from the following problems. Many discriminative…

Computation and Language · Computer Science 2019-08-22 Qingbin Liu , Shizhu He , Kang Liu , Shengping Liu , Jun Zhao

An ideal dialogue system requires continuous skill acquisition and adaptation to new tasks while retaining prior knowledge. Dialogue State Tracking (DST), vital in these systems, often involves learning new services and confronting…

Computation and Language · Computer Science 2024-10-17 Yujie Feng , Bo Liu , Xiaoyu Dong , Zexin Lu , Li-Ming Zhan , Albert Y. S. Lam , Xiao-Ming Wu

Zero-shot Dialogue State Tracking (DST) addresses the challenge of acquiring and annotating task-oriented dialogues, which can be time-consuming and costly. However, DST extends beyond simple slot-filling and requires effective updating…

Computation and Language · Computer Science 2023-11-28 Yuxiang Wu , Guanting Dong , Weiran Xu

We investigate the problem of multi-domain Dialogue State Tracking (DST) with open vocabulary. Existing approaches exploit BERT encoder and copy-based RNN decoder, where the encoder predicts the state operation, and the decoder generates…

Computation and Language · Computer Science 2021-04-09 Yan Zeng , Jian-Yun Nie

Despite increasing instances of machine translation (MT) systems including contextual information, the evidence for translation quality improvement is sparse, especially for discourse phenomena. Popular metrics like BLEU are not expressive…

Computation and Language · Computer Science 2020-05-01 Prathyusha Jwalapuram , Barbara Rychalska , Shafiq Joty , Dominika Basaj

Dialog state tracking is a key component of many modern dialog systems, most of which are designed with a single, well-defined domain in mind. This paper shows that dialog data drawn from different dialog domains can be used to train a…

Computation and Language · Computer Science 2015-06-25 Nikola Mrkšić , Diarmuid Ó Séaghdha , Blaise Thomson , Milica Gašić , Pei-Hao Su , David Vandyke , Tsung-Hsien Wen , Steve Young

There has been significant interest in zero and few-shot learning for dialogue state tracking (DST) due to the high cost of collecting and annotating task-oriented dialogues. Recent work has demonstrated that in-context learning requires…

Computation and Language · Computer Science 2023-07-06 Brendan King , Jeffrey Flanigan

Dialogue State Tracking (DST) is critical for comprehensively interpreting user and system utterances, thereby forming the cornerstone of efficient dialogue systems. Despite past research efforts focused on enhancing DST performance through…

Computation and Language · Computer Science 2023-07-25 Yukyung Lee , Takyoung Kim , Hoonsang Yoon , Pilsung Kang , Junseong Bang , Misuk Kim

For spoken dialog systems to conduct fluid conversational interactions with users, the systems must be sensitive to turn-taking cues produced by a user. Models should be designed so that effective decisions can be made as to when it is…

Computation and Language · Computer Science 2018-07-02 Matthew Roddy , Gabriel Skantze , Naomi Harte

The recent development of language models has shown promising results by achieving state-of-the-art performance on various natural language tasks by fine-tuning pretrained models. In task-oriented dialogue (ToD) systems, language models can…

Computation and Language · Computer Science 2022-01-24 Vinsen Marselino Andreas , Genta Indra Winata , Ayu Purwarianti

Existing voice AI assistants treat every detected pause as an invitation to speak. This works in dyadic dialogue, but in multi-party settings, where an AI assistant participates alongside multiple speakers, pauses are abundant and…

Artificial Intelligence · Computer Science 2026-03-13 Kratika Bhagtani , Mrinal Anand , Yu Chen Xu , Amit Kumar Singh Yadav

A dialog state tracker is an important component in modern spoken dialog systems. We present an incremental dialog state tracker, based on LSTM networks. It directly uses automatic speech recognition hypotheses to track the state. We also…

Computation and Language · Computer Science 2015-07-14 Lukas Zilka , Filip Jurcicek

Spoken dialogue modeling poses challenges beyond text-based language modeling, requiring real-time interaction, turn-taking, and backchanneling. While most Spoken Dialogue Models (SDMs) operate in half-duplex mode-processing one turn at a…

Computation and Language · Computer Science 2025-08-19 Guan-Ting Lin , Jiachen Lian , Tingle Li , Qirui Wang , Gopala Anumanchipalli , Alexander H. Liu , Hung-yi Lee

Transformer encoder-decoder models have achieved great performance in dialogue generation tasks, however, their inability to process long dialogue history often leads to truncation of the context To address this problem, we propose a novel…

Computation and Language · Computer Science 2023-05-24 Qingyang Wu , Zhou Yu

We investigate the problem of multi-domain Dialogue State Tracking (DST) with open vocabulary, which aims to extract the state from the dialogue. Existing approaches usually concatenate previous dialogue state with dialogue history as the…

Computation and Language · Computer Science 2020-10-22 Yan Zeng , Jian-Yun Nie

Large language model (LLM) based multi-turn dialogue systems often struggle to track dependencies across non-adjacent turns, undermining both consistency and scalability. As conversations lengthen, essential information becomes sparse and…

Computation and Language · Computer Science 2026-05-15 Renning Pang , Tian Lan , Leyuan Liu , Xiaoming Huang , Piao Tong , Xiaosong Zhang