English
Related papers

Related papers: Continual Dialogue State Tracking via Example-Guid…

200 papers

In this work, we approach spoken Dialogue State Tracking (DST) by bridging the representation spaces of speech encoders and LLMs via a small connector module, with a focus on fully open-sourced and open-data components (WavLM-large, OLMo).…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-11 Šimon Sedláček , Bolaji Yusuf , Ján Švec , Pradyoth Hegde , Santosh Kesiraju , Oldřich Plchot , Jan Černocký

Large language models (LLMs) have demonstrated self-improvement capabilities via feedback and refinement, but current small language models (SLMs) have had limited success in this area. Existing correction approaches often rely on…

Computation and Language · Computer Science 2024-10-25 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on…

Computation and Language · Computer Science 2022-03-31 Jinjie Ni , Tom Young , Vlad Pandelea , Fuzhao Xue , Erik Cambria

The goal of dialogue state tracking (DST) is to predict the current dialogue state given all previous dialogue contexts. Existing approaches generally predict the dialogue state at every turn from scratch. However, the overwhelming majority…

Computation and Language · Computer Science 2021-07-28 Jinyu Guo , Kai Shuang , Jijie Li , Zihan Wang

In this paper, we present a probabilistic framework for goal-driven spoken dialog systems. A new dynamic stochastic state (DS-state) is then defined to characterize the goal set of a dialog state at different stages of the dialog process.…

Artificial Intelligence · Computer Science 2015-04-28 Ji Wu , Miao Li , Chin-Hui Lee

Though Dialogue State Tracking (DST) is a core component of spoken dialogue systems, recent work on this task mostly deals with chat corpora, disregarding the discrepancies between spoken and written language.In this paper, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-01 Léo Jacqmin , Lucas Druart , Yannick Estève , Benoît Favre , Lina Maria Rojas-Barahona , Valentin Vielzeuf

Building robust and general dialogue models for spoken conversations is challenging due to the gap in distributions of spoken and written data. This paper presents our approach to build generalized models for the Knowledge-grounded…

Computation and Language · Computer Science 2022-03-09 Ruijie Yan , Shuang Peng , Haitao Mi , Liang Jiang , Shihui Yang , Yuchi Zhang , Jiajun Li , Liangrui Peng , Yongliang Wang , Zujie Wen

Reinforcement learning has been applied to train the dialog systems in many works. Previous approaches divide the dialog system into multiple modules including DST (dialog state tracking) and DP (dialog policy), and train these modules…

Computation and Language · Computer Science 2023-05-10 Sai Zhang , Yuwei Hu , Xiaojie Wang , Caixia Yuan

GuessWhat?! is a visual dialogue task between a guesser and an oracle. The guesser aims to locate an object supposed by the oracle oneself in an image by asking a sequence of Yes/No questions. Asking proper questions with the progress of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Wei Pang , Xiaojie Wang

Generative model has been one of the most common approaches for solving the Dialog State Tracking Problem with the capabilities to model the dialog hypotheses in an explicit manner. The most important task in such Bayesian networks models…

Artificial Intelligence · Computer Science 2017-02-22 Quan Nguyen

This paper presents an ontology-aware pretrained language model (OPAL) for end-to-end task-oriented dialogue (TOD). Unlike chit-chat dialogue models, task-oriented dialogue models fulfill at least two task-specific modules: dialogue state…

Computation and Language · Computer Science 2022-09-13 Zhi Chen , Yuncong Liu , Lu Chen , Su Zhu , Mengyue Wu , Kai Yu

The DIAlogue MOdel Learning Environment supports an engineering-oriented approach towards dialogue modelling for a spoken-language interface. Major steps towards dialogue models is to know about the basic units that are used to construct a…

cmp-lg · Computer Science 2008-02-03 Jens-Uwe Moeller

Current metrics for evaluating Dialogue State Tracking (DST) systems exhibit three primary limitations. They: i) erroneously presume a uniform distribution of slots throughout the dialog, ii) neglect to assign partial scores for individual…

Computation and Language · Computer Science 2024-03-19 Taha Aksu , Nancy F. Chen

Autonomous systems conducting schema-grounded information-gathering dialogues face an instrumentation gap, lacking turn-level observables for monitoring acquisition efficiency and detecting when questioning becomes unproductive. We…

Computation and Language · Computer Science 2026-01-15 Dimitris Panagopoulos , Adolfo Perrusquia , Weisi Guo

This paper presents the Frames dataset (Frames is available at http://datasets.maluuba.com/Frames), a corpus of 1369 human-human dialogues with an average of 15 turns per dialogue. We developed this dataset to study the role of memory in…

Computation and Language · Computer Science 2017-04-17 Layla El Asri , Hannes Schulz , Shikhar Sharma , Jeremie Zumer , Justin Harris , Emery Fine , Rahul Mehrotra , Kaheer Suleman

Spoken language understanding (SLU) is an essential component in conversational systems. Most SLU component treats each utterance independently, and then the following components aggregate the multi-turn information in the separate phases.…

Computation and Language · Computer Science 2017-12-12 Po-Chun Chen , Ta-Chung Chi , Shang-Yu Su , Yun-Nung Chen

User simulation is essential for generating enough data to train a statistical spoken dialogue system. Previous models for user simulation suffer from several drawbacks, such as the inability to take dialogue history into account, the need…

Computation and Language · Computer Science 2016-07-04 Layla El Asri , Jing He , Kaheer Suleman

Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses increasingly important for understanding their relative…

In-context learning with Large Language Models (LLMs) has emerged as a promising avenue of research in Dialog State Tracking (DST). However, the best-performing in-context learning methods involve retrieving and adding similar examples to…

Computation and Language · Computer Science 2024-02-06 Atharva Kulkarni , Bo-Hsiang Tseng , Joel Ruben Antony Moniz , Dhivya Piraviperumal , Hong Yu , Shruti Bhargava

A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Evaluation), a public…

Computation and Language · Computer Science 2020-10-02 Shikib Mehri , Mihail Eric , Dilek Hakkani-Tur