English
Related papers

Related papers: User Evaluation of a Multi-dimensional Statistical…

200 papers

In task-oriented dialogue systems the dialogue state tracker (DST) component is responsible for predicting the state of the dialogue based on the dialogue history. Current DST approaches rely on a predefined domain ontology, a fact that…

Computation and Language · Computer Science 2020-01-22 Vevake Balaraman , Bernardo Magnini

Open-domain dialogue systems aim to converse with humans through text, and dialogue research has heavily relied on benchmark datasets. In this work, we observe the overlapping problem in DailyDialog and OpenSubtitles, two popular…

Computation and Language · Computer Science 2022-05-10 Yuqiao Wen , Guoqing Luo , Lili Mou

The task-oriented spoken dialogue system (SDS) aims to assist a human user in accomplishing a specific task (e.g., hotel booking). The dialogue management is a core part of SDS. There are two main missions in dialogue management: dialogue…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Xiaoyuan Liu , Kai Yu

The blocks world is a classic toy domain that has long been used to build and test spatial reasoning systems. Despite its relative simplicity, tackling this domain in its full complexity requires the agent to exhibit a rich set of…

Artificial Intelligence · Computer Science 2019-11-07 Georgiy Platonov , Benjamin Kane , Aaron Gindi , Lenhart K. Schubert

Despite many recent advances for the design of dialogue systems, a true bottleneck remains the acquisition of data required to train its components. Unlike many other language processing applications, dialogue systems require interactions…

Computation and Language · Computer Science 2018-10-03 Matthieu Riou , Bassam Jabaian , Stéphane Huet , Fabrice Lefèvre

Spoken Dialogue Models (SDMs) have recently attracted significant attention for their ability to generate voice responses directly to users' spoken queries. Despite their increasing popularity, there exists a gap in research focused on…

Computation and Language · Computer Science 2025-10-07 Chengqian Ma , Wei Tao , Yiwen Guo

Goal-oriented dialogue systems typically rely on components specifically developed for a single task or domain. This limits such systems in two different ways: If there is an update in the task domain, the dialogue system usually needs to…

Artificial Intelligence · Computer Science 2018-12-03 Rahul Goel , Shachi Paul , Tagyoung Chung , Jeremie Lecomte , Arindam Mandal , Dilek Hakkani-Tur

In this paper, we describe a set of metrics for the evaluation of different dialogue management strategies in an implemented real-time spoken language system. The set of metrics we propose offers useful insights in evaluating how particular…

cmp-lg · Computer Science 2008-02-03 Morena Danieli , Elisabetta Gerbino

User attributes provide rich and useful information for user understanding, yet structured and easy-to-use attributes are often sparsely populated. In this paper, we leverage dialogues with conversational agents, which contain strong…

Computation and Language · Computer Science 2019-08-14 Chien-Sheng Wu , Andrea Madotto , Zhaojiang Lin , Peng Xu , Pascale Fung

The rapid evolution of large language models (LLMs) has transformed conversational agents, enabling complex human-machine interactions. However, evaluation frameworks often focus on single tasks, failing to capture the dynamic nature of…

Computation and Language · Computer Science 2025-02-10 Pietro Alessandro Aluffi , Patrick Zietkiewicz , Marya Bazzi , Matt Arderne , Vladimirs Murevics

Large language models (LLMs) can generate fluent dialogue, but prior works lack situational grounding, dynamic strategy control, and evaluation aligned with clinical standards in motivational interviewing (MI). We introduce StoryMI, a…

Computation and Language · Computer Science 2026-05-28 Qingyu Meng , Min Chen , Dingming Liu , Yifan Mo , Yue Su , Xin Sun , Koen Hindriks , Jiahuan Pei

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

We present work in progress on abstracting dialog managers from their domain in order to implement a dialog manager development tool which takes (among other data) a domain description as input and delivers a new dialog manager for the…

cmp-lg · Computer Science 2007-05-23 Bernd Ludwig , Guenther Goerz , Heinrich Niemann

Learning suitable and well-performing dialogue behaviour in statistical spoken dialogue systems has been in the focus of research for many years. While most work which is based on reinforcement learning employs an objective measure like…

Computation and Language · Computer Science 2020-01-22 Stefan Ultes

This paper presents a research platform that supports spoken dialogue interaction with multiple robots. The demonstration showcases our crafted MultiBot testing scenario in which users can verbally issue search, navigate, and follow…

Domain adaptation is an essential task in dialog system building because there are so many new dialog tasks created for different needs every day. Collecting and annotating training data for these new tasks is costly since it involves real…

Computation and Language · Computer Science 2019-08-20 Kun Qian , Zhou Yu

Recently, research on open domain dialogue systems have attracted extensive interests of academic and industrial researchers. The goal of an open domain dialogue system is to imitate humans in conversations. Previous works on single turn…

Computation and Language · Computer Science 2024-10-29 Wei-Nan Zhang , Yiming Cui , Kaiyan Zhang , Yifa Wang , Qingfu Zhu , Lingzhi Li , Ting Liu

Simulation is an invaluable tool for developing and evaluating controllers for self-driving cars. Current simulation frameworks are driven by highly-specialist domain specific languages, and so a natural language interface would greatly…

Artificial Intelligence · Computer Science 2023-10-27 Antonio Valerio Miceli-Barone , Alex Lascarides , Craig Innes

Dialogue models falter in noisy, multi-speaker environments, often producing irrelevant responses and awkward turn-taking. We present AV-Dialog, the first multimodal dialog framework that uses both audio and visual cues to track the target…

Computation and Language · Computer Science 2025-11-17 Tuochao Chen , Bandhav Veluri , Hongyu Gong , Shyamnath Gollakota

Dialogue systems are usually categorized into two types, open-domain and task-oriented. The first one focuses on chatting with users and making them engage in the conversations, where selecting a proper topic to fit the dialogue context is…

Computation and Language · Computer Science 2022-04-25 Ssu Chiu , Maolin Li , Yen-Ting Lin , Yun-Nung Chen