English
Related papers

Related papers: DEUS: A Data-driven Approach to Estimate User Sati…

200 papers

Dialog is a natural modality for interaction between customers and businesses in the service industry. As customers call up the service provider, their interactions may be routine or extraordinary. We believe that these interactions, when…

Computation and Language · Computer Science 2017-08-15 Q Vera Liao , Biplav Srivastava , Pavan Kapanipathi

Learning suitable and well-performing dialogue behaviour in statistical spoken dialogue systems has been in the focus of research for many years. While most work which is based on reinforcement learning employs an objective measure like…

Computation and Language · Computer Science 2020-01-22 Stefan Ultes

Due to the significance and value in human-computer interaction and natural language processing, task-oriented dialog systems are attracting more and more attention in both academic and industrial communities. In this paper, we survey…

Computation and Language · Computer Science 2020-06-24 Zheng Zhang , Ryuichi Takanobu , Qi Zhu , Minlie Huang , Xiaoyan Zhu

Spoken Dialogue Models (SDMs) have advanced rapidly, yet their ability to sustain genuinely interactive multi-turn conversations remains underexplored, as most benchmarks focus on single-turn exchanges. We introduce Multi-Bench, the first…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Yayue Deng , Guoqiang Hu , Haiyang Sun , Xiangyu Zhang , Haoyang Zhang , Fei Tian , Xuerui Yang , Gang Yu , Eng Siong Chng

Open-domain dialog systems (also known as chatbots) have increasingly drawn attention in natural language processing. Some of the recent work aims at incorporating affect information into sequence-to-sequence neural dialog modeling, making…

Computation and Language · Computer Science 2020-06-25 Yubo Xie , Ekaterina Svikhnushina , Pearl Pu

Instruction-tuned language models increasingly rely on large multi-turn dialogue corpora, but these datasets are often noisy and structurally inconsistent, with topic drift, repetitive chitchat, and mismatched answer formats across turns.…

Computation and Language · Computer Science 2026-04-21 Bo Li , Shikun Zhang , Wei Ye

This work investigates the task-oriented dialogue problem in mixed-domain settings. We study the effect of alternating between different domains in sequences of dialogue turns using two related state-of-the-art dialogue systems. We first…

Computation and Language · Computer Science 2019-09-06 Tho Luong Chi , Phuong Le-Hong

In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback. In a conversational setting such signals are usually unavailable due to the nature of the interactions, and, instead, the evaluation often relies…

Information Retrieval · Computer Science 2024-05-01 Clemencia Siro , Mohammad Aliannejadi , Maarten de Rijke

We present the first complete spoken dialogue system driven by a multi-dimensional statistical dialogue manager. This framework has been shown to substantially reduce data needs by leveraging domain-independent dimensions, such as social…

Computation and Language · Computer Science 2019-09-09 Simon Keizer , Ondřej Dušek , Xingkun Liu , Verena Rieser

User Satisfaction Estimation (USE) is an important yet challenging task in goal-oriented conversational systems. Whether the user is satisfied with the system largely depends on the fulfillment of the user's needs, which can be implicitly…

Computation and Language · Computer Science 2022-02-08 Yang Deng , Wenxuan Zhang , Wai Lam , Hong Cheng , Helen Meng

Recently, spoken dialogue systems have been widely deployed in a variety of applications, serving a huge number of end-users. A common issue is that the errors resulting from noisy utterances, semantic misunderstandings, or lack of…

Computation and Language · Computer Science 2022-12-08 Wei Shen , Xiaonan He , Chuheng Zhang , Xuyun Zhang , Jian XIe

Recently, research on open domain dialogue systems have attracted extensive interests of academic and industrial researchers. The goal of an open domain dialogue system is to imitate humans in conversations. Previous works on single turn…

Computation and Language · Computer Science 2024-10-29 Wei-Nan Zhang , Yiming Cui , Kaiyan Zhang , Yifa Wang , Qingfu Zhu , Lingzhi Li , Ting Liu

The field of eXplainable Artificial Intelligence (XAI) is increasingly recognizing the need to personalize and/or interactively adapt the explanation to better reflect users' explanation needs. While dialogue-based approaches to XAI have…

Machine Learning · Computer Science 2024-08-15 Dimitry Mindlin , Amelie Sophie Robrecht , Michael Morasch , Philipp Cimiano

Automatic evaluation is beneficial for open-domain dialog system development. However, standard word-overlap metrics (BLEU, ROUGE) do not correlate well with human judgements of open-domain dialog systems. In this work we propose to use the…

Computation and Language · Computer Science 2022-02-18 Sarik Ghazarian , Behnam Hedayatnia , Alexandros Papangelis , Yang Liu , Dilek Hakkani-Tur

Conversations with LMs involve two participants: a human user leading the conversation, and an LM assistant responding to the user's request. To satisfy this specific role, LMs are post-trained to be helpful assistants -- optimized to…

Computation and Language · Computer Science 2026-03-24 Tarek Naous , Philippe Laban , Wei Xu , Jennifer Neville

User engagement is a critical metric for evaluating the quality of open-domain dialogue systems. Prior work has focused on conversation-level engagement by using heuristically constructed features such as the number of turns and the total…

Computation and Language · Computer Science 2020-01-27 Sarik Ghazarian , Ralph Weischedel , Aram Galstyan , Nanyun Peng

Recent advancements in conversational systems have significantly enhanced human-machine interactions across various domains. However, training these systems is challenging due to the scarcity of specialized dialogue data. Traditionally,…

Computation and Language · Computer Science 2026-05-29 Heydar Soudani , Roxana Petcu , Evangelos Kanoulas , Faegheh Hasibi

Understanding the needs of a variety of distinct user groups is vital in designing effective, desirable dialogue systems that will be adopted by the largest possible segment of the population. Despite the increasing popularity of dialogue…

Human-Computer Interaction · Computer Science 2019-02-13 Libby Ferland , Thomas Huffstutler , Jacob Rice , Joan Zheng , Shi Ni , Maria Gini

In order to build dialogue systems to tackle the ambitious task of holding social conversations, we argue that we need a data driven approach that includes insight into human conversational chit chat, and which incorporates different…

Computation and Language · Computer Science 2017-09-12 Kevin K. Bowden , Shereen Oraby , Amita Misra , Jiaqi Wu , Stephanie Lukin

In a human-machine dialog scenario, deciding the appropriate time for the machine to take the turn is an open research problem. In contrast, humans engaged in conversations are able to timely decide when to interrupt the speaker for…

Computation and Language · Computer Science 2019-07-12 Andrei C. Coman , Koichiro Yoshino , Yukitoshi Murase , Satoshi Nakamura , Giuseppe Riccardi