English
Related papers

Related papers: Modeling User Satisfaction Dynamics in Dialogue vi…

200 papers

While theories of discourse and cognitive science have long recognized the value of unhurried pacing, recent dialogue research tends to minimize friction in conversational systems. Yet, frictionless dialogue risks fostering uncritical…

How do we measure the efficacy of language model explainability methods? While many explainability methods have been developed, they are typically evaluated on bespoke tasks, preventing an apples-to-apples comparison. To help fill this gap,…

Machine Learning · Computer Science 2025-02-04 Edmund Mills , Shiye Su , Stuart Russell , Scott Emmons

Previous dialogue summarization datasets mainly focus on open-domain chitchat dialogues, while summarization datasets for the broadly used task-oriented dialogue haven't been explored yet. Automatically summarizing such task-oriented…

Computation and Language · Computer Science 2021-10-26 Lulu Zhao , Fujia Zheng , Keqing He , Weihao Zeng , Yuejie Lei , Huixing Jiang , Wei Wu , Weiran Xu , Jun Guo , Fanyu Meng

Automatic evaluation metrics are a crucial component of dialog systems research. Standard language evaluation metrics are known to be ineffective for evaluating dialog. As such, recent research has proposed a number of novel,…

Computation and Language · Computer Science 2021-07-09 Yi-Ting Yeh , Maxine Eskenazi , Shikib Mehri

Explainable AI (XAI) techniques aim to provide insights into predictive models and enhance user performance, yet they often fall short of these expectations. Conversational XAI assistants promise to overcome such limitations, but empirical…

Machine Learning · Computer Science 2026-05-21 Sven Kruschel , Julian Rosenberger , Lasse Bohlen , Mathias Kraus , Patrick Zschech

Human annotator simulation (HAS) serves as a cost-effective substitute for human evaluation such as data annotation and system assessment. Human perception and behaviour during human evaluation exhibit inherent variability due to diverse…

Computation and Language · Computer Science 2023-10-03 Wen Wu , Wenlin Chen , Chao Zhang , Philip C. Woodland

We propose a novel probabilistic framework to model continuous-time interaction events data. Our goal is to infer the \emph{implicit} community structure underlying the temporal interactions among entities, and also to exploit how the…

Social and Information Networks · Computer Science 2020-06-24 Sikun Yang , Heinz Koeppl

Effective spoken dialog systems should facilitate natural interactions with quick and rhythmic timing, mirroring human communication patterns. To reduce response times, previous efforts have focused on minimizing the latency in automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-01 Oswald Zink , Yosuke Higuchi , Carlos Mullov , Alexander Waibel , Tetsunori Kobayashi

Automatic evaluation metrics are essential for the rapid development of open-domain dialogue systems as they facilitate hyper-parameter tuning and comparison between models. Although recently proposed trainable conversation-level metrics…

Computation and Language · Computer Science 2022-03-21 Sarik Ghazarian , Nuan Wen , Aram Galstyan , Nanyun Peng

Understanding the needs of a variety of distinct user groups is vital in designing effective, desirable dialogue systems that will be adopted by the largest possible segment of the population. Despite the increasing popularity of dialogue…

Human-Computer Interaction · Computer Science 2019-02-13 Libby Ferland , Thomas Huffstutler , Jacob Rice , Joan Zheng , Shi Ni , Maria Gini

A well-designed interactive human-like dialogue system is expected to take actions (e.g. smiling) and respond in a pattern similar to humans. However, due to the limitation of single-modality (only speech) or small volume of currently…

Human-Computer Interaction · Computer Science 2022-12-13 Zhiling Luo , Qiankun Shi , Sha Zhao , Wei Zhou , Haiqing Chen , Yuankai Ma , Haitao Leng

This paper analyses language modeling in spoken dialogue systems for accessing a database. The use of several language models obtained by exploiting dialogue predictions gives better results than the use of a single model for the whole…

cmp-lg · Computer Science 2008-02-03 Cosmin Popovici , Paolo Baggia

Recent advancements in dialogue policy planning have emphasized optimizing system agent policies to achieve predefined goals, focusing on strategy design, trajectory acquisition, and efficient training paradigms. However, these approaches…

Computation and Language · Computer Science 2025-04-21 Tao He , Lizi Liao , Ming Liu , Bing Qin

In healthcare, the ability to care for oneself is reflected in the "Activities of Daily Living (ADL)," which serve as a measure of functional ability (functioning). A lack of functioning may lead to poor living conditions requiring personal…

Computation and Language · Computer Science 2023-07-18 Zhecheng Sheng , Raymond Finzel , Michael Lucke , Sheena Dufresne , Maria Gini , Serguei Pakhomov

Driven by the rapid advancement of Large Language Models (LLMs), particularly Audio-LLMs and Omni-models, spoken dialogue systems have evolved significantly, progressively narrowing the gap between human-machine and human-human…

Recently, resources and tasks were proposed to go beyond state tracking in dialogue systems. An example is the frame tracking task, which requires recording multiple frames, one for each user goal set during the dialogue. This allows a…

Computation and Language · Computer Science 2017-06-07 Hannes Schulz , Jeremie Zumer , Layla El Asri , Shikhar Sharma

Despite recent advances in the field of explainable artificial intelligence systems, a concrete quantitative measure for evaluating the usability of such systems is nonexistent. Ensuring the success of an explanatory interface in…

Human-Computer Interaction · Computer Science 2020-10-26 Byung Hyung Kim , Seunghun Koh , Sejoon Huh , Sungho Jo , Sunghee Choi

Emotions have a major interactive role in defining how humans interact with their environment by encoding their perception to external events and accordingly, influencing their cognition and decision-making process. Therefore, increasing…

Human-Computer Interaction · Computer Science 2021-03-30 Mustaffa Alfatlawi

Dialog is a natural modality for interaction between customers and businesses in the service industry. As customers call up the service provider, their interactions may be routine or extraordinary. We believe that these interactions, when…

Computation and Language · Computer Science 2017-08-15 Q Vera Liao , Biplav Srivastava , Pavan Kapanipathi

Most research on task oriented dialog modeling is based on written text input. However, users interact with practical dialog systems often using speech as input. Typically, systems convert speech into text using an Automatic Speech…

Artificial Intelligence · Computer Science 2022-12-20 Hagen Soltau , Izhak Shafran , Mingqiu Wang , Abhinav Rastogi , Jeffrey Zhao , Ye Jia , Wei Han , Yuan Cao , Aramys Miranda