English
Related papers

Related papers: Turn-level Dialog Evaluation with Dialog-level Wea…

200 papers

Effective human-agent collaboration is increasingly prevalent in real-world applications. Current trends in such collaborations are predominantly unidirectional, with users providing instructions or posing questions to agents, where agents…

Artificial Intelligence · Computer Science 2025-12-16 Emre Can Acikgoz , Jinoh Oh , Jie Hao , Joo Hyuk Jeon , Heng Ji , Dilek Hakkani-Tür , Gokhan Tur , Xiang Li , Chengyuan Ma , Xing Fan

Many businesses and consumers are extending the capabilities of voice-based services such as Amazon Alexa, Google Home, Microsoft Cortana, and Apple Siri to create custom voice experiences (also known as skills). As the number of these…

Computation and Language · Computer Science 2019-11-18 Maryam Fazel-Zarandi , Sampat Biswas , Ryan Summers , Ahmed Elmalt , Andy McCraw , Michael McPhilips , John Peach

Many studies have applied reinforcement learning to train a dialog policy and show great promise these years. One common approach is to employ a user simulator to obtain a large number of simulated user experiences for reinforcement…

Computation and Language · Computer Science 2020-04-24 Ryuichi Takanobu , Runze Liang , Minlie Huang

We propose a large language model based reward decomposition framework for aligning dialogue agents using only a single session-level feedback signal. We leverage the reasoning capabilities of a frozen, pretrained large language model (LLM)…

Computation and Language · Computer Science 2026-02-12 Dong Won Lee , Hae Won Park , Cynthia Breazeal , Louis-Philippe Morency

Turn-taking, aiming to decide when the next speaker can start talking, is an essential component in building human-robot spoken dialogue systems. Previous studies indicate that multimodal cues can facilitate this challenging task. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-22 Jiudong Yang , Peiying Wang , Yi Zhu , Mingchao Feng , Meng Chen , Xiaodong He

Recent advances in deep neural networks, language modeling and language generation have introduced new ideas to the field of conversational agents. As a result, deep neural models such as sequence-to-sequence, Memory Networks, and the…

Computation and Language · Computer Science 2019-02-27 Momchil Hardalov , Ivan Koychev , Preslav Nakov

Dialogue policy learning for task-oriented dialogue systems has enjoyed great progress recently mostly through employing reinforcement learning methods. However, these approaches have become very sophisticated. It is time to re-evaluate it.…

Computation and Language · Computer Science 2020-09-22 Ziming Li , Julia Kiseleva , Maarten de Rijke

Building a machine learning driven spoken dialog system for goal-oriented interactions involves careful design of intents and data collection along with development of intent recognition models and dialog policy learning algorithms. The…

Computation and Language · Computer Science 2019-12-24 Saurav Sahay , Shachi H Kumar , Eda Okur , Haroon Syed , Lama Nachman

In this paper, a novel Generation-Evaluation framework is developed for multi-turn conversations with the objective of letting both participants know more about each other. For the sake of rational knowledge utilization and coherent…

Computation and Language · Computer Science 2019-06-04 Siqi Bao , Huang He , Fan Wang , Rongzhong Lian , Hua Wu

The next step for intelligent dialog agents is to escape their role as silent bystanders and become proactive. Well-defined proactive behavior may improve human-machine cooperation, as the agent takes a more active role during interaction…

Computation and Language · Computer Science 2023-06-23 Matthias Kraus , Nicolas Wagner , Ron Riekenbrauck , Wolfgang Minker

User engagement is a critical metric for evaluating the quality of open-domain dialogue systems. Prior work has focused on conversation-level engagement by using heuristically constructed features such as the number of turns and the total…

Computation and Language · Computer Science 2020-01-27 Sarik Ghazarian , Ralph Weischedel , Aram Galstyan , Nanyun Peng

Open-domain social dialogue is one of the long-standing goals of Artificial Intelligence. This year, the Amazon Alexa Prize challenge was announced for the first time, where real customers get to rate systems developed by leading…

Computation and Language · Computer Science 2017-12-21 Ioannis Papaioannou , Amanda Cercas Curry , Jose L. Part , Igor Shalyminov , Xinnuo Xu , Yanchao Yu , Ondřej Dušek , Verena Rieser , Oliver Lemon

Conversational agents are exploding in popularity. However, much work remains in the area of non goal-oriented conversations, despite significant growth in research interest over recent years. To advance the state of the art in…

Robot-moderated group discussions have the potential to facilitate engaging and productive interactions among human participants. Previous work on topic management in conversational agents has predominantly focused on human engagement and…

Robotics · Computer Science 2025-04-04 Georgios Hadjiantonis , Sarah Gillet , Marynel Vázquez , Iolanda Leite , Fethiye Irmak Dogan

Towards human-like dialogue systems, current emotional dialogue approaches jointly model emotion and semantics with a unified neural network. This strategy tends to generate safe responses due to the mutual restriction between emotion and…

Computation and Language · Computer Science 2024-10-02 Yushan Qian , Bo Wang , Shangzhao Ma , Wu Bin , Shuo Zhang , Dongming Zhao , Kun Huang , Yuexian Hou

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

Computation and Language · Computer Science 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke

For conversational AI and virtual assistants to communicate with humans in a realistic way, they must exhibit human characteristics such as expression of emotion and personality. Current attempts toward constructing human-like dialogue…

Computation and Language · Computer Science 2021-12-03 Aaron W. Li , Veronica Jiang , Steven Y. Feng , Julia Sprague , Wei Zhou , Jesse Hoey

Building a socially intelligent agent involves many challenges, one of which is to teach the agent to speak guided by its value like a human. However, value-driven chatbots are still understudied in the area of dialogue systems. Most…

Computation and Language · Computer Science 2022-07-25 Liang Qiu , Yizhou Zhao , Jinchao Li , Pan Lu , Baolin Peng , Jianfeng Gao , Song-Chun Zhu

Autonomous systems conducting schema-grounded information-gathering dialogues face an instrumentation gap, lacking turn-level observables for monitoring acquisition efficiency and detecting when questioning becomes unproductive. We…

Computation and Language · Computer Science 2026-01-15 Dimitris Panagopoulos , Adolfo Perrusquia , Weisi Guo

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation…

Computation and Language · Computer Science 2020-06-12 Sarah E. Finch , Jinho D. Choi