English
Related papers

Related papers: Approximating Interactive Human Evaluation with Se…

200 papers

Creating effective dialogue systems for mental health support requires high-quality multi-turn counseling dialogue data, yet collecting real counselor-client conversations presents significant challenges, including privacy concerns, high…

Computation and Language · Computer Science 2026-05-27 Huachuan Qiu , Zhenzhong Lan

Building dialogue systems that naturally converse with humans is being an attractive and an active research domain. Multiple systems are being designed everyday and several datasets are being available. For this reason, it is being hard to…

Computation and Language · Computer Science 2019-07-31 Basma El Amel Boussaha , Nicolas Hernandez , Christine Jacquin , Emmanuel Morin

Recent open-domain dialogue models have brought numerous breakthroughs. However, building a chat system is not scalable since it often requires a considerable volume of human-human dialogue data, especially when enforcing features such as…

Computation and Language · Computer Science 2022-05-03 Sanghwan Bae , Donghyun Kwak , Sungdong Kim , Donghoon Ham , Soyoung Kang , Sang-Woo Lee , Woomyoung Park

Due to the lack of human resources for mental health support, there is an increasing demand for employing conversational agents for support. Recent work has demonstrated the effectiveness of dialogue models in providing emotional support.…

Computation and Language · Computer Science 2023-05-30 Jiale Cheng , Sahand Sabour , Hao Sun , Zhuang Chen , Minlie Huang

Open-domain dialog systems (also known as chatbots) have increasingly drawn attention in natural language processing. Some of the recent work aims at incorporating affect information into sequence-to-sequence neural dialog modeling, making…

Computation and Language · Computer Science 2020-06-25 Yubo Xie , Ekaterina Svikhnushina , Pearl Pu

User attributes provide rich and useful information for user understanding, yet structured and easy-to-use attributes are often sparsely populated. In this paper, we leverage dialogues with conversational agents, which contain strong…

Computation and Language · Computer Science 2019-08-14 Chien-Sheng Wu , Andrea Madotto , Zhaojiang Lin , Peng Xu , Pascale Fung

Task-oriented dialog systems are often trained on human/human dialogs, such as collected from Wizard-of-Oz interfaces. However, human/human corpora are frequently too small for supervised training to be effective. This paper investigates…

Computation and Language · Computer Science 2021-09-21 Arkady Arkhangorodsky , Scot Fang , Victoria Knight , Ajay Nagesh , Maria Ryskina , Kevin Knight

Designing dialog tutors has been challenging as it involves modeling the diverse and complex pedagogical strategies employed by human tutors. Although there have been significant recent advances in neural conversational systems using large…

Computation and Language · Computer Science 2023-03-29 Jakub Macina , Nico Daheim , Lingzhi Wang , Tanmay Sinha , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

Driven by the rapid advancement of Large Language Models (LLMs), particularly Audio-LLMs and Omni-models, spoken dialogue systems have evolved significantly, progressively narrowing the gap between human-machine and human-human…

Endowing dialogue systems with personas is essential to deliver more human-like conversations. However, this problem is still far from well explored due to the difficulties of both embodying personalities in natural languages and the…

Computation and Language · Computer Science 2019-11-13 Yinhe Zheng , Rongsheng Zhang , Xiaoxi Mao , Minlie Huang

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

Despite recent improvements in open-domain dialogue models, state of the art models are trained and evaluated on short conversations with little context. In contrast, the long-term conversation setting has hardly been studied. In this work…

Computation and Language · Computer Science 2021-07-19 Jing Xu , Arthur Szlam , Jason Weston

Proactive dialogue systems, related to a wide range of real-world conversational applications, equip the conversational agent with the capability of leading the conversation direction towards achieving pre-defined targets or fulfilling…

Computation and Language · Computer Science 2023-05-10 Yang Deng , Wenqiang Lei , Wai Lam , Tat-Seng Chua

Role-play has become a key testbed for generative models, expanding from text-only dialogue to multimodal interaction. Extending role-play to speech captures prosody, emotion, and delivery, but also poses new evaluation challenges. Current…

Maintaining a consistent attribute profile is crucial for dialogue agents to naturally converse with humans. Existing studies on improving attribute consistency mainly explored how to incorporate attribute information in the responses, but…

Computation and Language · Computer Science 2021-05-18 Haoyu Song , Yan Wang , Wei-Nan Zhang , Zhengyu Zhao , Ting Liu , Xiaojiang Liu

Current dialogue systems are not very engaging for users, especially when trained end-to-end without relying on proactive reengaging scripted strategies. Zhang et al. (2018) showed that the engagement level of end-to-end dialogue models…

Computation and Language · Computer Science 2018-09-07 Pierre-Emmanuel Mazaré , Samuel Humeau , Martin Raison , Antoine Bordes

Human ratings are one of the most prevalent methods to evaluate the performance of natural language processing algorithms. Similarly, it is common to measure the quality of sentences generated by a natural language generation model using…

Computation and Language · Computer Science 2021-04-13 Jakob Nyberg , Ramesh Manuvinakurike , Maike Paetzel-Prüsmann

Developing intelligent persuasive conversational agents to change people's opinions and actions for social good is the frontier in advancing the ethical development of automated dialogue systems. To do so, the first step is to understand…

Computation and Language · Computer Science 2020-01-14 Xuewei Wang , Weiyan Shi , Richard Kim , Yoojung Oh , Sijia Yang , Jingwen Zhang , Zhou Yu

To provide consistent emotional interaction with users, dialog systems should be capable to automatically select appropriate emotions for responses like humans. However, most existing works focus on rendering specified emotions in responses…

Computation and Language · Computer Science 2021-07-01 Wen Zhiyuan , Cao Jiannong , Yang Ruosong , Liu Shuaiqi , Shen Jiaxing

When communicating, people behave consistently across conversational roles: People understand the words they say and are able to produce the words they hear. To date, artificial agents developed for language tasks have lacked such symmetry,…

Computation and Language · Computer Science 2020-10-13 Charles Lovering , Ellie Pavlick