中文
相关论文

相关论文: Approximating Interactive Human Evaluation with Se…

200 篇论文

Creating effective dialogue systems for mental health support requires high-quality multi-turn counseling dialogue data, yet collecting real counselor-client conversations presents significant challenges, including privacy concerns, high…

计算与语言 · 计算机科学 2026-05-27 Huachuan Qiu , Zhenzhong Lan

Building dialogue systems that naturally converse with humans is being an attractive and an active research domain. Multiple systems are being designed everyday and several datasets are being available. For this reason, it is being hard to…

计算与语言 · 计算机科学 2019-07-31 Basma El Amel Boussaha , Nicolas Hernandez , Christine Jacquin , Emmanuel Morin

Recent open-domain dialogue models have brought numerous breakthroughs. However, building a chat system is not scalable since it often requires a considerable volume of human-human dialogue data, especially when enforcing features such as…

计算与语言 · 计算机科学 2022-05-03 Sanghwan Bae , Donghyun Kwak , Sungdong Kim , Donghoon Ham , Soyoung Kang , Sang-Woo Lee , Woomyoung Park

Due to the lack of human resources for mental health support, there is an increasing demand for employing conversational agents for support. Recent work has demonstrated the effectiveness of dialogue models in providing emotional support.…

计算与语言 · 计算机科学 2023-05-30 Jiale Cheng , Sahand Sabour , Hao Sun , Zhuang Chen , Minlie Huang

Open-domain dialog systems (also known as chatbots) have increasingly drawn attention in natural language processing. Some of the recent work aims at incorporating affect information into sequence-to-sequence neural dialog modeling, making…

计算与语言 · 计算机科学 2020-06-25 Yubo Xie , Ekaterina Svikhnushina , Pearl Pu

User attributes provide rich and useful information for user understanding, yet structured and easy-to-use attributes are often sparsely populated. In this paper, we leverage dialogues with conversational agents, which contain strong…

计算与语言 · 计算机科学 2019-08-14 Chien-Sheng Wu , Andrea Madotto , Zhaojiang Lin , Peng Xu , Pascale Fung

Task-oriented dialog systems are often trained on human/human dialogs, such as collected from Wizard-of-Oz interfaces. However, human/human corpora are frequently too small for supervised training to be effective. This paper investigates…

计算与语言 · 计算机科学 2021-09-21 Arkady Arkhangorodsky , Scot Fang , Victoria Knight , Ajay Nagesh , Maria Ryskina , Kevin Knight

Designing dialog tutors has been challenging as it involves modeling the diverse and complex pedagogical strategies employed by human tutors. Although there have been significant recent advances in neural conversational systems using large…

计算与语言 · 计算机科学 2023-03-29 Jakub Macina , Nico Daheim , Lingzhi Wang , Tanmay Sinha , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

Driven by the rapid advancement of Large Language Models (LLMs), particularly Audio-LLMs and Omni-models, spoken dialogue systems have evolved significantly, progressively narrowing the gap between human-machine and human-human…

Endowing dialogue systems with personas is essential to deliver more human-like conversations. However, this problem is still far from well explored due to the difficulties of both embodying personalities in natural languages and the…

计算与语言 · 计算机科学 2019-11-13 Yinhe Zheng , Rongsheng Zhang , Xiaoxi Mao , Minlie Huang

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

计算与语言 · 计算机科学 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

Despite recent improvements in open-domain dialogue models, state of the art models are trained and evaluated on short conversations with little context. In contrast, the long-term conversation setting has hardly been studied. In this work…

计算与语言 · 计算机科学 2021-07-19 Jing Xu , Arthur Szlam , Jason Weston

Proactive dialogue systems, related to a wide range of real-world conversational applications, equip the conversational agent with the capability of leading the conversation direction towards achieving pre-defined targets or fulfilling…

计算与语言 · 计算机科学 2023-05-10 Yang Deng , Wenqiang Lei , Wai Lam , Tat-Seng Chua

Role-play has become a key testbed for generative models, expanding from text-only dialogue to multimodal interaction. Extending role-play to speech captures prosody, emotion, and delivery, but also poses new evaluation challenges. Current…

Maintaining a consistent attribute profile is crucial for dialogue agents to naturally converse with humans. Existing studies on improving attribute consistency mainly explored how to incorporate attribute information in the responses, but…

计算与语言 · 计算机科学 2021-05-18 Haoyu Song , Yan Wang , Wei-Nan Zhang , Zhengyu Zhao , Ting Liu , Xiaojiang Liu

Current dialogue systems are not very engaging for users, especially when trained end-to-end without relying on proactive reengaging scripted strategies. Zhang et al. (2018) showed that the engagement level of end-to-end dialogue models…

计算与语言 · 计算机科学 2018-09-07 Pierre-Emmanuel Mazaré , Samuel Humeau , Martin Raison , Antoine Bordes

Human ratings are one of the most prevalent methods to evaluate the performance of natural language processing algorithms. Similarly, it is common to measure the quality of sentences generated by a natural language generation model using…

计算与语言 · 计算机科学 2021-04-13 Jakob Nyberg , Ramesh Manuvinakurike , Maike Paetzel-Prüsmann

Developing intelligent persuasive conversational agents to change people's opinions and actions for social good is the frontier in advancing the ethical development of automated dialogue systems. To do so, the first step is to understand…

计算与语言 · 计算机科学 2020-01-14 Xuewei Wang , Weiyan Shi , Richard Kim , Yoojung Oh , Sijia Yang , Jingwen Zhang , Zhou Yu

To provide consistent emotional interaction with users, dialog systems should be capable to automatically select appropriate emotions for responses like humans. However, most existing works focus on rendering specified emotions in responses…

计算与语言 · 计算机科学 2021-07-01 Wen Zhiyuan , Cao Jiannong , Yang Ruosong , Liu Shuaiqi , Shen Jiaxing

When communicating, people behave consistently across conversational roles: People understand the words they say and are able to produce the words they hear. To date, artificial agents developed for language tasks have lacked such symmetry,…

计算与语言 · 计算机科学 2020-10-13 Charles Lovering , Ellie Pavlick