中文
相关论文

相关论文: Evaluating Attribution in Dialogue Systems: The BE…

200 篇论文

In open-domain dialogue intelligent agents should exhibit the use of knowledge, however there are few convincing demonstrations of this to date. The most popular sequence to sequence models typically "generate and hope" generic utterances…

计算与语言 · 计算机科学 2019-02-25 Emily Dinan , Stephen Roller , Kurt Shuster , Angela Fan , Michael Auli , Jason Weston

Response diversity has become an important criterion for evaluating the quality of open-domain dialogue generation models. However, current evaluation metrics for response diversity often fail to capture the semantic diversity of generated…

计算与语言 · 计算机科学 2022-10-25 Seungju Han , Beomsu Kim , Buru Chang

The equitable assessment of individual contribution in teams remains a persistent challenge, where conflict and disparity in workload can result in unfair performance evaluation, often requiring manual intervention - a costly and…

人工智能 · 计算机科学 2026-05-27 Jakub Slapek , Mir Seyedebrahimi , Jianhua Yang

This paper introduces an adversarial method to stress-test trained metrics to evaluate conversational dialogue systems. The method leverages Reinforcement Learning to find response strategies that elicit optimal scores from the trained…

人工智能 · 计算机科学 2022-03-01 Jan Deriu , Don Tuggener , Pius von Däniken , Mark Cieliebak

Knowledge-based, open-domain dialogue generation aims to build chit-chat systems that talk to humans using mined support knowledge. Many types and sources of knowledge have previously been shown to be useful as support knowledge. Even in…

计算与语言 · 计算机科学 2025-05-19 Xiangci Li , Linfeng Song , Lifeng Jin , Haitao Mi , Jessica Ouyang , Dong Yu

Knowledge-grounded dialogue generation is a challenging task because it requires satisfying two fundamental yet often competing constraints: being responsive in a manner that is specific to what the conversation partner has said while also…

计算与语言 · 计算机科学 2024-02-06 Kushal Chawla , Hannah Rashkin , Gaurav Singh Tomar , David Reitter

Human dialogues are scenario-based and appropriate responses generally relate to the latent context knowledge entailed by the specific scenario. To enable responses that are more meaningful and context-specific, we propose to improve…

计算与语言 · 计算机科学 2020-10-07 Shaoxiong Feng , Xuancheng Ren , Hongshen Chen , Bin Sun , Kan Li , Xu Sun

Spoken Dialogue Models (SDMs) have recently attracted significant attention for their ability to generate voice responses directly to users' spoken queries. Despite their increasing popularity, there exists a gap in research focused on…

计算与语言 · 计算机科学 2025-10-07 Chengqian Ma , Wei Tao , Yiwen Guo

This paper introduces QAConv, a new question answering (QA) dataset that uses conversations as a knowledge source. We focus on informative conversations, including business emails, panel discussions, and work channels. Unlike open-domain…

计算与语言 · 计算机科学 2022-04-18 Chien-Sheng Wu , Andrea Madotto , Wenhao Liu , Pascale Fung , Caiming Xiong

Emotional intelligence (EI), the ability to perceive, understand, and respond appropriately to others' emotional states, is central to human communication, and increasingly important to assess as LLMs assume conversational roles in everyday…

Most prior work on task-oriented dialogue systems are restricted to a limited coverage of domain APIs, while users oftentimes have domain related requests that are not covered by the APIs. In this paper, we propose to expand coverage of…

计算与语言 · 计算机科学 2020-06-08 Seokhwan Kim , Mihail Eric , Karthik Gopalakrishnan , Behnam Hedayatnia , Yang Liu , Dilek Hakkani-Tur

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

计算与语言 · 计算机科学 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke

With the growing prevalence of large language models, it is increasingly common to annotate datasets for machine learning using pools of crowd raters. However, these raters often work in isolation as individual crowdworkers. In this work,…

计算机与社会 · 计算机科学 2024-08-05 Sonja Schmer-Galunder , Ruta Wheelock , Scott Friedman , Alyssa Chvasta , Zaria Jalan , Emily Saltz

In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. Dialogue systems are increasingly being designed to move beyond just imitating conversation and also…

计算与语言 · 计算机科学 2021-11-03 Atharv Singh Patlan , Shiven Tripathi , Shubham Korde

There is a multitude of novel generative models for open-domain conversational systems; however, there is no systematic evaluation of different systems. Systematic comparisons require consistency in experimental design, evaluation sets,…

计算与语言 · 计算机科学 2020-10-27 Seolhwa Lee , Heuiseok Lim , João Sedoc

Incorporating personas information allows diverse and engaging responses in dialogue response generation. Unfortunately, prior works have primarily focused on self personas and have overlooked the value of partner personas. Moreover, in…

计算与语言 · 计算机科学 2021-11-30 Hongyuan Lu , Wai Lam , Hong Cheng , Helen M. Meng

Dialog systems enriched with external knowledge can handle user queries that are outside the scope of the supporting databases/APIs. In this paper, we follow the baseline provided in DSTC9 Track 1 and propose three subsystems, KDEAK,…

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge this gap. We first…

计算与语言 · 计算机科学 2025-03-18 Alihan Hüyük , Xinnuo Xu , Jacqueline Maasch , Aditya V. Nori , Javier González

Traditional dialogue summarization primarily focuses on dialogue content, assuming it comprises adequate information for a clear summary. However, this assumption often fails for discussions grounded in shared background, where participants…

计算与语言 · 计算机科学 2025-11-07 Weixiao Zhou , Junnan Zhu , Gengyao Li , Xianfu Cheng , Xinnian Liang , Feifei Zhai , Zhoujun Li

While previous conversational information-seeking (CIS) research has focused on passage retrieval, reranking, and query rewriting, the challenge of synthesizing retrieved information into coherent responses remains. The proposed research…

信息检索 · 计算机科学 2024-06-28 Weronika Łajewska