中文
相关论文

相关论文: Multi-domain Conversation Quality Evaluation via U…

200 篇论文

People often answer yes-no questions without explicitly saying yes, no, or similar polar keywords. Figuring out the meaning of indirect answers is challenging, even for large language models. In this paper, we investigate this problem…

计算与语言 · 计算机科学 2024-04-26 Zijie Wang , Farzana Rashid , Eduardo Blanco

In spoken Task-Oriented Dialogue (TOD) systems, the choice of the semantic representation describing the users' requests is key to a smooth interaction. Indeed, the system uses this representation to reason over a database and its domain…

人工智能 · 计算机科学 2024-06-21 Lucas Druart , Valentin Vielzeuf , Yannick Estève

Clarifying user needs is essential for existing task-oriented dialogue systems. However, in real-world applications, developers can never guarantee that all possible user demands are taken into account in the design phase. Consequently,…

计算与语言 · 计算机科学 2019-06-13 Weikang Wang , Jiajun Zhang , Qian Li , Mei-Yuh Hwang , Chengqing Zong , Zhifei Li

Automatic dialogue coherence evaluation has attracted increasing attention and is crucial for developing promising dialogue systems. However, existing metrics have two major limitations: (a) they are mostly trained in a simplified two-level…

计算与语言 · 计算机科学 2021-07-23 Zheng Ye , Liucun Lu , Lishan Huang , Liang Lin , Xiaodan Liang

Prepared domain specific datasets plays an important role to supervised learning approaches. In this article a new sentence dataset for software quality-in-use is proposed. Three experts were chosen to annotate the data using a proposed…

软件工程 · 计算机科学 2015-09-21 Issa Atoum , Chih How Bong , Narayanan Kulathuramaiyer

Recently, spoken dialogue systems have been widely deployed in a variety of applications, serving a huge number of end-users. A common issue is that the errors resulting from noisy utterances, semantic misunderstandings, or lack of…

计算与语言 · 计算机科学 2022-12-08 Wei Shen , Xiaonan He , Chuheng Zhang , Xuyun Zhang , Jian XIe

Generative AI has significantly changed industries by enabling text-driven image generation, yet challenges remain in achieving high-resolution outputs that align with fine-grained user preferences. Consequently, multi-round interactions…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Kun Li , Jianhui Wang , Yangfan He , Xinyuan Song , Ruoyu Wang , Hongyang He , Wenxin Zhang , Jiaqi Chen , Keqin Li , Sida Li , Miao Zhang , Tianyu Shi , Xueqian Wang

Growing literature explores toxicity and polarization in discourse, with comparatively less work on characterizing what makes dialogue prosocial and constructive. We explore conversational discourse and investigate a method for…

计算与语言 · 计算机科学 2025-11-04 Margaret Hughes , Brandon Roy , Elinor Poole-Dayan , Deb Roy , Jad Kabbara

The rapid evolution of large language models (LLMs) has transformed conversational agents, enabling complex human-machine interactions. However, evaluation frameworks often focus on single tasks, failing to capture the dynamic nature of…

计算与语言 · 计算机科学 2025-02-10 Pietro Alessandro Aluffi , Patrick Zietkiewicz , Marya Bazzi , Matt Arderne , Vladimirs Murevics

In contrast with goal-oriented dialogue, social dialogue has no clear measure of task success. Consequently, evaluation of these systems is notoriously hard. In this paper, we review current evaluation methods, focusing on automatic…

计算与语言 · 计算机科学 2017-09-14 Amanda Cercas Curry , Helen Hastie , Verena Rieser

Enhancing user engagement through interactions plays an essential role in socially-driven dialogues. While prior works have optimized models to reason over relevant knowledge or plan a dialogue act flow, the relationship between user…

计算与语言 · 计算机科学 2025-06-27 Jiashuo Wang , Kaitao Song , Chunpu Xu , Changhe Song , Yang Xiao , Dongsheng Li , Lili Qiu , Wenjie Li

In this paper, a novel Generation-Evaluation framework is developed for multi-turn conversations with the objective of letting both participants know more about each other. For the sake of rational knowledge utilization and coherent…

计算与语言 · 计算机科学 2019-06-04 Siqi Bao , Huang He , Fan Wang , Rongzhong Lian , Hua Wu

Existing open-domain dialog models are generally trained to minimize the perplexity of target human responses. However, some human replies are more engaging than others, spawning more followup interactions. Current conversational models are…

计算与语言 · 计算机科学 2020-09-16 Xiang Gao , Yizhe Zhang , Michel Galley , Chris Brockett , Bill Dolan

Most of the existing spoken language understanding systems can perform only semantic frame parsing based on a single-round user query. They cannot take users' feedback to update/add/remove slot values through multiround interactions with…

计算与语言 · 计算机科学 2021-06-29 Yu Wang , Yilin Shen , Hongxia Jin

This paper propose to combine pretrained language models with the modular dialogue paradigm for open-domain dialogue modeling. Our method, semantic-enhanced finetuning, instantiates conversation understanding, planning, and response…

计算与语言 · 计算机科学 2022-05-25 Yinhe Zheng , Yida Wang , Pei Ke , Zhenyu Yang , Minlie Huang

Despite the rapid progress of open-domain generation-based conversational agents, most deployed systems treat dialogue contexts as single-turns, while systems dealing with multi-turn contexts are less studied. There is a lack of a reliable…

计算与语言 · 计算机科学 2022-11-10 Yujie Xing , Jon Atle Gulla

Social interactions in general are multifaceted and there exists a wide set of factors and events that influence them. In this paper, we quantify social interactions with a holistic viewpoint on individual experiences, particularly focusing…

多智能体系统 · 计算机科学 2020-09-29 Navin Raj Prabhu , Chirag Raman , Hayley Hung

Recent advances in open-domain dialogue systems rely on the success of neural models that are trained on large-scale data. However, collecting large-scale dialogue data is usually time-consuming and labor-intensive. To address this data…

计算与语言 · 计算机科学 2020-11-11 Rongsheng Zhang , Yinhe Zheng , Jianzhi Shao , Xiaoxi Mao , Yadong Xi , Minlie Huang

Today, most large-scale conversational AI agents (e.g. Alexa, Siri, or Google Assistant) are built using manually annotated data to train the different components of the system. Typically, the accuracy of the ML models in these components…

机器学习 · 计算机科学 2019-11-07 Pragaash Ponnusamy , Alireza Roshan Ghias , Chenlei Guo , Ruhi Sarikaya

Achieving seamless, human-like interaction remains a key challenge for full-duplex spoken dialogue models (SDMs). Reinforcement learning (RL) has substantially enhanced text- and vision-language models, while well-designed reward signals…

人工智能 · 计算机科学 2026-04-17 Yifu Chen , Shengpeng Ji , Zhengqing Liu , Qian Chen , Wen Wang , Ziqing Wang , Yangzhuo Li , Tianle Liang , Zhou Zhao