English
Related papers

Related papers: Generate, Evaluate, and Select: A Dialogue System …

200 papers

Evaluating AI systems that interact with humans requires understanding their behavior across diverse user populations, but collecting representative human data is often expensive or infeasible, particularly for novel technologies or…

Artificial Intelligence · Computer Science 2026-05-27 Davide Paglieri , Logan Cross , William A. Cunningham , Joel Z. Leibo , Alexander Sasha Vezhnevets

Cross-domain natural language generation (NLG) is still a difficult task within spoken dialogue modelling. Given a semantic representation provided by the dialogue manager, the language generator should generate sentences that convey…

Computation and Language · Computer Science 2018-12-24 Bo-Hsiang Tseng , Florian Kreyssig , Pawel Budzianowski , Inigo Casanueva , Yen-Chen Wu , Stefan Ultes , Milica Gasic

The rapid advancement of conversational search systems revolutionizes how information is accessed by enabling the multi-turn interaction between the user and the system. Existing conversational search systems are usually built with two…

Computation and Language · Computer Science 2025-07-14 Fengran Mo , Yifan Gao , Chuan Meng , Xin Liu , Zhuofeng Wu , Kelong Mao , Zhengyang Wang , Pei Chen , Zheng Li , Xian Li , Bing Yin , Meng Jiang

Maintaining a consistent personality in conversations is quite natural for human beings, but is still a non-trivial task for machines. The persona-based dialogue generation task is thus introduced to tackle the personality-inconsistent…

Computation and Language · Computer Science 2020-05-01 Haoyu Song , Yan Wang , Wei-Nan Zhang , Xiaojiang Liu , Ting Liu

The generation of personalized dialogue is vital to natural and human-like conversation. Typically, personalized dialogue generation models involve conditioning the generated response on the dialogue history and a representation of the…

Computation and Language · Computer Science 2021-11-23 Jing Yang Lee , Kong Aik Lee , Woon Seng Gan

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

In comparison to the interpretation of classification models, the explanation of sequence generation models is also an important problem, however it has seen little attention. In this work, we study model-agnostic explanations of a…

Computation and Language · Computer Science 2022-02-08 Yi-Lin Tuan , Connor Pryor , Wenhu Chen , Lise Getoor , William Yang Wang

The recent application of RNN encoder-decoder models has resulted in substantial progress in fully data-driven dialogue systems, but evaluation remains a challenge. An adversarial loss could be a way to directly evaluate the extent to which…

Computation and Language · Computer Science 2017-01-31 Anjuli Kannan , Oriol Vinyals

We present Viola, an open-domain dialogue system for spoken conversation that uses a topic-agnostic dialogue manager based on a simple generate-and-rank approach. Leveraging recent advances of generative dialogue systems powered by large…

Computation and Language · Computer Science 2021-08-26 Hyundong Cho , Basel Shbita , Kartik Shenoy , Shuai Liu , Nikhil Patel , Hitesh Pindikanti , Jennifer Lee , Jonathan May

Despite tremendous advancements in dialogue systems, stable evaluation still requires human judgments producing notoriously high-variance metrics due to their inherent subjectivity. Moreover, methods and labels in dialogue evaluation are…

Computation and Language · Computer Science 2023-08-01 Sarah E. Finch , James D. Finch , Jinho D. Choi

The wave of pre-training language models has been continuously improving the quality of the machine-generated conversations, however, some of the generated responses still suffer from excessive repetition, sometimes repeating words from…

Computation and Language · Computer Science 2021-12-17 Yadong Xi , Jiashu Pu , Xiaoxi Mao

Generative retrieval has recently emerged as a promising approach to sequential recommendation, framing candidate item retrieval as an autoregressive sequence generation problem. However, existing generative methods typically focus solely…

Information Retrieval · Computer Science 2024-07-04 Ye Wang , Jiahao Xun , Minjie Hong , Jieming Zhu , Tao Jin , Wang Lin , Haoyuan Li , Linjun Li , Yan Xia , Zhou Zhao , Zhenhua Dong

This paper proposes a group deliberation oriented multi-agent conversational model to address the limitations of single large language models in complex reasoning tasks. The model adopts a three-level role division architecture consisting…

Artificial Intelligence · Computer Science 2026-01-01 Zheyu Shi , Dong Qiu , Shanlong Yu

Evaluating open-domain dialogue systems is challenging for reasons such as the one-to-many problem, i.e., many appropriate responses other than just the golden response. As of now, automatic evaluation methods need better consistency with…

Computation and Language · Computer Science 2023-09-19 Zhengliang Shi , Weiwei Sun , Shuo Zhang , Zhen Zhang , Pengjie Ren , Zhaochun Ren

Acquiring training data to improve the robustness of dialog systems can be a painstakingly long process. In this work, we propose a method to reduce the cost and effort of creating new conversational agents by artificially generating more…

Computation and Language · Computer Science 2022-05-05 Louis Marceau , Raouf Belbahar , Marc Queudot , Nada Naji , Eric Charton , Marie-Jean Meurs

Current evaluation practices in speech-driven gesture generation lack standardisation and focus on aspects that are easy to measure over aspects that actually matter. This leads to a situation where it is impossible to know what is the…

Despite the recent advances in open-domain dialogue systems, building a reliable evaluation metric is still a challenging problem. Recent studies proposed learnable metrics based on classification models trained to distinguish the correct…

Computation and Language · Computer Science 2023-05-26 ChaeHun Park , Seungil Chad Lee , Daniel Rim , Jaegul Choo

Reranking models solve the final recommendation lists that best fulfill users' demands. While existing solutions focus on finding parametric models that approximate optimal policies, recent approaches find that it is better to generate…

Information Retrieval · Computer Science 2025-04-23 Hailan Yang , Zhenyu Qi , Shuchang Liu , Xiaoyu Yang , Xiaobei Wang , Xiang Li , Lantao Hu , Han Li , Kun Gai

Negotiation is one of the crucial abilities in human communication, and there has been a resurgent research interest in negotiation dialogue systems recently, which goal is to empower intelligent agents with such ability that can…

Computation and Language · Computer Science 2022-12-20 Haolan Zhan , Yufei Wang , Tao Feng , Yuncheng Hua , Suraj Sharma , Zhuang Li , Lizhen Qu , Gholamreza Haffari

Customer reviews usually contain much information about one's online shopping experience. While positive reviews are beneficial to the stores, negative ones will largely influence consumers' decision and may lead to a decline in sales.…

Computation and Language · Computer Science 2022-09-21 Bo Chen , Jiayi Liu , Mieradilijiang Maimaiti , Xing Gao , Ji Zhang