English
Related papers

Related papers: Generate, Evaluate, and Select: A Dialogue System …

200 papers

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

Computation and Language · Computer Science 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke

Conversational recommender systems have attracted immense attention recently. The most recent approaches rely on neural models trained on recorded dialogs between humans, implementing an end-to-end learning process. These systems are…

Information Retrieval · Computer Science 2022-05-26 Ahtsham Manzoor , Dietmar Jannach

The aim of this paper is to mitigate the shortcomings of automatic evaluation of open-domain dialog systems through multi-reference evaluation. Existing metrics have been shown to correlate poorly with human judgement, particularly in…

Computation and Language · Computer Science 2019-09-10 Prakhar Gupta , Shikib Mehri , Tiancheng Zhao , Amy Pavel , Maxine Eskenazi , Jeffrey P. Bigham

Towards human-like dialogue systems, current emotional dialogue approaches jointly model emotion and semantics with a unified neural network. This strategy tends to generate safe responses due to the mutual restriction between emotion and…

Computation and Language · Computer Science 2024-10-02 Yushan Qian , Bo Wang , Shangzhao Ma , Wu Bin , Shuo Zhang , Dongming Zhao , Kun Huang , Yuexian Hou

There is a multitude of novel generative models for open-domain conversational systems; however, there is no systematic evaluation of different systems. Systematic comparisons require consistency in experimental design, evaluation sets,…

Computation and Language · Computer Science 2020-10-27 Seolhwa Lee , Heuiseok Lim , João Sedoc

A good empathetic dialogue system should first track and understand a user's emotion and then reply with an appropriate emotion. However, current approaches to this task either focus on improving the understanding of users' emotion or on…

Computation and Language · Computer Science 2022-08-04 Yuhan Liu , Jun Gao , Jiachen Du , Lanjun Zhou , Ruifeng Xu

Collecting human judgements is currently the most reliable evaluation method for natural language generation systems. Automatic metrics have reported flaws when applied to measure quality aspects of generated text and have been shown to…

Computation and Language · Computer Science 2022-04-29 Thórhildur Thorleiksdóttir , Cedric Renggli , Nora Hollenstein , Ce Zhang

Responsing with image has been recognized as an important capability for an intelligent conversational agent. Yet existing works only focus on exploring the multimodal dialogue models which depend on retrieval-based methods, but neglecting…

Computation and Language · Computer Science 2022-03-30 Qingfeng Sun , Yujing Wang , Can Xu , Kai Zheng , Yaming Yang , Huang Hu , Fei Xu , Jessica Zhang , Xiubo Geng , Daxin Jiang

In retrieval-based dialogue systems, a response selection model acts as a ranker to select the most appropriate response among several candidates. However, such selection models tend to rely on context-response content similarity, which…

Computation and Language · Computer Science 2022-11-01 Nyoungwoo Lee , ChaeHun Park , Ho-Jin Choi , Jaegul Choo

Linguistic pragmatics state that a conversation's underlying speech acts can constrain the type of response which is appropriate at each turn in the conversation. When generating dialogue responses, neural dialogue agents struggle to…

Computation and Language · Computer Science 2023-04-07 Katherine Stasaski , Marti A. Hearst

Social chatbots have gained immense popularity, and their appeal lies not just in their capacity to respond to the diverse requests from users, but also in the ability to develop an emotional connection with users. To further develop and…

Computation and Language · Computer Science 2022-06-01 Avinash Madasu , Mauajama Firdaus , Asif Eqbal

Dialogue engines that incorporate different types of agents to converse with humans are popular. However, conversations are dynamic in the sense that a selected response will change the conversation on-the-fly, influencing the subsequent…

Computation and Language · Computer Science 2020-05-08 Asir Saeed , Khai Mai , Pham Minh , Nguyen Tuan Duc , Danushka Bollegala

Neural generative models have become popular and achieved promising performance on short-text conversation tasks. They are generally trained to build a 1-to-1 mapping from the input post to its output response. However, a given post is…

Computation and Language · Computer Science 2019-02-22 Jun Gao , Wei Bi , Xiaojiang Liu , Junhui Li , Shuming Shi

Sequence generation models for dialogue are known to have several problems: they tend to produce short, generic sentences that are uninformative and unengaging. Retrieval models on the other hand can surface interesting responses, but are…

Computation and Language · Computer Science 2018-09-07 Jason Weston , Emily Dinan , Alexander H. Miller

Knowledge-grounded dialogue systems are intended to convey information that is based on evidence provided in a given source text. We discuss the challenges of training a generative neural dialogue model for such systems that is controlled…

Computation and Language · Computer Science 2021-07-16 Hannah Rashkin , David Reitter , Gaurav Singh Tomar , Dipanjan Das

End-to-end generation-based approaches have been investigated and applied in task-oriented dialogue systems. However, in industrial scenarios, existing methods face the bottlenecks of controllability (e.g., domain-inconsistent responses,…

Computation and Language · Computer Science 2023-04-04 Yuncheng Hua , Xiangyu Xi , Zheng Jiang , Guanwei Zhang , Chaobo Sun , Guanglu Wan , Wei Ye

Evaluating the quality of a dialogue system is an understudied problem. The recent evolution of evaluation method motivated this survey, in which an explicit and comprehensive analysis of the existing methods is sought. We are first to…

Computation and Language · Computer Science 2021-08-04 Xinmeng Li , Wansen Wu , Long Qin , Quanjun Yin

Automatic evaluation of open-domain dialogue response generation is very challenging because there are many appropriate responses for a given context. Existing evaluation models merely compare the generated response with the ground truth…

Computation and Language · Computer Science 2020-06-15 JinYeong Bak , Alice Oh

Human conversation is a complex mechanism with subtle nuances. It is hence an ambitious goal to develop artificial intelligence agents that can participate fluently in a conversation. While we are still far from achieving this goal, recent…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Unnat Jain , Svetlana Lazebnik , Alexander Schwing

Current works in the generation of personalized dialogue primarily contribute to the agent presenting a consistent personality and driving a more informative response. However, we found that the generated responses from most previous models…

Computation and Language · Computer Science 2022-08-23 Itsugun Cho , Dongyang Wang , Ryota Takahashi , Hiroaki Saito