English
Related papers

Related papers: Speaker Sensitive Response Evaluation Model

200 papers

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

The experimental landscape in natural language processing for social media is too fragmented. Each year, new shared tasks and datasets are proposed, ranging from classics like sentiment analysis to irony detection or emoji prediction.…

Computation and Language · Computer Science 2020-10-27 Francesco Barbieri , Jose Camacho-Collados , Leonardo Neves , Luis Espinosa-Anke

Most human interactions occur in the form of spoken conversations where the semantic meaning of a given utterance depends on the context. Each utterance in spoken conversation can be represented by many semantic and speaker attributes, and…

Computation and Language · Computer Science 2023-05-02 Siddhant Arora , Hayato Futami , Emiru Tsunoo , Brian Yan , Shinji Watanabe

We aim to overcome the lack of diversity in responses of current dialogue systems and to develop a dialogue system that is engaging as a conversational partner. We propose a generator-evaluator model that evaluates multiple responses…

Computation and Language · Computer Science 2022-06-13 Ryoma Sakaeda , Daisuke Kawahara

This paper introduces an adversarial method to stress-test trained metrics to evaluate conversational dialogue systems. The method leverages Reinforcement Learning to find response strategies that elicit optimal scores from the trained…

Artificial Intelligence · Computer Science 2022-03-01 Jan Deriu , Don Tuggener , Pius von Däniken , Mark Cieliebak

There is a multitude of novel generative models for open-domain conversational systems; however, there is no systematic evaluation of different systems. Systematic comparisons require consistency in experimental design, evaluation sets,…

Computation and Language · Computer Science 2020-10-27 Seolhwa Lee , Heuiseok Lim , João Sedoc

The ability to model and automatically detect dialogue act is an important step toward understanding spontaneous speech and Instant Messages. However, it has been difficult to infer a dialogue act from a surface utterance because it highly…

Computation and Language · Computer Science 2018-06-05 AbdelRahim Elmadany , Sherif Abdou , Mervat Gheith

Semantic sentence embeddings are usually supervisedly built minimizing distances between pairs of embeddings of sentences labelled as semantically similar by annotators. Since big labelled datasets are rare, in particular for non-English…

Computation and Language · Computer Science 2021-10-06 Marco Di Giovanni , Marco Brambilla

While liking or upvoting a post on a mobile app is easy to do, replying with a written note is much more difficult, due to both the cognitive load of coming up with a meaningful response as well as the mechanics of entering the text. Here…

Social and Information Networks · Computer Science 2017-11-29 Parminder Bhatia , Marsal Gavalda , Arash Einolghozati

We study knowledge-grounded dialogue generation with pre-trained language models. To leverage the redundant external knowledge under capacity constraint, we propose equipping response generation defined by a pre-trained language model with…

Computation and Language · Computer Science 2020-10-20 Xueliang Zhao , Wei Wu , Can Xu , Chongyang Tao , Dongyan Zhao , Rui Yan

Scarcity of training data for task-oriented dialogue systems is a well known problem that is usually tackled with costly and time-consuming manual data annotation. An alternative solution is to rely on automatic text generation which,…

Computation and Language · Computer Science 2020-11-05 Stéphane d'Ascoli , Alice Coucke , Francesco Caltagirone , Alexandre Caulier , Marc Lelarge

Current works in the generation of personalized dialogue primarily contribute to the agent presenting a consistent personality and driving a more informative response. However, we found that the generated responses from most previous models…

Computation and Language · Computer Science 2022-08-23 Itsugun Cho , Dongyang Wang , Ryota Takahashi , Hiroaki Saito

Towards human-like dialogue systems, current emotional dialogue approaches jointly model emotion and semantics with a unified neural network. This strategy tends to generate safe responses due to the mutual restriction between emotion and…

Computation and Language · Computer Science 2024-10-02 Yushan Qian , Bo Wang , Shangzhao Ma , Wu Bin , Shuo Zhang , Dongming Zhao , Kun Huang , Yuexian Hou

Speaker recognition, recognizing speaker identities based on voice alone, enables important downstream applications, such as personalization and authentication. Learning speaker representations, in the context of supervised learning,…

Machine Learning · Computer Science 2022-07-13 Metehan Cekic , Ruirui Li , Zeya Chen , Yuguang Yang , Andreas Stolcke , Upamanyu Madhow

Recent advances in deep neural networks, language modeling and language generation have introduced new ideas to the field of conversational agents. As a result, deep neural models such as sequence-to-sequence, Memory Networks, and the…

Computation and Language · Computer Science 2019-02-27 Momchil Hardalov , Ivan Koychev , Preslav Nakov

Real human conversation data are complicated, heterogeneous, and noisy, from which building open-domain dialogue systems remains a challenging task. In fact, such dialogue data still contains a wealth of information and knowledge, however,…

Computation and Language · Computer Science 2022-09-16 Yihe Wang , Yitong Li , Yasheng Wang , Fei Mi , Pingyi Zhou , Xin Wang , Jin Liu , Xin Jiang , Qun Liu

In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. Dialogue systems are increasingly being designed to move beyond just imitating conversation and also…

Computation and Language · Computer Science 2021-11-03 Atharv Singh Patlan , Shiven Tripathi , Shubham Korde

The long-standing one-to-many issue of the open-domain dialogues poses significant challenges for automatic evaluation methods, i.e., there may be multiple suitable responses which differ in semantics for a given conversational context. To…

Computation and Language · Computer Science 2023-06-13 Kun Zhao , Bohao Yang , Chenghua Lin , Wenge Rong , Aline Villavicencio , Xiaohui Cui

Current dialogue summarization systems usually encode the text with a number of general semantic features (e.g., keywords and topics) to gain more powerful dialogue modeling capabilities. However, these features are obtained via open-domain…

Computation and Language · Computer Science 2021-05-31 Xiachong Feng , Xiaocheng Feng , Libo Qin , Bing Qin , Ting Liu