English
Related papers

Related papers: Classification As Decoder: Trading Flexibility For…

200 papers

Neural network models are capable of generating extremely natural sounding conversational interactions. Nevertheless, these models have yet to demonstrate that they can incorporate content in the form of factual information or…

Computation and Language · Computer Science 2018-11-19 Marjan Ghazvininejad , Chris Brockett , Ming-Wei Chang , Bill Dolan , Jianfeng Gao , Wen-tau Yih , Michel Galley

Dialogue systems pretrained with large language models generate locally coherent responses, but lack the fine-grained control over responses necessary to achieve specific goals. A promising method to control response generation is…

Computation and Language · Computer Science 2021-03-26 Prakhar Gupta , Jeffrey P. Bigham , Yulia Tsvetkov , Amy Pavel

Generative models have gained more and more attention in recent years for their remarkable success in tasks that required estimating and sampling data distribution to generate high-fidelity synthetic data. In speech, text-to-speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-27 Alexander H. Liu , Matt Le , Apoorv Vyas , Bowen Shi , Andros Tjandra , Wei-Ning Hsu

Neural network-based Open-ended conversational agents automatically generate responses based on predictive models learned from a large number of pairs of utterances. The generated responses are typically acceptable as a sentence but are…

Computation and Language · Computer Science 2019-05-16 Chenyang Huang , Osmar R. Zaïane

Pre-trained models have proved to be powerful in enhancing task-oriented dialog systems. However, current pre-training methods mainly focus on enhancing dialog understanding and generation tasks while neglecting the exploitation of dialog…

Computation and Language · Computer Science 2022-03-30 Wanwei He , Yinpei Dai , Yinhe Zheng , Yuchuan Wu , Zheng Cao , Dermot Liu , Peng Jiang , Min Yang , Fei Huang , Luo Si , Jian Sun , Yongbin Li

Recent approaches to question generation have used modifications to a Seq2Seq architecture inspired by advances in machine translation. Models are trained using teacher forcing to optimise only the one-step-ahead prediction. However, at…

Computation and Language · Computer Science 2019-06-04 Tom Hosking , Sebastian Riedel

The task of predicting dialog acts (DA) based on conversational dialog is a key component in the development of conversational agents. Accurately predicting DAs requires a precise modeling of both the conversation and the global tag…

Computation and Language · Computer Science 2020-02-27 Pierre Colombo , Emile Chapuis , Matteo Manica , Emmanuel Vignon , Giovanna Varni , Chloe Clavel

Neural conversation systems generate responses based on the sequence-to-sequence (SEQ2SEQ) paradigm. Typically, the model is equipped with a single set of learned parameters to generate responses for given input contexts. When confronting…

Computation and Language · Computer Science 2020-01-22 Hengyi Cai , Hongshen Chen , Cheng Zhang , Yonghao Song , Xiaofang Zhao , Dawei Yin

Existing open-domain dialogue generation models are usually trained to mimic the gold response in the training set using cross-entropy loss on the vocabulary. However, a good response does not need to resemble the gold response, since there…

Computation and Language · Computer Science 2020-10-06 Wei-Jen Ko , Avik Ray , Yilin Shen , Hongxia Jin

Inspired by recent work in meta-learning and generative teaching networks, we propose a framework called Generative Conversational Networks, in which conversational agents learn to generate their own labelled training data (given some seed…

Computation and Language · Computer Science 2021-07-20 Alexandros Papangelis , Karthik Gopalakrishnan , Aishwarya Padmakumar , Seokhwan Kim , Gokhan Tur , Dilek Hakkani-Tur

While recent neural encoder-decoder models have shown great promise in modeling open-domain conversations, they often generate dull and generic responses. Unlike past work that has focused on diversifying the output of the decoder at…

Computation and Language · Computer Science 2017-10-24 Tiancheng Zhao , Ran Zhao , Maxine Eskenazi

Neural question generation (NQG) is the task of generating a question from a given passage with deep neural networks. Previous NQG models suffer from a problem that a significant proportion of the generated questions include words in the…

Computation and Language · Computer Science 2018-11-20 Yanghoon Kim , Hwanhee Lee , Joongbo Shin , Kyomin Jung

The task of predicting dialog acts (DA) based on conversational dialog is a key component in the development of conversational agents. Accurately predicting DAs requires a precise modeling of both the conversation and the global tag…

Computation and Language · Computer Science 2020-02-27 Pierre Colombo , Emile Chapuis , Matteo Manica , Emmanuel Vignon , Giovanna Varni , Chloe Clavel

Sequential data often possesses a hierarchical structure with complex dependencies between subsequences, such as found between the utterances in a dialogue. In an effort to model this kind of generative process, we propose a neural…

Computation and Language · Computer Science 2016-06-15 Iulian Vlad Serban , Alessandro Sordoni , Ryan Lowe , Laurent Charlin , Joelle Pineau , Aaron Courville , Yoshua Bengio

Scarcity of training data for task-oriented dialogue systems is a well known problem that is usually tackled with costly and time-consuming manual data annotation. An alternative solution is to rely on automatic text generation which,…

Computation and Language · Computer Science 2020-11-05 Stéphane d'Ascoli , Alice Coucke , Francesco Caltagirone , Alexandre Caulier , Marc Lelarge

We study knowledge-grounded dialogue generation with pre-trained language models. To leverage the redundant external knowledge under capacity constraint, we propose equipping response generation defined by a pre-trained language model with…

Computation and Language · Computer Science 2020-10-20 Xueliang Zhao , Wei Wu , Can Xu , Chongyang Tao , Dongyan Zhao , Rui Yan

This paper presents a new adversarial learning method for generative conversational agents (GCA) besides a new model of GCA. Similar to previous works on adversarial learning for dialogue generation, our method assumes the GCA as a…

Computation and Language · Computer Science 2018-01-10 Oswaldo Ludwig

This work proposes a novel approach based on sequence-to-sequence (seq2seq) models for context-aware conversational systems. Exist- ing seq2seq models have been shown to be good for generating natural responses in a data-driven…

Computation and Language · Computer Science 2018-05-23 Silje Christensen , Simen Johnsrud , Massimiliano Ruocco , Heri Ramampiaro

In open-domain conversational systems, it is important but challenging to leverage background knowledge. We can use the incorporation of knowledge to make the generation of dialogue controllable, and can generate more diverse sentences that…

Artificial Intelligence · Computer Science 2021-05-06 Cheng Luo , Dayiheng Liu , Chanjuan Li , Li Lu , Jiancheng Lv

Responses in task-oriented dialogue systems often realize multiple propositions whose ultimate form depends on the use of sentence planning and discourse structuring operations. For example a recommendation may consist of an explicitly…

Computation and Language · Computer Science 2018-11-05 Lena Reed , Shereen Oraby , Marilyn Walker