English
Related papers

Related papers: Why are Sequence-to-Sequence Models So Dull? Under…

200 papers

Neural network-based sequence-to-sequence (seq2seq) models strongly suffer from the low-diversity problem when it comes to open-domain dialogue generation. As bland and generic utterances usually dominate the frequency distribution in our…

Computation and Language · Computer Science 2020-05-14 Hui Su , Xiaoyu Shen , Sanqiang Zhao , Xiao Zhou , Pengwei Hu , Randy Zhong , Cheng Niu , Jie Zhou

Sequence-to-Sequence (Seq2Seq) models have achieved encouraging performance on the dialogue response generation task. However, existing Seq2Seq-based response generation methods suffer from a low-diversity problem: they frequently generate…

Information Retrieval · Computer Science 2019-02-26 Shaojie Jiang , Pengjie Ren , Christof Monz , Maarten de Rijke

We present our work on Track 2 in the Dialog System Technology Challenges 7 (DSTC7). The DSTC7-Track 2 aims to evaluate the response generation of fully data-driven conversation models in knowledge-grounded settings, which provides the…

Computation and Language · Computer Science 2019-02-01 Yu-Ping Ruan , Zhen-Hua Ling , Quan Liu , Jia-Chen Gu , Xiaodan Zhu

Sequence-to-sequence models have been applied to the conversation response generation problem where the source sequence is the conversation history and the target sequence is the response. Unlike translation, conversation responding is…

Computation and Language · Computer Science 2017-08-01 Louis Shao , Stephan Gouws , Denny Britz , Anna Goldie , Brian Strope , Ray Kurzweil

Sequence-to-Sequence (seq2seq) models have become overwhelmingly popular in building end-to-end trainable dialogue systems. Though highly efficient in learning the backbone of human-computer communications, they suffer from the problem of…

Computation and Language · Computer Science 2018-10-09 Hui Su , Xiaoyu Shen , Wenjie Li , Dietrich Klakow

We consider incorporating topic information into the sequence-to-sequence framework to generate informative and interesting responses for chatbots. To this end, we propose a topic aware sequence-to-sequence (TA-Seq2Seq) model. The model…

Computation and Language · Computer Science 2016-09-20 Chen Xing , Wei Wu , Yu Wu , Jie Liu , Yalou Huang , Ming Zhou , Wei-Ying Ma

Stylistic variation is critical to render the utterances generated by conversational agents natural and engaging. In this paper, we focus on sequence-to-sequence models for open-domain dialogue response generation and propose a new method…

Computation and Language · Computer Science 2018-10-02 Yujie Xing , Raquel Fernández

Although pre-trained sequence-to-sequence models have achieved great success in dialogue response generation, chatbots still suffer from generating inconsistent responses in real-world practice, especially in multi-turn settings. We argue…

Computation and Language · Computer Science 2022-03-08 Leyang Cui , Fandong Meng , Yijin Liu , Jie Zhou , Yue Zhang

We study the problem of generating interesting endings for stories. Neural generative models have shown promising results for various text generation problems. Sequence to Sequence (Seq2Seq) models are typically trained to generate a single…

Machine Learning · Computer Science 2019-07-22 Prakhar Gupta , Vinayshekhar Bannihatti Kumar , Mukul Bhutani , Alan W Black

In this work we explore a deep learning-based dialogue system that generates sarcastic and humorous responses from a conversation design perspective. We trained a seq2seq model on a carefully curated dataset of 3000 question-answering…

Computation and Language · Computer Science 2019-09-23 Suzana Ilić , Reiichiro Nakano , Ivo Hajnal

Researchers have recently started investigating deep neural networks for dialogue applications. In particular, generative sequence-to-sequence (Seq2Seq) models have shown promising results for unstructured tasks, such as word-level dialogue…

Computation and Language · Computer Science 2016-11-21 Iulian Vlad Serban , Ryan Lowe , Laurent Charlin , Joelle Pineau

Many sequence-to-sequence dialogue models tend to generate safe, uninformative responses. There have been various useful efforts on trying to eliminate them. However, these approaches either improve decoding algorithms during inference,…

Computation and Language · Computer Science 2020-01-16 Tong Niu , Mohit Bansal

Conventional seq2seq chatbot models only try to find the sentences with the highest probabilities conditioned on the input sequences, without considering the sentiment of the output sentences. Some research works trying to modify the…

Computation and Language · Computer Science 2018-04-10 Chih-Wei Lee , Yau-Shian Wang , Tsung-Yuan Hsu , Kuan-Yu Chen , Hung-Yi Lee , Lin-shan Lee

Generative models have long been the dominant approach for speech recognition. The success of these models however relies on the use of sophisticated recipes and complicated machinery that is not easily accessible to non-practitioners.…

Computation and Language · Computer Science 2017-06-21 Chung-Cheng Chiu , Dieterich Lawson , Yuping Luo , George Tucker , Kevin Swersky , Ilya Sutskever , Navdeep Jaitly

Language models have demonstrated remarkable capabilities on standard benchmarks, yet they struggle increasingly from mode collapse, the inability to generate diverse and novel outputs. Our work introduces NoveltyBench, a benchmark…

Computation and Language · Computer Science 2025-08-12 Yiming Zhang , Harshita Diddee , Susan Holm , Hanchen Liu , Xinyue Liu , Vinay Samuel , Barry Wang , Daphne Ippolito

A chatbot is an intelligent software application that automates conversations and engages users in natural language through messaging platforms. Leveraging artificial intelligence (AI), chatbots serve various functions, including customer…

Computation and Language · Computer Science 2025-01-03 Lamya Benaddi , Charaf Ouaddi , Adnane Souha , Abdeslam Jakimi , Mohamed Rahouti , Mohammed Aledhari , Diogo Oliveira , Brahim Ouchao

Sentence simplification is the task of rewriting texts so they are easier to understand. Recent research has applied sequence-to-sequence (Seq2Seq) models to this task, focusing largely on training-time improvements via reinforcement…

Computation and Language · Computer Science 2019-04-08 Reno Kriz , João Sedoc , Marianna Apidianaki , Carolina Zheng , Gaurav Kumar , Eleni Miltsakaki , Chris Callison-Burch

Recently, open-domain dialogue systems have attracted growing attention. Most of them use the sequence-to-sequence (Seq2Seq) architecture to generate responses. However, traditional Seq2Seq-based open-domain dialogue models tend to generate…

Computation and Language · Computer Science 2020-07-06 Heng-Da Xu , Xian-Ling Mao , Zewen Chi , Jing-Jing Zhu , Fanshu Sun , Heyan Huang

This work proposes a novel approach based on sequence-to-sequence (seq2seq) models for context-aware conversational systems. Exist- ing seq2seq models have been shown to be good for generating natural responses in a data-driven…

Computation and Language · Computer Science 2018-05-23 Silje Christensen , Simen Johnsrud , Massimiliano Ruocco , Heri Ramampiaro

Sequence generation models for dialogue are known to have several problems: they tend to produce short, generic sentences that are uninformative and unengaging. Retrieval models on the other hand can surface interesting responses, but are…

Computation and Language · Computer Science 2018-09-07 Jason Weston , Emily Dinan , Alexander H. Miller
‹ Prev 1 2 3 10 Next ›