English
Related papers

Related papers: Why are Sequence-to-Sequence Models So Dull? Under…

200 papers

Generating diverse, interesting responses to chitchat conversations is a problem for neural conversational agents. This paper makes two substantial contributions to improving diversity in dialogue generation. First, we propose a novel…

Computation and Language · Computer Science 2022-05-04 Katherine Stasaski , Marti A. Hearst

While diversity has become a debated issue in design, very little research exists on positive use-cases for diversity beyond scholarly criticism. The current work addresses this gap through the case of a diversity-aware chatbot, exploring…

Human-Computer Interaction · Computer Science 2024-02-14 Peter Kun , Amalia De Götzen , Miriam Bidoglia , Niels Jørgen Gommesen , George Gaskell

Neural conversational models tend to produce generic or safe responses in different contexts, e.g., reply \textit{"Of course"} to narrative statements or \textit{"I don't know"} to questions. In this paper, we propose an end-to-end approach…

Computation and Language · Computer Science 2016-07-21 Kun Xiong , Anqi Cui , Zefeng Zhang , Ming Li

Due to advances in Large Language Models (LLMs) such as ChatGPT, the boundary between human-written text and AI-generated text has become blurred. Nevertheless, recent work has demonstrated that it is possible to reliably detect…

Computation and Language · Computer Science 2025-06-17 Natesh Reddy , Mark Stamp

We present a dialogue generation model that directly captures the variability in possible responses to a given input, which reduces the `boring output' issue of deterministic dialogue models. Experiments show that our model generates more…

Computation and Language · Computer Science 2017-02-21 Kris Cao , Stephen Clark

We propose a method that can leverage unlabeled data to learn a matching model for response selection in retrieval-based chatbots. The method employs a sequence-to-sequence architecture (Seq2Seq) model as a weak annotator to judge the…

Computation and Language · Computer Science 2018-05-11 Yu Wu , Wei Wu , Zhoujun Li , Ming Zhou

The recently proposed Sequence-to-Sequence (seq2seq) framework advocates replacing complex data processing pipelines, such as an entire automatic speech recognition system, with a single neural network trained in an end-to-end fashion. In…

Neural and Evolutionary Computing · Computer Science 2016-12-09 Jan Chorowski , Navdeep Jaitly

Sequence-to-Sequence models were introduced to tackle many real-life problems like machine translation, summarization, image captioning, etc. The standard optimization algorithms are mainly based on example-to-example matching like maximum…

Computation and Language · Computer Science 2018-09-05 Wenhu Chen , Guanlin Li , Shujie Liu , Zhirui Zhang , Mu Li , Ming Zhou

Recently, diffusion models have emerged as a new paradigm for generative models. Despite the success in domains using continuous signals such as vision and audio, adapting diffusion models to natural language is under-explored due to the…

Computation and Language · Computer Science 2023-02-15 Shansan Gong , Mukai Li , Jiangtao Feng , Zhiyong Wu , Lingpeng Kong

Generative seq2seq dialogue systems are trained to predict the next word in dialogues that have already occurred. They can learn from large unlabeled conversation datasets, build a deeper understanding of conversational context, and…

Computation and Language · Computer Science 2019-11-21 Sam Shleifer , Manish Chablani , Anitha Kannan , Namit Katariya , Xavier Amatriain

Using neural networks to generate replies in human-computer dialogue systems is attracting increasing attention over the past few years. However, the performance is not satisfactory: the neural network tends to generate safe, universally…

Computation and Language · Computer Science 2016-10-14 Lili Mou , Yiping Song , Rui Yan , Ge Li , Lu Zhang , Zhi Jin

Previous work in slogan generation focused on utilising slogan skeletons mined from existing slogans. While some generated slogans can be catchy, they are often not coherent with the company's focus or style across their marketing…

Computation and Language · Computer Science 2021-09-08 Yiping Jin , Akshay Bhatia , Dittaya Wanvarie , Phu T. V. Le

Using a sequence-to-sequence framework, many neural conversation models for chit-chat succeed in naturalness of the response. Nevertheless, the neural conversation models tend to give generic responses which are not specific to given…

Computation and Language · Computer Science 2018-05-24 Jonggu Kim , Doyeon Kong , Jong-Hyeok Lee

We first propose a new task named Dialogue Description (Dial2Desc). Unlike other existing dialogue summarization tasks such as meeting summarization, we do not maintain the natural flow of a conversation but describe an object or an action…

Computation and Language · Computer Science 2018-11-02 Haojie Pan , Junpei Zhou , Zhou Zhao , Yan Liu , Deng Cai , Min Yang

Neural conversation models tend to generate safe, generic responses for most inputs. This is due to the limitations of likelihood-based decoding objectives in generation tasks with diverse outputs, such as conversation. To address this…

Computation and Language · Computer Science 2018-09-06 Ashutosh Baheti , Alan Ritter , Jiwei Li , Bill Dolan

We present a comparison of word-based and character-based sequence-to-sequence models for data-to-text natural language generation, which generate natural language descriptions for structured inputs. On the datasets of two recent generation…

Computation and Language · Computer Science 2018-10-12 Glorianna Jagfeld , Sabrina Jenne , Ngoc Thang Vu

Recent years have seen growing interest in conversational agents, such as chatbots, which are a very good fit for automated customer support because the domain in which they need to operate is narrow. This interest was in part inspired by…

Computation and Language · Computer Science 2018-09-05 Momchil Hardalov , Ivan Koychev , Preslav Nakov

End-to-end dialogue generation has achieved promising results without using handcrafted features and attributes specific for each task and corpus. However, one of the fatal drawbacks in such approaches is that they are unable to generate…

Computation and Language · Computer Science 2019-03-26 Hao-Tong Ye , Kai-Ling Lo , Shang-Yu Su , Yun-Nung Chen

Ever since the successful application of sequence to sequence learning for neural machine translation systems, interest has surged in its applicability towards language generation in other problem domains. Recent work has investigated the…

Computation and Language · Computer Science 2017-10-31 Sharath T. S. , Shubhangi Tandon , Ryan Bauer

The sequence-to-sequence (Seq2Seq) model generates target words iteratively given the previously observed words during decoding process, which results in the loss of the holistic semantics in the target response and the complete semantic…

Computation and Language · Computer Science 2020-01-22 Yiru Wang , Pengda Si , Zeyang Lei , Guangxu Xun , Yujiu Yang