English
Related papers

Related papers: Understanding and Improving the Exemplar-based Gen…

200 papers

Open-domain conversation models have become good at generating natural-sounding dialogue, using very large architectures with billions of trainable parameters. The vast training data required to train these architectures aggregates many…

Computation and Language · Computer Science 2020-09-24 Eric Michael Smith , Diana Gonzalez-Rico , Emily Dinan , Y-Lan Boureau

In the age of neural natural language processing, there are plenty of works trying to derive interpretations of neural models. Intuitively, when gold rationales exist during training, one can additionally train the model to match its…

Computation and Language · Computer Science 2024-04-03 Zhuo Chen , Chengyue Jiang , Kewei Tu

Practical dialogue systems require robust methods of detecting out-of-scope (OOS) utterances to avoid conversational breakdowns and related failure modes. Directly training a model with labeled OOS examples yields reasonable performance,…

Computation and Language · Computer Science 2021-09-08 Derek Chen , Zhou Yu

Although pre-trained sequence-to-sequence models have achieved great success in dialogue response generation, chatbots still suffer from generating inconsistent responses in real-world practice, especially in multi-turn settings. We argue…

Computation and Language · Computer Science 2022-03-08 Leyang Cui , Fandong Meng , Yijin Liu , Jie Zhou , Yue Zhang

Retrieval-based chatbot selects the appropriate response from candidates according to the context, which heavily depends on a response selection module. A response selection module is generally a scoring model to evaluate candidates and is…

Computation and Language · Computer Science 2021-09-15 Yao Qiu , Jinchao Zhang , Huiying Ren , Jie Zhou

We introduce the Exemplar-Based Expository Text Generation task, aiming to generate an expository text on a new topic using an exemplar on a similar topic. Current methods fall short due to their reliance on extensive exemplar data,…

Computation and Language · Computer Science 2025-05-27 Yuxiang Liu , Kevin Chen-Chuan Chang

Current neural network-based conversational models lack diversity and generate boring responses to open-ended utterances. Priors such as persona, emotion, or topic provide additional information to dialog models to aid response generation,…

Computation and Language · Computer Science 2019-08-05 Richard Csaky , Patrik Purgai , Gabor Recski

Intelligent personal assistant systems that are able to have multi-turn conversations with human users are becoming increasingly popular. Most previous research has been focused on using either retrieval-based or generation-based methods to…

Information Retrieval · Computer Science 2019-08-27 Liu Yang , Junjie Hu , Minghui Qiu , Chen Qu , Jianfeng Gao , W. Bruce Croft , Xiaodong Liu , Yelong Shen , Jingjing Liu

Building open-domain dialogue systems capable of rich human-like conversational ability is one of the fundamental challenges in language generation. However, even with recent advancements in the field, existing open-domain generative models…

Computation and Language · Computer Science 2022-06-14 Ritvik Choudhary , Daisuke Kawahara

Using a sequence-to-sequence framework, many neural conversation models for chit-chat succeed in naturalness of the response. Nevertheless, the neural conversation models tend to give generic responses which are not specific to given…

Computation and Language · Computer Science 2018-05-24 Jonggu Kim , Doyeon Kong , Jong-Hyeok Lee

Pre-trained language models have been successfully used in response generation for open-domain dialogue. Four main frameworks have been proposed: (1) Transformer-ED using Transformer encoder and decoder separately for source and target…

Computation and Language · Computer Science 2020-10-27 Yan Zeng , Jian-Yun Nie

A common recent approach to semantic parsing augments sequence-to-sequence models by retrieving and appending a set of training samples, called exemplars. The effectiveness of this recipe is limited by the ability to retrieve informative…

Computation and Language · Computer Science 2022-09-30 Yury Zemlyanskiy , Michiel de Jong , Joshua Ainslie , Panupong Pasupat , Peter Shaw , Linlu Qiu , Sumit Sanghai , Fei Sha

Generating responses following a desired style has great potentials to extend applications of open-domain dialogue systems, yet is refrained by lacking of parallel data for training. In this work, we explore the challenging task with…

Computation and Language · Computer Science 2020-10-07 Ze Yang , Wei Wu , Can Xu , Xinnian Liang , Jiaqi Bai , Liran Wang , Wei Wang , Zhoujun Li

Conversational recommender systems have attracted immense attention recently. The most recent approaches rely on neural models trained on recorded dialogs between humans, implementing an end-to-end learning process. These systems are…

Information Retrieval · Computer Science 2022-05-26 Ahtsham Manzoor , Dietmar Jannach

Task-oriented conversational modeling with unstructured knowledge access, as track 1 of the 9th Dialogue System Technology Challenges (DSTC 9), requests to build a system to generate response given dialogue history and knowledge access.…

Computation and Language · Computer Science 2020-12-23 Chao-Hong Tan , Xiaoyu Yang , Zi'ou Zheng , Tianda Li , Yufei Feng , Jia-Chen Gu , Quan Liu , Dan Liu , Zhen-Hua Ling , Xiaodan Zhu

Various encoder-decoder models have been applied to response generation in open-domain dialogs, but a majority of conventional models directly learn a mapping from lexical input to lexical output without explicitly modeling intermediate…

Computation and Language · Computer Science 2019-06-27 Tianyu Zhao , Shinsuke Mori , Tatsuya Kawahara

Existing dialog datasets contain a sequence of utterances and responses without any explicit background knowledge associated with them. This has resulted in the development of models which treat conversation as a sequence-to-sequence…

Computation and Language · Computer Science 2018-09-24 Nikita Moghe , Siddhartha Arora , Suman Banerjee , Mitesh M. Khapra

The predominant approach to open-domain dialog generation relies on end-to-end training of neural models on chat datasets. However, this approach provides little insight as to what these models learn (or do not learn) about engaging in…

Computation and Language · Computer Science 2020-08-04 Abdelrhman Saleh , Tovly Deutsch , Stephen Casper , Yonatan Belinkov , Stuart Shieber

End-to-end neural models for intelligent dialogue systems suffer from the problem of generating uninformative responses. Various methods were proposed to generate more informative responses by leveraging external knowledge. However, few…

Computation and Language · Computer Science 2019-05-22 Rongzhong Lian , Min Xie , Fan Wang , Jinhua Peng , Hua Wu

Many text generation systems benefit from using a retriever to retrieve passages from a textual knowledge corpus (e.g., Wikipedia) which are then provided as additional context to the generator. For open-ended generation tasks (like…

Computation and Language · Computer Science 2021-10-22 Ashwin Paranjape , Omar Khattab , Christopher Potts , Matei Zaharia , Christopher D. Manning