English
Related papers

Related papers: Neural Response Generation with Dynamic Vocabulari…

200 papers

Unlike autoregressive language models, which terminate variable-length generation upon predicting an End-of-Sequence (EoS) token, Diffusion Language Models (DLMs) operate over a fixed maximum-length context window for a predetermined number…

Computation and Language · Computer Science 2026-03-09 Vittorio Rossi , Giacomo Cirò , Davide Beltrame , Luca Gandolfi , Paul Röttger , Dirk Hovy

Neural network-based sequence-to-sequence (seq2seq) models strongly suffer from the low-diversity problem when it comes to open-domain dialogue generation. As bland and generic utterances usually dominate the frequency distribution in our…

Computation and Language · Computer Science 2020-05-14 Hui Su , Xiaoyu Shen , Sanqiang Zhao , Xiao Zhou , Pengwei Hu , Randy Zhong , Cheng Niu , Jie Zhou

Recent progress on neural approaches for language processing has triggered a resurgence of interest on building intelligent open-domain chatbots. However, even the state-of-the-art neural chatbots cannot produce satisfying responses for…

Computation and Language · Computer Science 2022-08-10 Behnam Hedayatnia , Di Jin , Yang Liu , Dilek Hakkani-Tur

Recent advances in neural sequence-to-sequence models have led to promising results for several language generation-based tasks, including dialogue response generation, summarization, and machine translation. However, these models are known…

Computation and Language · Computer Science 2019-08-29 Semih Yavuz , Abhinav Rastogi , Guan-Lin Chao , Dilek Hakkani-Tur

Neural conversation systems generate responses based on the sequence-to-sequence (SEQ2SEQ) paradigm. Typically, the model is equipped with a single set of learned parameters to generate responses for given input contexts. When confronting…

Computation and Language · Computer Science 2020-01-22 Hengyi Cai , Hongshen Chen , Cheng Zhang , Yonghao Song , Xiaofang Zhao , Dawei Yin

Knowledge-aided dialogue response generation aims at augmenting chatbots with relevant external knowledge in the hope of generating more informative responses. The majority of previous work assumes that the relevant knowledge is given as…

Computation and Language · Computer Science 2023-02-21 Ante Wang , Linfeng Song , Qi Liu , Haitao Mi , Longyue Wang , Zhaopeng Tu , Jinsong Su , Dong Yu

Fact-based dialogue generation is a task of generating a human-like response based on both dialogue context and factual texts. Various methods were proposed to focus on generating informative words that contain facts effectively. However,…

Computation and Language · Computer Science 2020-05-11 Ryota Tanaka , Akinobu Lee

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

Computation and Language · Computer Science 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke

Conversational agents have become an integral part of the general population for simple task enabling situations. However, these systems are yet to have any social impact on the diverse and minority population, for example, helping people…

Computation and Language · Computer Science 2021-12-07 Shachi H Kumar , Hsuan Su , Ramesh Manuvinakurike , Saurav Sahay , Lama Nachman

We consider incorporating topic information into the sequence-to-sequence framework to generate informative and interesting responses for chatbots. To this end, we propose a topic aware sequence-to-sequence (TA-Seq2Seq) model. The model…

Computation and Language · Computer Science 2016-09-20 Chen Xing , Wei Wu , Yu Wu , Jie Liu , Yalou Huang , Ming Zhou , Wei-Ying Ma

We apply sequence-to-sequence model to mitigate the impact of speech recognition errors on open domain end-to-end dialog generation. We cast the task as a domain adaptation problem where ASR transcriptions and original text are in two…

Computation and Language · Computer Science 2017-12-05 Pin-Jung Chen , I-Hung Hsu , Yi-Yao Huang , Hung-Yi Lee

Pre-training models have been proved effective for a wide range of natural language processing tasks. Inspired by this, we propose a novel dialogue generation pre-training framework to support various kinds of conversations, including…

Computation and Language · Computer Science 2020-05-01 Siqi Bao , Huang He , Fan Wang , Hua Wu , Haifeng Wang

The timings of spoken response offsets in human dialogue have been shown to vary based on contextual elements of the dialogue. We propose neural models that simulate the distributions of these response offsets, taking into account the…

Computation and Language · Computer Science 2020-05-20 Matthew Roddy , Naomi Harte

For dialogue response generation, traditional generative models generate responses solely from input queries. Such models rely on insufficient information for generating a specific response since a certain query could be answered in…

Computation and Language · Computer Science 2020-03-02 Deng Cai , Yan Wang , Victoria Bi , Zhaopeng Tu , Xiaojiang Liu , Wai Lam , Shuming Shi

Generating responses that are consistent with the dialogue context is one of the central challenges in building engaging conversational agents. We demonstrate that neural conversation models can be geared towards generating consistent…

Computation and Language · Computer Science 2021-08-13 Yizhe Zhang , Xiang Gao , Sungjin Lee , Chris Brockett , Michel Galley , Jianfeng Gao , Bill Dolan

We present a novel response generation system that can be trained end to end on large quantities of unstructured Twitter conversations. A neural network architecture is used to address sparsity issues that arise when integrating contextual…

Computation and Language · Computer Science 2015-06-23 Alessandro Sordoni , Michel Galley , Michael Auli , Chris Brockett , Yangfeng Ji , Margaret Mitchell , Jian-Yun Nie , Jianfeng Gao , Bill Dolan

We present a novel natural language generation system for spoken dialogue systems capable of entraining (adapting) to users' way of speaking, providing contextually appropriate responses. The generator is based on recurrent neural networks…

Computation and Language · Computer Science 2017-09-18 Ondřej Dušek , Filip Jurčíček

Responsing with image has been recognized as an important capability for an intelligent conversational agent. Yet existing works only focus on exploring the multimodal dialogue models which depend on retrieval-based methods, but neglecting…

Computation and Language · Computer Science 2022-03-30 Qingfeng Sun , Yujing Wang , Can Xu , Kai Zheng , Yaming Yang , Huang Hu , Fei Xu , Jessica Zhang , Xiubo Geng , Daxin Jiang

Dialog response generation in open domain is an important research topic where the main challenge is to generate relevant and diverse responses. In this paper, we propose a new dialog pre-training framework called DialogVED, which…

Computation and Language · Computer Science 2022-11-01 Wei Chen , Yeyun Gong , Song Wang , Bolun Yao , Weizhen Qi , Zhongyu Wei , Xiaowu Hu , Bartuer Zhou , Yi Mao , Weizhu Chen , Biao Cheng , Nan Duan

Real human conversation data are complicated, heterogeneous, and noisy, from which building open-domain dialogue systems remains a challenging task. In fact, such dialogue data still contains a wealth of information and knowledge, however,…

Computation and Language · Computer Science 2022-09-16 Yihe Wang , Yitong Li , Yasheng Wang , Fei Mi , Pingyi Zhou , Xin Wang , Jin Liu , Xin Jiang , Qun Liu