English
Related papers

Related papers: Latent Variable Dialogue Models and their Diversit…

200 papers

Linguistic pragmatics state that a conversation's underlying speech acts can constrain the type of response which is appropriate at each turn in the conversation. When generating dialogue responses, neural dialogue agents struggle to…

Computation and Language · Computer Science 2023-04-07 Katherine Stasaski , Marti A. Hearst

To engage human users in meaningful conversation, open-domain dialogue agents are required to generate diverse and contextually coherent dialogue. Despite recent advancements, which can be attributed to the usage of pretrained language…

Computation and Language · Computer Science 2023-11-21 Jing Yang Lee , Kong Aik Lee , Woon-Seng Gan

Generating relevant responses in a dialog is challenging, and requires not only proper modeling of context in the conversation but also being able to generate fluent sentences during inference. In this paper, we propose a two-step framework…

Computation and Language · Computer Science 2020-11-04 Kashif Khan , Gaurav Sahu , Vikash Balasubramanian , Lili Mou , Olga Vechtomova

Many sequence-to-sequence dialogue models tend to generate safe, uninformative responses. There have been various useful efforts on trying to eliminate them. However, these approaches either improve decoding algorithms during inference,…

Computation and Language · Computer Science 2020-01-16 Tong Niu , Mohit Bansal

Variational encoder-decoders (VEDs) have shown promising results in dialogue generation. However, the latent variable distributions are usually approximated by a much simpler model than the powerful RNN structure used for encoding and…

Computation and Language · Computer Science 2018-02-07 Xiaoyu Shen , Hui Su , Shuzi Niu , Vera Demberg

Latent variable models have been a preferred choice in conversational modeling compared to sequence-to-sequence (seq2seq) models which tend to generate generic and repetitive responses. Despite so, training latent variable models remains to…

Computation and Language · Computer Science 2018-09-20 Tsung-Hsien Wen , Minh-Thang Luong

End-to-End intelligent neural dialogue systems suffer from the problems of generating inconsistent and repetitive responses. Existing dialogue models pay attention to unilaterally incorporating personal knowledge into the dialog while…

Computation and Language · Computer Science 2021-07-19 Yajing Sun , Yue Hu , Luxi Xing , Yuqiang Xie , Xiangpeng Wei

We present a novel natural language generation system for spoken dialogue systems capable of entraining (adapting) to users' way of speaking, providing contextually appropriate responses. The generator is based on recurrent neural networks…

Computation and Language · Computer Science 2017-09-18 Ondřej Dušek , Filip Jurčíček

Neural language models often fail to generate diverse and informative texts, limiting their applicability in real-world problems. While previous approaches have proposed to address these issues by identifying and penalizing undesirable…

Computation and Language · Computer Science 2023-09-25 Jimin Hong , ChaeHun Park , Jaegul Choo

Being able to generate informative and coherent dialogue responses is crucial when designing human-like open-domain dialogue systems. Encoder-decoder-based dialogue models tend to produce generic and dull responses during the decoding step…

Computation and Language · Computer Science 2021-05-04 Ziming Li , Julia Kiseleva , Maarten de Rijke

Discourse coherence is strongly associated with text quality, making it important to natural language generation and understanding. Yet existing models of coherence focus on measuring individual aspects of coherence (lexical overlap,…

Computation and Language · Computer Science 2017-09-26 Jiwei Li , Dan Jurafsky

Despite the recent advances in applying pre-trained language models to generate high-quality texts, generating long passages that maintain long-range coherence is yet challenging for these models. In this paper, we propose DiscoDVT, a…

Computation and Language · Computer Science 2021-10-13 Haozhe Ji , Minlie Huang

The personalized dialogue explores the consistent relationship between dialogue generation and personality. Existing personalized dialogue agents model persona profiles from three resources: sparse or dense persona descriptions and dialogue…

Computation and Language · Computer Science 2023-05-22 Yihong Tang , Bo Wang , Miao Fang , Dongming Zhao , Kun Huang , Ruifang He , Yuexian Hou

We consider multi-solution optimization and generative models for the generation of diverse artifacts and the discovery of novel solutions. In cases where the domain's factors of variation are unknown or too complex to encode manually,…

Machine Learning · Computer Science 2021-05-11 Alexander Hagg , Sebastian Berns , Alexander Asteroth , Simon Colton , Thomas Bäck

Deep generative models have been wildly successful at learning coherent latent representations for continuous data such as video and audio. However, generative modeling of discrete data such as arithmetic expressions and molecular…

Machine Learning · Statistics 2017-03-07 Matt J. Kusner , Brooks Paige , José Miguel Hernández-Lobato

Open-domain conversation models have become good at generating natural-sounding dialogue, using very large architectures with billions of trainable parameters. The vast training data required to train these architectures aggregates many…

Computation and Language · Computer Science 2020-09-24 Eric Michael Smith , Diana Gonzalez-Rico , Emily Dinan , Y-Lan Boureau

We study knowledge-grounded dialogue generation with pre-trained language models. To leverage the redundant external knowledge under capacity constraint, we propose equipping response generation defined by a pre-trained language model with…

Computation and Language · Computer Science 2020-10-20 Xueliang Zhao , Wei Wu , Can Xu , Chongyang Tao , Dongyan Zhao , Rui Yan

Large language models increasingly rely on explicit reasoning chains and can produce multiple plausible responses for a given context. We study the candidate sampler that produces the set of plausible responses contrasting the ancestral…

Computation and Language · Computer Science 2025-09-23 Sergey Troshin , Irina Saparina , Antske Fokkens , Vlad Niculae

Statistical spoken dialogue systems usually rely on a single- or multi-domain dialogue model that is restricted in its capabilities of modelling complex dialogue structures, e.g., relations. In this work, we propose a novel dialogue model…

Computation and Language · Computer Science 2019-01-09 Stefan Ultes , Paweł\ Budzianowski , Iñigo Casanueva , Lina Rojas-Barahona , Bo-Hsiang Tseng , Yen-Chen Wu , Steve Young , Milica Gašić

In dialog studies, we often encode a dialog using a hierarchical encoder where each utterance is converted into an utterance vector, and then a sequence of utterance vectors is converted into a dialog vector. Since knowing who produced…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-15 Tianyu Zhao , Tatsuya Kawahara