English
Related papers

Related papers: Variational Transformers for Diverse Response Gene…

200 papers

The generation of personalized dialogue is vital to natural and human-like conversation. Typically, personalized dialogue generation models involve conditioning the generated response on the dialogue history and a representation of the…

Computation and Language · Computer Science 2021-11-23 Jing Yang Lee , Kong Aik Lee , Woon Seng Gan

GPT-2 has been frequently adapted in story generation models as it provides powerful generative capability. However, it still fails to generate consistent stories and lacks diversity. Current story generation models leverage additional…

Computation and Language · Computer Science 2021-11-17 Zhuohan Xie , Trevor Cohn , Jey Han Lau

Variational autoencoders (VAE) combined with hierarchical RNNs have emerged as a powerful framework for conversation modeling. However, they suffer from the notorious degeneration problem, where the decoders learn to ignore latent variables…

Computation and Language · Computer Science 2018-04-13 Yookoon Park , Jaemin Cho , Gunhee Kim

The recurrent neural networks (RNN) with richly distributed internal states and flexible non-linear transition functions, have overtaken the dynamic Bayesian networks such as the hidden Markov models (HMMs) in the task of modeling highly…

Machine Learning · Computer Science 2021-08-11 Jin Huang , Ming Xiao

End-to-end dialogue generation has achieved promising results without using handcrafted features and attributes specific for each task and corpus. However, one of the fatal drawbacks in such approaches is that they are unable to generate…

Computation and Language · Computer Science 2019-03-26 Hao-Tong Ye , Kai-Ling Lo , Shang-Yu Su , Yun-Nung Chen

Variational autoencoder is a powerful deep generative model with variational inference. The practice of modeling latent variables in the VAE's original formulation as normal distributions with a diagonal covariance matrix limits the…

Machine Learning · Computer Science 2019-03-11 Sarin Chandy , Amin Rasekh

Recent deep learning models have shown improving results to natural language generation (NLG) irrespective of providing sufficient annotated data. However, a modest training data may harm such models performance. Thus, how to build a…

Computation and Language · Computer Science 2018-11-13 Van-Khanh Tran , Le-Minh Nguyen

Knowledge-grounded dialogue is a task of generating an informative response based on both discourse context and external knowledge. As we focus on better modeling the knowledge selection in the multi-turn knowledge-grounded dialogue, we…

Computation and Language · Computer Science 2020-06-17 Byeongchang Kim , Jaewoo Ahn , Gunhee Kim

We present a dialogue generation model that directly captures the variability in possible responses to a given input, which reduces the `boring output' issue of deterministic dialogue models. Experiments show that our model generates more…

Computation and Language · Computer Science 2017-02-21 Kris Cao , Stephen Clark

Latent variable models have been a preferred choice in conversational modeling compared to sequence-to-sequence (seq2seq) models which tend to generate generic and repetitive responses. Despite so, training latent variable models remains to…

Computation and Language · Computer Science 2018-09-20 Tsung-Hsien Wen , Minh-Thang Luong

Developing Video-Grounded Dialogue Systems (VGDS), where a dialogue is conducted based on visual and audio aspects of a given video, is significantly more challenging than traditional image or text-grounded dialogue systems because (1)…

Computation and Language · Computer Science 2020-02-26 Hung Le , Doyen Sahoo , Nancy F. Chen , Steven C. H. Hoi

Predicting customers' long-term revenue from sparse and irregular transaction data is central to marketing resource allocation in non-contractual settings, yet existing approaches face a trade-off. Traditional probabilistic customer base…

Machine Learning · Statistics 2026-04-27 Jeffrey Näf , Riana Valera Mbelson , Markus Meierer

Tabular data remains a challenging domain for generative models. In particular, the standard Variational Autoencoder (VAE) architecture, typically composed of multilayer perceptrons, struggles to model relationships between features,…

Machine Learning · Computer Science 2026-01-29 Aníbal Silva , Moisés Santos , André Restivo , Carlos Soares

Posterior collapse plagues VAEs for text, especially for conditional text generation with strong autoregressive decoders. In this work, we address this problem in variational neural machine translation by explicitly promoting mutual…

Computation and Language · Computer Science 2019-09-23 Arya D. McCarthy , Xian Li , Jiatao Gu , Ning Dong

Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Huajian Fang , Guillaume Carbajal , Stefan Wermter , Timo Gerkmann

Diverse and accurate vision+language modeling is an important goal to retain creative freedom and maintain user engagement. However, adequately capturing the intricacies of diversity in language models is challenging. Recent works commonly…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Jyoti Aneja , Harsh Agrawal , Dhruv Batra , Alexander Schwing

Predicting future frames for a video sequence is a challenging generative modeling task. Promising approaches include probabilistic latent variable models such as the Variational Auto-Encoder. While VAEs can handle uncertainty and model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Lluis Castrejon , Nicolas Ballas , Aaron Courville

Training diffusion models for audiovisual sequences allows for a range of generation tasks by learning conditional distributions of various input-output combinations of the two modalities. Nevertheless, this strategy often requires training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Gwanghyun Kim , Alonso Martinez , Yu-Chuan Su , Brendan Jou , José Lezama , Agrim Gupta , Lijun Yu , Lu Jiang , Aren Jansen , Jacob Walker , Krishna Somandepalli

Visual dialog is a challenging vision-language task, where a dialog agent needs to answer a series of questions through reasoning on the image content and dialog history. Prior work has mostly focused on various attention mechanisms to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yue Wang , Shafiq Joty , Michael R. Lyu , Irwin King , Caiming Xiong , Steven C. H. Hoi

Time series sequence prediction and modelling has proven to be a challenging endeavor in real world datasets. Two key issues are the multi-dimensionality of data and the interaction of independent dimensions forming a latent output signal,…

Machine Learning · Computer Science 2020-10-09 Jakob Aungiers