English
Related papers

Related papers: Natural Language Generation with Neural Variationa…

200 papers

Variational autoencoders (VAEs) have been widely applied for text modeling. In practice, however, they are troubled by two challenges: information underrepresentation and posterior collapse. The former arises as only the last hidden state…

Machine Learning · Computer Science 2021-06-17 Xianghong Fang , Haoli Bai , Jian Li , Zenglin Xu , Michael Lyu , Irwin King

In this paper, we are interested in audio-visual speech separation given a single-channel audio recording as well as visual information (lips movements) associated with each speaker. We propose an unsupervised technique based on…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-01 Viet-Nhat Nguyen , Mostafa Sadeghi , Elisa Ricci , Xavier Alameda-Pineda

Variational auto-encoders (VAEs) provide an attractive solution to image generation problem. However, they tend to produce blurred and over-smoothed images due to their dependence on pixel-wise reconstruction loss. This paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Salman H. Khan , Munawar Hayat , Nick Barnes

Recent work on generative modeling of text has found that variational auto-encoders (VAE) incorporating LSTM decoders perform worse than simpler LSTM language models (Bowman et al., 2015). This negative result is so far poorly understood,…

Neural and Evolutionary Computing · Computer Science 2017-06-20 Zichao Yang , Zhiting Hu , Ruslan Salakhutdinov , Taylor Berg-Kirkpatrick

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder (DD-VAE) for…

Machine Learning · Computer Science 2020-03-05 Daniil Polykovskiy , Dmitry Vetrov

Learning a generative model from partial data (data with missingness) is a challenging area of machine learning research. We study a specific implementation of the Auto-Encoding Variational Bayes (AEVB) algorithm, named in this paper as a…

Machine Learning · Computer Science 2021-01-05 Amir Zadeh , Yao-Chong Lim , Paul Pu Liang , Louis-Philippe Morency

Variational Autoencoder (VAE) is a powerful method for learning representations of high-dimensional data. However, VAEs can suffer from an issue known as latent variable collapse (or KL loss vanishing), where the posterior collapses to the…

Computation and Language · Computer Science 2019-11-14 Ruizhe Li , Xiao Li , Chenghua Lin , Matthew Collinson , Rui Mao

Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Huajian Fang , Guillaume Carbajal , Stefan Wermter , Timo Gerkmann

Variational Autoencoders (VAEs) are powerful generative models capable of learning compact latent representations. However, conventional VAEs often generate relatively blurry images due to their assumption of an isotropic Gaussian latent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Andrew Kiruluta

While unsupervised variational autoencoders (VAE) have become a powerful tool in neuroimage analysis, their application to supervised learning is under-explored. We aim to close this gap by proposing a unified probabilistic model for…

Machine Learning · Computer Science 2019-07-15 Qingyu Zhao , Ehsan Adeli , Nicolas Honnorat , Tuo Leng , Kilian M. Pohl

Discrete latent variables are considered important for real world data, which has motivated research on Variational Autoencoders (VAEs) with discrete latents. However, standard VAE training is not possible in this case, which has motivated…

Machine Learning · Statistics 2023-03-27 Enrico Guiraud , Jakob Drefs , Jörg Lücke

The encoder-decoder dialog model is one of the most prominent methods used to build dialog systems in complex domains. Yet it is limited because it cannot output interpretable actions as in traditional systems, which hinders humans from…

Computation and Language · Computer Science 2018-04-24 Tiancheng Zhao , Kyusong Lee , Maxine Eskenazi

In principle, applying variational autoencoders (VAEs) to sequential data offers a method for controlled sequence generation, manipulation, and structured representation learning. However, training sequence VAEs is challenging:…

Machine Learning · Computer Science 2022-12-19 Đorđe Miladinović , Kumar Shridhar , Kushal Jain , Max B. Paulus , Joachim M. Buhmann , Mrinmaya Sachan , Carl Allen

In this paper, we propose a variational autoencoder with disentanglement priors, VAE-DPRIOR, for task-specific natural language generation with none or a handful of task-specific labeled examples. In order to tackle compositional…

Computation and Language · Computer Science 2022-11-01 Zhuang Li , Lizhen Qu , Qiongkai Xu , Tongtong Wu , Tianyang Zhan , Gholamreza Haffari

Paraphrase generation is an important problem in NLP, especially in question answering, information retrieval, information extraction, conversation systems, to name a few. In this paper, we address the problem of generating paraphrases…

Computation and Language · Computer Science 2017-09-18 Ankush Gupta , Arvind Agarwal , Prawaan Singh , Piyush Rai

Variational Autoencoders (VAEs), as a form of deep generative model, have been widely used in recent years, and shown great great peformance in a number of different domains, including image generation and anomaly detection, etc.. This…

Machine Learning · Computer Science 2024-08-28 Liang Cheng , Peiyuan Guan , Amir Taherkordi , Lei Liu , Dapeng Lan

In this paper we explore the effect of architectural choices on learning a Variational Autoencoder (VAE) for text generation. In contrast to the previously introduced VAE model for text where both the encoder and decoder are RNNs, we…

Computation and Language · Computer Science 2017-02-09 Stanislau Semeniuta , Aliaksei Severyn , Erhardt Barth

Variational autoencdoers (VAE) are a popular approach to generative modelling. However, exploiting the capabilities of VAEs in practice can be difficult. Recent work on regularised and entropic autoencoders have begun to explore the…

Machine Learning · Computer Science 2022-03-02 Gregory A. Daly , Jonathan E. Fieldsend , Gavin Tabor

Code-switching, the interleaving of two or more languages within a sentence or discourse is pervasive in multilingual societies. Accurate language models for code-switched text are critical for NLP tasks. State-of-the-art data-intensive…

Computation and Language · Computer Science 2019-06-24 Bidisha Samanta , Sharmila Reddy , Hussain Jagirdar , Niloy Ganguly , Soumen Chakrabarti

The variational autoencoder (VAE) framework remains a popular option for training unsupervised generative models, especially for discrete data where generative adversarial networks (GANs) require workaround to create gradient for the…

Machine Learning · Computer Science 2019-04-24 Jason Chou , Gautam Hathi