English
Related papers

Related papers: Improve Variational Autoencoder for Text Generatio…

200 papers

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

Machine Learning · Computer Science 2022-11-16 Rafael Pastrana

Deep generative models have been enjoying success in modeling continuous data. However it remains challenging to capture the representations for discrete structures with formal grammars and semantics, e.g., computer programs and molecular…

Machine Learning · Computer Science 2018-02-27 Hanjun Dai , Yingtao Tian , Bo Dai , Steven Skiena , Le Song

Recent state-of-the-art autoencoder based generative models have an encoder-decoder structure and learn a latent representation with a pre-defined distribution that can be sampled from. Implementing the encoder networks of these models in a…

Machine Learning · Computer Science 2020-05-11 D. T. Braithwaite , M. O'Connor , W. B. Kleijn

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder (DD-VAE) for…

Machine Learning · Computer Science 2020-03-05 Daniil Polykovskiy , Dmitry Vetrov

The Variational Autoencoder (VAE) has proven to be an effective model for producing semantically meaningful latent representations for natural data. However, it has thus far seen limited application to sequential data, and, as we…

Machine Learning · Computer Science 2019-11-12 Adam Roberts , Jesse Engel , Colin Raffel , Curtis Hawthorne , Douglas Eck

Variational Autoencoders for multimodal data hold promise for many tasks in data analysis, such as representation learning, conditional generation, and imputation. Current architectures either share the encoder output, decoder input, or…

In principle, applying variational autoencoders (VAEs) to sequential data offers a method for controlled sequence generation, manipulation, and structured representation learning. However, training sequence VAEs is challenging:…

Machine Learning · Computer Science 2022-12-19 Đorđe Miladinović , Kumar Shridhar , Kushal Jain , Max B. Paulus , Joachim M. Buhmann , Mrinmaya Sachan , Carl Allen

In this paper, we introduce the Variational Autoencoder (VAE) to an end-to-end speech synthesis model, to learn the latent representation of speaking styles in an unsupervised manner. The style representation learned through VAE shows good…

Computation and Language · Computer Science 2019-02-15 Ya-Jie Zhang , Shifeng Pan , Lei He , Zhen-Hua Ling

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

Machine Learning · Statistics 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell

Variational autoencoders (VAEs) are a standard framework for inducing latent variable models that have been shown effective in learning text representations as well as in text generation. The key challenge with using VAEs is the {\it…

Machine Learning · Computer Science 2020-05-01 Serhii Havrylov , Ivan Titov

Multimodal generative models require a unified approach to handle both discrete data (e.g., text and code) and continuous data (e.g., image, audio, video). In this work, we propose Latent Language Modeling (LatentLM), which seamlessly…

Computation and Language · Computer Science 2024-12-12 Yutao Sun , Hangbo Bao , Wenhui Wang , Zhiliang Peng , Li Dong , Shaohan Huang , Jianyong Wang , Furu Wei

Variational auto-encoders (VAEs) are widely used in natural language generation due to the regularization of the latent space. However, generating sentences from the continuous latent space does not explicitly model the syntactic…

Computation and Language · Computer Science 2019-07-15 Yu Bao , Hao Zhou , Shujian Huang , Lei Li , Lili Mou , Olga Vechtomova , Xinyu Dai , Jiajun Chen

Structuring the latent space in probabilistic deep generative models, e.g., variational autoencoders (VAEs), is important to yield more expressive models and interpretable representations, and to avoid overfitting. One way to achieve this…

Machine Learning · Computer Science 2022-06-20 Mostafa Sadeghi , Paul Magron

After deep generative models were successfully applied to image generation tasks, learning disentangled latent variables of data has become a crucial part of deep generative model research. Many models have been proposed to learn an…

Machine Learning · Computer Science 2019-07-08 Sangchul Hahn , Heeyoul Choi

Latent generative models have emerged as a leading approach for high-quality image synthesis. These models rely on an autoencoder to compress images into a latent space, followed by a generative model to learn the latent distribution. We…

Machine Learning · Computer Science 2025-08-05 Theodoros Kouzelis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Variational autoencoder-based voice conversion (VAE-VC) has the advantage of requiring only pairs of speeches and speaker labels for training. Unlike the majority of the research in VAE-VC which focuses on utilizing auxiliary losses or…

Sound · Computer Science 2021-12-07 Kei Akuzawa , Kotaro Onishi , Keisuke Takiguchi , Kohki Mametani , Koichiro Mori

Variational Autoencoders (VAEs) are powerful generative models that have been widely used in various fields, including image and text generation. However, one of the known challenges in using VAEs is the model's sensitivity to its…

Machine Learning · Computer Science 2024-12-31 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

As a widely recognized approach to deep generative modeling, Variational Auto-Encoders (VAEs) still face challenges with the quality of generated images, often presenting noticeable blurriness. This issue stems from the unrealistic…

Machine Learning · Computer Science 2023-05-22 Georgios Batzolis , Jan Stanczuk , Carola-Bibiane Schönlieb

Variational encoder-decoders (VEDs) have shown promising results in dialogue generation. However, the latent variable distributions are usually approximated by a much simpler model than the powerful RNN structure used for encoding and…

Computation and Language · Computer Science 2018-02-07 Xiaoyu Shen , Hui Su , Shuzi Niu , Vera Demberg

VAEs (Variational AutoEncoders) have proved to be powerful in the context of density modeling and have been used in a variety of contexts for creative purposes. In many settings, the data we model possesses continuous attributes that we…

Machine Learning · Computer Science 2017-07-18 Gaëtan Hadjeres , Frank Nielsen , François Pachet