中文
相关论文

相关论文: Implicit Deep Latent Variable Models for Text Gene…

200 篇论文

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

机器学习 · 统计学 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

机器学习 · 计算机科学 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

Variational autoencoders (VAE) often use Gaussian or category distribution to model the inference process. This puts a limit on variational learning because this simplified assumption does not match the true posterior distribution, which is…

机器学习 · 计算机科学 2017-02-28 Ke Sun , Xiangliang Zhang

Neural conversation models such as encoder-decoder models are easy to generate bland and generic responses. Some researchers propose to use the conditional variational autoencoder(CVAE) which maximizes the lower bound on the conditional…

计算与语言 · 计算机科学 2019-11-25 Jun Gao , Wei Bi , Xiaojiang Liu , Junhui Li , Guodong Zhou , Shuming Shi

The posterior collapse phenomenon in variational autoencoder (VAE), where the variational posterior distribution closely matches the prior distribution, can hinder the quality of the learned latent variables. As a consequence of posterior…

机器学习 · 统计学 2024-05-14 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

机器学习 · 计算机科学 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

Probabilistic Latent Variable Models (LVMs) provide an alternative to self-supervised learning approaches for linguistic representation learning from speech. LVMs admit an intuitive probabilistic interpretation where the latent structure…

音频与语音处理 · 电气工程与系统科学 2020-09-09 Sameer Khurana , Antoine Laurent , Wei-Ning Hsu , Jan Chorowski , Adrian Lancucki , Ricard Marxer , James Glass

In data-driven drug discovery, designing molecular descriptors is a very important task. Deep generative models such as variational autoencoders (VAEs) offer a potential solution by designing descriptors as probabilistic latent vectors…

机器学习 · 计算机科学 2023-08-23 Daiki Koge , Naoaki Ono , Shigehiko Kanaya

Latent representations are the essence of deep generative models and determine their usefulness and power. For latent representations to be useful as generative concept representations, their latent space must support latent space…

机器学习 · 计算机科学 2019-01-01 Daniel T. Chang

We would like to learn latent representations that are low-dimensional and highly interpretable. A model that has these characteristics is the Gaussian Process Latent Variable Model. The benefits and negative of the GP-LVM are complementary…

机器学习 · 统计学 2017-12-19 Erik Bodin , Iman Malik , Carl Henrik Ek , Neill D. F. Campbell

The variational autoencoder (VAE; Kingma, Welling (2014)) is a recently proposed generative model pairing a top-down generative network with a bottom-up recognition network which approximates posterior inference. It typically makes strong…

机器学习 · 计算机科学 2016-11-08 Yuri Burda , Roger Grosse , Ruslan Salakhutdinov

Variational autoencoders (VAEs) hold great potential for modelling text, as they could in theory separate high-level semantic and syntactic properties from local regularities of natural language. Practically, however, VAEs with…

机器学习 · 计算机科学 2020-11-11 Teng Long , Yanshuai Cao , Jackie Chi Kit Cheung

Advances in neural variational inference have facilitated the learning of powerful directed graphical models with continuous latent variables, such as variational autoencoders. The hope is that such models will learn to represent rich,…

计算与语言 · 计算机科学 2017-09-26 Iulian V. Serban , Alexander G. Ororbia , Joelle Pineau , Aaron Courville

Current variational dialog models have employed pre-trained language models (PLMs) to parameterize the likelihood and posterior distributions. However, the Gaussian assumption made on the prior distribution is incompatible with these…

计算与语言 · 计算机科学 2023-10-25 Tianyu Yang , Thy Thy Tran , Iryna Gurevych

In this work we explore deep generative models of text in which the latent representation of a document is itself drawn from a discrete language model distribution. We formulate a variational auto-encoder for inference in this model and…

计算与语言 · 计算机科学 2016-10-17 Yishu Miao , Phil Blunsom

Variational autoencoders (VAEs) are powerful generative models with the salient ability to perform inference. Here, we introduce a quantum variational autoencoder (QVAE): a VAE whose latent generative process is implemented as a quantum…

As a widely recognized approach to deep generative modeling, Variational Auto-Encoders (VAEs) still face challenges with the quality of generated images, often presenting noticeable blurriness. This issue stems from the unrealistic…

机器学习 · 计算机科学 2023-05-22 Georgios Batzolis , Jan Stanczuk , Carola-Bibiane Schönlieb

In this paper, we address the unsupervised speech enhancement problem based on recurrent variational autoencoder (RVAE). This approach offers promising generalization performance over the supervised counterpart. Nevertheless, the involved…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Mostafa Sadeghi , Romain Serizel

Recent language models can generate interesting and grammatically correct text in story generation but often lack plot development and long-term coherence. This paper experiments with a latent vector planning approach based on a TD-VAE…

计算与语言 · 计算机科学 2021-09-15 David Wilmot , Frank Keller

Variational autoencoders (VAEs) combine latent variables with amortized variational inference, whose optimization usually converges into a trivial local optimum termed posterior collapse, especially in text modeling. By tracking the…

计算与语言 · 计算机科学 2020-04-21 Chen Wu , Prince Zizhuang Wang , William Yang Wang