English
Related papers

Related papers: Generated Loss and Augmented Training of MNIST VAE

200 papers

We introduce an improved variational autoencoder (VAE) for text modeling with topic information explicitly modeled as a Dirichlet latent variable. By providing the proposed model topic awareness, it is more superior at reconstructing input…

Computation and Language · Computer Science 2018-11-02 Yijun Xiao , Tiancheng Zhao , William Yang Wang

Deep generative models are attracting great attention as a new promising approach for molecular design. All models reported so far are based on either variational autoencoder (VAE) or generative adversarial network (GAN). Here we propose a…

Chemical Physics · Physics 2019-12-13 Seung Hwan Hong , Jaechang Lim , Seongok Ryu , Woo Youn Kim

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. They balance reconstruction and regularizer terms. A variational approximation produces an evidence…

Machine Learning · Statistics 2023-12-13 Robert I. Cukier

We propose a topic-guided variational autoencoder (TGVAE) model for text generation. Distinct from existing variational autoencoder (VAE) based approaches, which assume a simple Gaussian prior for the latent code, our model specifies the…

Computation and Language · Computer Science 2019-03-19 Wenlin Wang , Zhe Gan , Hongteng Xu , Ruiyi Zhang , Guoyin Wang , Dinghan Shen , Changyou Chen , Lawrence Carin

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

Machine Learning · Computer Science 2024-01-08 Ahmed Salah , David Yevick

Inference for Variational Autoencoders (VAEs) consists of learning two models: (1) a generative model, which transforms a simple distribution over a latent space into the distribution over observed data, and (2) an inference model, which…

Machine Learning · Statistics 2024-06-14 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

Advancing defensive mechanisms against adversarial attacks in generative models is a critical research topic in machine learning. Our study focuses on a specific type of generative models - Variational Auto-Encoders (VAEs). Contrary to…

We introduce a version of a variational auto-encoder (VAE), which can generate good perturbations of images, when trained on a complex dataset (in our experiments, CIFAR-10). The net is using only two latent generative dimensions per class,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Galin Georgiev

Recent work in unsupervised learning has focused on efficient inference and learning in latent variables models. Training these models by maximizing the evidence (marginal likelihood) is typically intractable. Thus, a common approximation…

Machine Learning · Computer Science 2021-02-15 Linh Tran , Maja Pantic , Marc Peter Deisenroth

As deep Variational Auto-Encoder (VAE) frameworks become more widely used for modeling biomolecular simulation data, we emphasize the capability of the VAE architecture to concurrently maximize the timescale of the latent space while…

Chemical Physics · Physics 2021-12-08 Hannah K. Wayment-Steele , Vijay S. Pande

Training deep generative models with maximum likelihood remains a challenge. The typical workaround is to use variational inference (VI) and maximize a lower bound to the log marginal likelihood of the data. Variational auto-encoders (VAEs)…

Machine Learning · Statistics 2019-08-13 Adji B. Dieng , John Paisley

We introduce Exemplar VAEs, a family of generative models that bridge the gap between parametric and non-parametric, exemplar based generative models. Exemplar VAE is a variant of VAE with a non-parametric prior in the latent space based on…

Machine Learning · Computer Science 2020-11-25 Sajad Norouzi , David J. Fleet , Mohammad Norouzi

Variational auto-encoders (VAEs) are deep generative latent variable models that can be used for learning the distribution of complex data. VAEs have been successfully used to learn a probabilistic prior over speech signals, which is then…

Sound · Computer Science 2020-12-18 Mostafa Sadeghi , Simon Leglaive , Xavier Alameda-PIneda , Laurent Girin , Radu Horaud

Variational autoencoders (VAEs) are a popular class of deep generative models with many variants and a wide range of applications. Improvements upon the standard VAE mostly focus on the modelling of the posterior distribution over the…

Machine Learning · Computer Science 2022-11-02 James Langley , Miguel Monteiro , Charles Jones , Nick Pawlowski , Ben Glocker

Deep metric learning has been demonstrated to be highly effective in learning semantic representation and encoding information that can be used to measure data similarity, by relying on the embedding learned from metric learning. At the…

Machine Learning · Statistics 2023-02-09 Haque Ishfaq , Assaf Hoogi , Daniel Rubin

Objective: This paper investigates how generative models, trained on ground-truth images, can be used \changes{as} priors for inverse problems, penalizing reconstructions far from images the generator can produce. The aim is that learned…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Margaret Duff , Ivor J. A. Simpson , Matthias J. Ehrhardt , Neill D. F. Campbell

The variational autoencoder (VAE) is a simple and efficient generative artificial intelligence method for modeling complex probability distributions of various types of data, such as images and texts. However, it suffers some main…

Machine Learning · Computer Science 2025-02-14 Xi Chen , Shaofan Li

Variational autoencoders learn distributions of high-dimensional data. They model data with a deep latent-variable model and then fit the model by maximizing a lower bound of the log marginal likelihood. VAEs can capture complex…

Machine Learning · Statistics 2019-02-01 Adji B. Dieng , Yoon Kim , Alexander M. Rush , David M. Blei

Variational AutoEncoders (VAEs) provide a means to generate representational latent embeddings. Previous research has highlighted the benefits of achieving representations that are disentangled, particularly for downstream tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

Variational autoencoders (VAEs) are essential tools in end-to-end representation learning. However, the sequential text generation common pitfall with VAEs is that the model tends to ignore latent variables with a strong auto-regressive…

Machine Learning · Computer Science 2021-02-26 Yang Zhao , Ping Yu , Suchismit Mahapatra , Qinliang Su , Changyou Chen