English
Related papers

Related papers: Variational Diffusion Autoencoders with Random Wal…

200 papers

Generative models have attracted significant interest due to their ability to handle uncertainty by learning the inherent data distributions. However, two prominent generative models, namely Generative Adversarial Networks (GANs) and…

Machine Learning · Computer Science 2023-04-25 Yu Wang , Zhiwei Liu , Liangwei Yang , Philip S. Yu

We propose Unbalanced GANs, which pre-trains the generator of the generative adversarial network (GAN) using variational autoencoder (VAE). We guarantee the stable training of the generator by preventing the faster convergence of the…

Machine Learning · Computer Science 2020-02-07 Hyungrok Ham , Tae Joon Jun , Daeyoung Kim

In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function…

Machine Learning · Statistics 2021-01-05 Carl Doersch

Generative Adversarial Networks (GANs) can achieve state-of-the-art sample quality in generative modelling tasks but suffer from the mode collapse problem. Variational Autoencoders (VAE) on the other hand explicitly maximize a…

Machine Learning · Computer Science 2019-09-30 Apratim Bhattacharyya , Mario Fritz , Bernt Schiele

Deep learning on graphs has become a popular research topic with many applications. However, past work has concentrated on learning graph embedding tasks, which is in contrast with advances in generative models for images and text. Is it…

Machine Learning · Computer Science 2018-02-13 Martin Simonovsky , Nikos Komodakis

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

Machine Learning · Computer Science 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

In generative modeling, numerous successful approaches leverage a low-dimensional latent space, e.g., Stable Diffusion models the latent space induced by an encoder and generates images through a paired decoder. Although the selection of…

Machine Learning · Computer Science 2023-10-31 Tianyang Hu , Fei Chen , Haonan Wang , Jiawei Li , Wenjia Wang , Jiacheng Sun , Zhenguo Li

This project report compares some known GAN and VAE models proposed prior to 2017. There has been significant progress after we finished this report. We upload this report as an introduction to generative models and provide some personal…

Machine Learning · Computer Science 2018-12-19 Lu Mi , Macheng Shen , Jingzhao Zhang

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

Machine Learning · Computer Science 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

Inference for Variational Autoencoders (VAEs) consists of learning two models: (1) a generative model, which transforms a simple distribution over a latent space into the distribution over observed data, and (2) an inference model, which…

Machine Learning · Statistics 2024-06-14 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

Generative Adversarial Nets (GANs) and Variational Auto-Encoders (VAEs) provide impressive image generations from Gaussian white noise, but the underlying mathematics are not well understood. We compute deep convolutional network generators…

Machine Learning · Computer Science 2018-05-18 Tomás Angles , Stéphane Mallat

We present variational generative adversarial networks, a general learning framework that combines a variational auto-encoder with a generative adversarial network, for synthesizing images in fine-grained categories, such as faces of a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Jianmin Bao , Dong Chen , Fang Wen , Houqiang Li , Gang Hua

Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Thomas Lucas , Konstantin Shmelkov , Karteek Alahari , Cordelia Schmid , Jakob Verbeek

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

Machine Learning · Computer Science 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

The Variational Autoencoder (VAE) is a powerful framework for learning probabilistic latent variable generative models. However, typical assumptions on the approximate posterior distribution of the encoder and/or the prior, seriously…

Machine Learning · Computer Science 2020-07-13 Ifigeneia Apostolopoulou , Elan Rosenfeld , Artur Dubrawski

Ensemble smoothers are among the most successful and efficient techniques currently available for history matching. However, because these methods rely on Gaussian assumptions, their performance is severely degraded when the prior geology…

Although variational autoencoders (VAEs) represent a widely influential deep generative model, many aspects of the underlying energy function remain poorly understood. In particular, it is commonly believed that Gaussian encoder/decoder…

Machine Learning · Computer Science 2019-10-31 Bin Dai , David Wipf

Autoencoders are effective deep learning models that can function as generative models and learn latent representations for downstream tasks. The use of graph autoencoders - with both encoder and decoder implemented as message passing…

Machine Learning · Computer Science 2025-03-04 Magnus Cunow , Gerrit Großmann

The variational autoencoder (VAE) framework remains a popular option for training unsupervised generative models, especially for discrete data where generative adversarial networks (GANs) require workaround to create gradient for the…

Machine Learning · Computer Science 2019-04-24 Jason Chou , Gautam Hathi

Generative adversarial networks (GANs) are a powerful framework for generative tasks. However, they are difficult to train and tend to miss modes of the true data generation process. Although GANs can learn a rich representation of the…

Machine Learning · Computer Science 2017-11-27 Robin Winter , Djork-Arné Clevert