English
Related papers

Related papers: Hierarchical Patch VAE-GAN: Generating Diverse Vid…

200 papers

Semantic image synthesis is a process for generating photorealistic images from a single semantic mask. To enrich the diversity of multimodal image synthesis, previous methods have controlled the global appearance of an output image by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Yuki Endo , Yoshihiro Kanamori

Deep generative models often perform poorly in real-world applications due to the heterogeneity of natural data sets. Heterogeneity arises from data containing different types of features (categorical, ordinal, continuous, etc.) and…

Machine Learning · Computer Science 2020-06-23 Chao Ma , Sebastian Tschiatschek , José Miguel Hernández-Lobato , Richard Turner , Cheng Zhang

In this paper, we investigate the problem of string-based molecular generation via variational autoencoders (VAEs) that have served a popular generative approach for various tasks in artificial intelligence. We propose a simple, yet…

Machine Learning · Computer Science 2022-08-24 Kisoo Kwon , Kuhwan Jung , Junghyun Park , Hwidong Na , Jinwoo Shin

Among the wide variety of image generative models, two models stand out: Variational Auto Encoders (VAE) and Generative Adversarial Networks (GAN). GANs can produce realistic images, but they suffer from mode collapse and do not provide…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

We present variational generative adversarial networks, a general learning framework that combines a variational auto-encoder with a generative adversarial network, for synthesizing images in fine-grained categories, such as faces of a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Jianmin Bao , Dong Chen , Fang Wen , Houqiang Li , Gang Hua

We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large scale image generation. To this end, we scale and enhance the autoregressive priors used in VQ-VAE to generate synthetic samples of much higher…

Machine Learning · Computer Science 2019-06-04 Ali Razavi , Aaron van den Oord , Oriol Vinyals

In this work, we propose a Variational Autoencoder (VAE) - Generative Adversarial Networks (GAN) model that can produce highly realistic MRI together with its pixel accurate groundtruth for the application of cine-MR image cardiac…

Image and Video Processing · Electrical Eng. & Systems 2020-05-25 Youssef Skandarani , Nathan Painchaud , Pierre-Marc Jodoin , Alain Lalande

The decoder-based machine learning generative algorithms such as Generative Adversarial Networks (GAN), Variational Auto-Encoders (VAE), Transformers show impressive results when constructing objects similar to those in a training ensemble.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Gabriel Turinici

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent methods aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Subeen Lee , Jiyeon Han , Soyeon Kim , Jaesik Choi

Variational Autoencoders (VAE) are probabilistic deep generative models underpinned by elegant theory, stable training processes, and meaningful manifold representations. However, they produce blurry images due to a lack of explicit…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Prashnna K Gyawali , Rudra Saha , Linwei Wang , VSR Veeravasarapu , Maneesh Singh

Given a large dataset for training, generative adversarial networks (GANs) can achieve remarkable performance for the image synthesis task. However, training GANs in extremely low data regimes remains a challenge, as overfitting often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Vadim Sushko , Dan Zhang , Juergen Gall , Anna Khoreva

In this paper, we aim to improve the state-of-the-art video generative adversarial networks (GANs) with a view towards multi-functional applications. Our improved video GAN model does not separate foreground from background nor dynamic from…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Bernhard Kratzwald , Zhiwu Huang , Danda Pani Paudel , Acharya Dinesh , Luc Van Gool

Generative adversarial networks (GANs) are one of the most widely used generative models. GANs can learn complex multi-modal distributions, and generate real-like samples. Despite the major success of GANs in generating synthetic data, they…

Machine Learning · Computer Science 2021-09-07 Sanaz Mohammadjafari , Mucahit Cevik , Ayse Basar

Despite success on a wide range of problems related to vision, generative adversarial networks (GANs) often suffer from inferior performance due to unstable training, especially for text generation. To solve this issue, we propose a new…

Machine Learning · Computer Science 2020-11-02 Yue Wu , Pan Zhou , Andrew Gordon Wilson , Eric P. Xing , Zhiting Hu

We introduce SinGAN, an unconditional generative model that can be learned from a single natural image. Our model is trained to capture the internal distribution of patches within the image, and is then able to generate high quality,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Tamar Rott Shaham , Tali Dekel , Tomer Michaeli

Previous work explored blending levels from existing games to create levels for a new game that mixes properties of the original games. In this paper, we use Variational Autoencoders (VAEs) for improving upon such techniques. VAEs are…

Machine Learning · Computer Science 2020-02-28 Anurag Sarkar , Zhihan Yang , Seth Cooper

The usage of deep generative models for image compression has led to impressive performance gains over classical codecs while neural video compression is still in its infancy. Here, we propose an end-to-end, deep generative modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jun Han , Salvator Lombardo , Christopher Schroers , Stephan Mandt

Learning a robust video Variational Autoencoder (VAE) is essential for reducing video redundancy and facilitating efficient video generation. Directly applying image VAEs to individual frames in isolation can result in temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yazhou Xing , Yang Fei , Yingqing He , Jingye Chen , Jiaxin Xie , Xiaowei Chi , Qifeng Chen

Generative Adversarial Networks (GANs) can achieve state-of-the-art sample quality in generative modelling tasks but suffer from the mode collapse problem. Variational Autoencoders (VAE) on the other hand explicitly maximize a…

Machine Learning · Computer Science 2019-09-30 Apratim Bhattacharyya , Mario Fritz , Bernt Schiele

A deep generative model that describes human motions can benefit a wide range of fundamental computer vision and graphics tasks, such as providing robustness to video-based human pose estimation, predicting complete body movements for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Jiaman Li , Ruben Villegas , Duygu Ceylan , Jimei Yang , Zhengfei Kuang , Hao Li , Yajie Zhao