English
Related papers

Related papers: PixelVAE++: Improved PixelVAE with Discrete Prior

200 papers

This paper presents a family of advanced vision encoder, named OpenVision 3, that learns a single, unified visual representation that can serve both image understanding and image generation. Our core architecture is simple: we feed…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Letian Zhang , Sucheng Ren , Yanqing Liu , Xianhang Li , Zeyu Wang , Yuyin Zhou , Huaxiu Yao , Zeyu Zheng , Weili Nie , Guilin Liu , Zhiding Yu , Cihang Xie

We present a novel introspective variational autoencoder (IntroVAE) model for synthesizing high-resolution photographic images. IntroVAE is capable of self-evaluating the quality of its generated samples and improving itself accordingly.…

Machine Learning · Computer Science 2018-10-30 Huaibo Huang , Zhihang Li , Ran He , Zhenan Sun , Tieniu Tan

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

Machine Learning · Computer Science 2022-11-16 Rafael Pastrana

Deep probabilistic generative models have achieved incredible success in many fields of application. Among such models, variational autoencoders (VAEs) have proved their ability in modeling a generative process by learning a latent…

Machine Learning · Computer Science 2022-12-16 Eleonora Grassucci , Danilo Comminiello , Aurelio Uncini

We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE). This model makes use of latent variables and is capable of learning…

Machine Learning · Statistics 2016-11-23 Thomas N. Kipf , Max Welling

One major challenge of disentanglement learning with variational autoencoders is the trade-off between disentanglement and reconstruction fidelity. Previous studies, which increase the information bottleneck during training, tend to lose…

Machine Learning · Computer Science 2023-10-05 Jiantao Wu , Shentong Mo , Xiang Yang , Muhammad Awais , Sara Atito , Xingshen Zhang , Lin Wang , Xiang Yang

We introduce a version of a variational auto-encoder (VAE), which can generate good perturbations of images, when trained on a complex dataset (in our experiments, CIFAR-10). The net is using only two latent generative dimensions per class,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Galin Georgiev

Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work has focused largely on modifying the variational cost…

Machine Learning · Statistics 2019-09-12 Jan Stühmer , Richard E. Turner , Sebastian Nowozin

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder (DD-VAE) for…

Machine Learning · Computer Science 2020-03-05 Daniil Polykovskiy , Dmitry Vetrov

Variational Autoencoders (VAE) and their variants have been widely used in a variety of applications, such as dialog generation, image generation and disentangled representation learning. However, the existing VAE models have some…

Machine Learning · Computer Science 2020-06-23 Huajie Shao , Shuochao Yao , Dachun Sun , Aston Zhang , Shengzhong Liu , Dongxin Liu , Jun Wang , Tarek Abdelzaher

In this paper we propose Spatial PixelCNN, a conditional autoregressive model that generates images from small patches. By conditioning on a grid of pixel coordinates and global features extracted from a Variational Autoencoder (VAE), we…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Nader Akoury , Anh Nguyen

In this work, we propose a new generative model that is capable of automatically decoupling global and local representations of images in an entirely unsupervised setting, by embedding a generative flow in the VAE framework to model the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Xuezhe Ma , Xiang Kong , Shanghang Zhang , Eduard Hovy

By composing graphical models with deep learning architectures, we learn generative models with the strengths of both frameworks. The structured variational autoencoder (SVAE) inherits structure and interpretability from graphical models,…

Machine Learning · Computer Science 2023-11-15 Harry Bendekgey , Gabriel Hope , Erik B. Sudderth

Subsurface earth models (referred to as geo-models) are crucial for characterizing complex subsurface systems. Multiple-point statistics are commonly used to generate geo-models. In this paper, a deep-learning-based generative method is…

Geophysics · Physics 2023-08-23 Jungang Chen , Chung-Kan Huang , Jose F. Delgado , Siddharth Misra

Variational auto-encoders (VAEs) have proven to be a well suited tool for performing dimensionality reduction by extracting latent variables lying in a potentially much smaller dimensional space than the data. Their ability to capture…

Machine Learning · Statistics 2020-10-23 Clément Chadebec , Clément Mantoux , Stéphanie Allassonnière

After deep generative models were successfully applied to image generation tasks, learning disentangled latent variables of data has become a crucial part of deep generative model research. Many models have been proposed to learn an…

Machine Learning · Computer Science 2019-07-08 Sangchul Hahn , Heeyoul Choi

Recent state-of-the-art autoencoder based generative models have an encoder-decoder structure and learn a latent representation with a pre-defined distribution that can be sampled from. Implementing the encoder networks of these models in a…

Machine Learning · Computer Science 2020-05-11 D. T. Braithwaite , M. O'Connor , W. B. Kleijn

Constructing a compressed latent space through a variational autoencoder (VAE) is the key for efficient 3D diffusion models. This paper introduces COD-VAE that encodes 3D shapes into a COmpact set of 1D latent vectors without sacrificing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 In Cho , Youngbeom Yoo , Subin Jeon , Seon Joo Kim

Colour controlled image generation and manipulation are of interest to artists and graphic designers. Vector Quantised Variational AutoEncoders (VQ-VAEs) with autoregressive (AR) prior are able to produce high quality images, but lack an…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Keerth Rathakumar , David Liebowitz , Christian Walder , Kristen Moore , Salil S. Kanhere

This paper proposes a convolutional neural network that can fuse high-level prior for semantic image segmentation. Motivated by humans' vision recognition system, our key design is a three-layer generative structure consisting of high-level…

Computer Vision and Pattern Recognition · Computer Science 2015-11-24 Haitian Zheng , Yebin Liu , Mengqi Ji , Feng Wu , Lu Fang