English
Related papers

Related papers: Variational Autoencoder with Learned Latent Struct…

200 papers

We propose DoE2Vec, a variational autoencoder (VAE)-based methodology to learn optimization landscape characteristics for downstream meta-learning tasks, e.g., automated selection of optimization algorithms. Principally, using large…

Optimization and Control · Mathematics 2023-04-05 Bas van Stein , Fu Xing Long , Moritz Frenzel , Peter Krause , Markus Gitterle , Thomas Bäck

Variational autoencoders (VAEs) are a powerful class of deep generative latent variable model for unsupervised representation learning on high-dimensional data. To ensure computational tractability, VAEs are often implemented with a…

Machine Learning · Computer Science 2020-06-09 Alex Campbell , Pietro Liò

Variational autoencoders (VAEs) are a popular framework for modeling complex data distributions; they can be efficiently trained via variational inference by maximizing the evidence lower bound (ELBO), at the expense of a gap to the exact…

Variational autoencoders learn distributions of high-dimensional data. They model data with a deep latent-variable model and then fit the model by maximizing a lower bound of the log marginal likelihood. VAEs can capture complex…

Machine Learning · Statistics 2019-02-01 Adji B. Dieng , Yoon Kim , Alexander M. Rush , David M. Blei

We explain why directly changing the prior can be a surprisingly ineffective mechanism for incorporating inductive biases into VAEs, and introduce a simple and effective alternative approach: Intermediary Latent Space VAEs(InteL-VAEs).…

Machine Learning · Statistics 2022-02-16 Ning Miao , Emile Mathieu , N. Siddharth , Yee Whye Teh , Tom Rainforth

We present an autoencoder that leverages learned representations to better measure similarities in data space. By combining a variational autoencoder with a generative adversarial network we can use learned feature representations in the…

Machine Learning · Computer Science 2016-02-12 Anders Boesen Lindbo Larsen , Søren Kaae Sønderby , Hugo Larochelle , Ole Winther

Variational Autoencoders are powerful models for unsupervised learning. However deep models with several layers of dependent stochastic variables are difficult to train which limits the improvements obtained using these highly expressive…

Machine Learning · Statistics 2016-05-30 Casper Kaae Sønderby , Tapani Raiko , Lars Maaløe , Søren Kaae Sønderby , Ole Winther

Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source---the latent space---to samples from a more complex distribution…

Machine Learning · Statistics 2018-02-09 Nutan Chen , Alexej Klushyn , Richard Kurle , Xueyan Jiang , Justin Bayer , Patrick van der Smagt

Unsupervised and semi-supervised ML methods such as variational autoencoders (VAE) have become widely adopted across multiple areas of physics, chemistry, and materials sciences due to their capability in disentangling representations and…

Machine Learning · Computer Science 2022-07-04 Arpan Biswas , Rama Vasudevan , Maxim Ziatdinov , Sergei V. Kalinin

We present fast, realistic image generation on high-resolution, multimodal datasets using hierarchical variational autoencoders (VAEs) trained on a deterministic autoencoder's latent space. In this two-stage setup, the autoencoder…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Troy Luhman , Eric Luhman

Variational autoencoders (VAEs) are a popular class of deep generative models with many variants and a wide range of applications. Improvements upon the standard VAE mostly focus on the modelling of the posterior distribution over the…

Machine Learning · Computer Science 2022-11-02 James Langley , Miguel Monteiro , Charles Jones , Nick Pawlowski , Ben Glocker

We propose the Variational Shape Learner (VSL), a generative model that learns the underlying structure of voxelized 3D shapes in an unsupervised fashion. Through the use of skip-connections, our model can successfully learn and infer a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Shikun Liu , C. Lee Giles , Alexander G. Ororbia

Deep neural networks with discrete latent variables offer the promise of better symbolic reasoning, and learning abstractions that are more useful to new tasks. There has been a surge in interest in discrete latent variable models, however,…

Machine Learning · Computer Science 2018-07-23 Aurko Roy , Ashish Vaswani , Arvind Neelakantan , Niki Parmar

Variational Autoencoder is a scalable method for learning latent variable models of complex data. It employs a clear objective that can be easily optimized. However, it does not explicitly measure the quality of learned representations. We…

Machine Learning · Computer Science 2020-05-29 Andriy Serdega , Dae-Shik Kim

Autoencoders are a widespread tool in machine learning to transform high-dimensional data into a lowerdimensional representation which still exhibits the essential characteristics of the input. The encoder provides an embedding from the…

Machine Learning · Computer Science 2021-04-28 Juliane Braunsmann , Marko Rajković , Martin Rumpf , Benedikt Wirth

Deep generative models often perform poorly in real-world applications due to the heterogeneity of natural data sets. Heterogeneity arises from data containing different types of features (categorical, ordinal, continuous, etc.) and…

Machine Learning · Computer Science 2020-06-23 Chao Ma , Sebastian Tschiatschek , José Miguel Hernández-Lobato , Richard Turner , Cheng Zhang

A variational autoencoder (VAE) derived from Tsallis statistics called q-VAE is proposed. In the proposed method, a standard VAE is employed to statistically extract latent space hidden in sampled data, and this latent space helps make…

Machine Learning · Computer Science 2021-08-27 Taisuke Kobayashi

In the last few years there have been important advancements in generative models with the two dominant approaches being Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs). However, standard Autoencoders (AEs) and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Massimiliano Patacchiola , Patrick Fox-Roberts , Edward Rosten

Despite their ubiquity, variational autoencoders (VAEs) inherently suffer from posterior collapse, a failure mode in which latent variables are effectively ignored. This failure arises because explicit prior imposition drives optimization…

Machine Learning · Computer Science 2026-05-18 Hazhir Aliahmadi , Irina Babayan , Greg van Anders

We propose a cross-domain latent modulation mechanism within a variational autoencoders (VAE) framework to enable improved transfer learning. Our key idea is to procure deep representations from one data domain and use it as perturbation to…

Machine Learning · Computer Science 2020-12-23 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Ding