English
Related papers

Related papers: The Variational InfoMax AutoEncoder

200 papers

As a widely recognized approach to deep generative modeling, Variational Auto-Encoders (VAEs) still face challenges with the quality of generated images, often presenting noticeable blurriness. This issue stems from the unrealistic…

Machine Learning · Computer Science 2023-05-22 Georgios Batzolis , Jan Stanczuk , Carola-Bibiane Schönlieb

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

Machine Learning · Statistics 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell

Recent approaches build on implicit neural representations (INRs) to propose generative models over function spaces. However, they are computationally costly when dealing with inference tasks, such as missing data imputation, or directly…

Machine Learning · Computer Science 2023-07-21 Batuhan Koyuncu , Pablo Sanchez-Martin , Ignacio Peis , Pablo M. Olmos , Isabel Valera

Variational Auto-encoders (VAEs) have been very successful as methods for forming compressed latent representations of complex, often high-dimensional, data. In this paper, we derive an alternative variational lower bound from the one…

Machine Learning · Computer Science 2019-03-20 Shuyu Lin , Ronald Clark , Robert Birke , Niki Trigoni , Stephen Roberts

Interpretable machine learning is rapidly becoming a crucial tool for scientific discovery. Among existing approaches, variational autoencoders (VAEs) have shown promise in extracting the hidden physical features of some input data, with no…

Variational autoencoder (VAE) neural networks can be trained to generate power system states that capture both marginal distribution and multivariate dependencies of historical data. The coordinates of the latent space codes of VAEs have…

Systems and Control · Electrical Eng. & Systems 2023-03-22 Chenguang Wang , Ensieh Sharifnia , Simon H. Tindemans , Peter Palensky

We present a latent variable model for classification that provides a novel probabilistic interpretation of neural network softmax classifiers. We derive a variational objective to train the model, analogous to the evidence lower bound…

Machine Learning · Computer Science 2024-01-10 Shehzaad Dhuliawala , Mrinmaya Sachan , Carl Allen

VAEs, or variational autoencoders, are autoencoders that explicitly learn the distribution of the input image space rather than assuming no prior information about the distribution. This allows it to classify similar samples close to each…

Machine Learning · Computer Science 2023-02-08 Fareed Sheriff , Sameer Pai

We prove that the evidence lower bound (ELBO) employed by variational auto-encoders (VAEs) admits non-trivial solutions having constant posterior variances under certain mild conditions, removing the need to learn variances in the encoder.…

Machine Learning · Computer Science 2021-05-27 Graham Fyffe

In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function…

Machine Learning · Statistics 2021-01-05 Carl Doersch

Image generative models can learn the distributions of the training data and consequently generate examples by sampling from these distributions. However, when the training dataset is corrupted with outliers, generative models will likely…

Machine Learning · Computer Science 2022-09-21 Chieh-Hsin Lai , Dongmian Zou , Gilad Lerman

In this work, we present a novel neural network to generate high resolution images. We replace the decoder of VAE with a discriminator while using the encoder as it is. The encoder is fed data from a normal distribution while the generator…

Image and Video Processing · Electrical Eng. & Systems 2021-06-23 Abhinav Sagar

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

Machine Learning · Computer Science 2024-01-08 Ahmed Salah , David Yevick

We propose a novel deep clustering method that integrates Variational Autoencoders (VAEs) into the Expectation-Maximization (EM) framework. Our approach models the probability distribution of each cluster with a VAE and alternates between…

Machine Learning · Computer Science 2025-01-14 Michael Adipoetra , Ségolène Martin

Recent advances in neural-based generative modeling have reignited the hopes of having computer systems capable of conversing with humans and able to understand natural language. The employment of deep neural architectures has been largely…

Computation and Language · Computer Science 2022-11-16 Haoqin Tu , Yitong Li

The Gaussianity assumption has been consistently criticized as a main limitation of the Variational Autoencoder (VAE) despite its efficiency in computational modeling. In this paper, we propose a new approach that expands the model capacity…

Machine Learning · Statistics 2023-10-30 Seunghwan An , Jong-June Jeon

This paper introduces a new interpretation of the Variational Autoencoder framework by taking a fully geometric point of view. We argue that vanilla VAE models unveil naturally a Riemannian structure in their latent space and that taking…

Machine Learning · Statistics 2022-11-04 Clément Chadebec , Stéphanie Allassonnière

People can easily imagine the potential sound while seeing an event. This natural synchronization between audio and visual signals reveals their intrinsic correlations. To this end, we propose to learn the audio-visual correlations from the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Ye Zhu , Yu Wu , Hugo Latapie , Yi Yang , Yan Yan

The variational autoencoder (VAE) framework remains a popular option for training unsupervised generative models, especially for discrete data where generative adversarial networks (GANs) require workaround to create gradient for the…

Machine Learning · Computer Science 2019-04-24 Jason Chou , Gautam Hathi

Purpose: Handling heterogeneous and mixed data types has become increasingly critical with the exponential growth in real-world databases. While deep generative models attempt to merge diverse data views into a common latent space, they…

Machine Learning · Computer Science 2024-10-23 Alejandro Guerrero-López , Carlos Sevilla-Salcedo , Vanessa Gómez-Verdejo , Pablo M. Olmos