English
Related papers

Related papers: Tutorial on Variational Autoencoders

200 papers

Conditional Variational Auto Encoders (VAE) are gathering significant attention as an Explainable Artificial Intelligence (XAI) tool. The codes in the latent space provide a theoretically sound way to produce counterfactuals, i.e.…

Machine Learning · Computer Science 2021-02-02 Nicolas Vercheval , Aleksandra Pizurica

Discrete latent variables are considered important for real world data, which has motivated research on Variational Autoencoders (VAEs) with discrete latents. However, standard VAE training is not possible in this case, which has motivated…

Machine Learning · Statistics 2023-03-27 Enrico Guiraud , Jakob Drefs , Jörg Lücke

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

Machine Learning · Statistics 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

Machine Learning · Computer Science 2024-01-08 Ahmed Salah , David Yevick

Using a discriminative representation obtained by supervised deep learning methods showed promising results on diverse Content-Based Image Retrieval (CBIR) problems. However, existing methods exploiting labels during training try to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Mehdi Rafiei , Alexandros Iosifidis

Successfully training Variational Autoencoders (VAEs) with a hierarchy of discrete latent variables remains an area of active research. Vector-Quantised VAEs are a powerful approach to discrete VAEs, but naive hierarchical extensions can be…

Machine Learning · Statistics 2021-02-05 Matthew Willetts , Xenia Miscouridou , Stephen Roberts , Chris Holmes

Variational autoencoders (VAEs) are used for transfer learning across various research domains such as music generation or medical image analysis. However, there is no principled way to assess before transfer which components to retrain or…

Machine Learning · Computer Science 2023-04-24 Lisa Bonheme , Marek Grzes

Variational Autoencoders (VAEs) have been a pioneering force in the realm of deep generative models. Amongst its legions of progenies, Wasserstein Autoencoders (WAEs) stand out in particular due to the dual offering of heightened generative…

Machine Learning · Statistics 2023-12-12 Anish Chakrabarty , Arkaprabha Basu , Swagatam Das

Data assimilation refers to a set of algorithms designed to compute the optimal estimate of a system's state by refining the prior prediction (known as background states) using observed data. Variational assimilation methods rely on the…

Machine Learning · Computer Science 2024-05-24 Yi Xiao , Qilong Jia , Wei Xue , Lei Bai

Variational Autoencoders (VAEs), as a form of deep generative model, have been widely used in recent years, and shown great great peformance in a number of different domains, including image generation and anomaly detection, etc.. This…

Machine Learning · Computer Science 2024-08-28 Liang Cheng , Peiyuan Guan , Amir Taherkordi , Lei Liu , Dapeng Lan

Deep latent variable models, trained using variational autoencoders or generative adversarial networks, are now a key technique for representation learning of continuous structures. However, applying similar methods to discrete structures,…

Machine Learning · Computer Science 2018-07-02 Jake Zhao , Yoon Kim , Kelly Zhang , Alexander M. Rush , Yann LeCun

Variational autoencoders (VAE) are directed generative models that learn factorial latent variables. As noted by Burda et al. (2015), these models exhibit the problem of factor over-pruning where a significant number of stochastic factors…

Machine Learning · Computer Science 2017-08-08 Serena Yeung , Anitha Kannan , Yann Dauphin , Li Fei-Fei

The combination of machine learning models with physical models is a recent research path to learn robust data representations. In this paper, we introduce p$^3$VAE, a variational autoencoder that integrates prior physical knowledge about…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Romain Thoreau , Laurent Risser , Véronique Achard , Béatrice Berthelot , Xavier Briottet

The variational autoencoder (VAE) is a popular probabilistic generative model. However, one shortcoming of VAEs is that the latent variables cannot be discrete, which makes it difficult to generate data from different modes of a…

Machine Learning · Statistics 2017-11-21 Jay A. Hennig , Akash Umakantha , Ryan C. Williamson

Understanding the latent spaces learned by deep learning models is crucial in exploring how they represent and generate complex data. Autoencoders (AEs) have played a key role in the area of representation learning, with numerous…

Machine Learning · Computer Science 2025-01-17 Anika Shrivastava , Renu Rameshan , Samar Agnihotri

Variational Autoencoder (VAE) and its variations are classic generative models by learning a low-dimensional latent representation to satisfy some prior distribution (e.g., Gaussian distribution). Their advantages over GAN are that they can…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Cong Geng , Jia Wang , Li Chen , Zhiyong Gao

Variational auto-encoders (VAE) are popular deep latent variable models which are trained by maximizing an Evidence Lower Bound (ELBO). To obtain tighter ELBO and hence better variational approximations, it has been proposed to use…

Machine Learning · Statistics 2021-07-22 Achille Thin , Nikita Kotelevskii , Arnaud Doucet , Alain Durmus , Eric Moulines , Maxim Panov

Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work has focused largely on modifying the variational cost…

Machine Learning · Statistics 2019-09-12 Jan Stühmer , Richard E. Turner , Sebastian Nowozin

The generation of discontinuous distributions is a difficult task for most known frameworks such as generative autoencoders and generative adversarial networks. Generative non-invertible models are unable to accurately generate such…

Machine Learning · Computer Science 2021-12-20 Mariia Drozdova , Vitaliy Kinakh , Guillaume Quétant , Tobias Golling , Slava Voloshynovskiy

Human face exhibits an inherent hierarchy in its representations (i.e., holistic facial expressions can be encoded via a set of facial action units (AUs) and their intensity). Variational (deep) auto-encoders (VAE) have shown great results…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Dieu Linh Tran , Robert Walecki , Ognjen Rudovic , Stefanos Eleftheriadis , Bjørn Schuller , Maja Pantic