English
Related papers

Related papers: Semi-Amortized Variational Autoencoders

200 papers

This paper presents a simulator-assisted training method (SimVAE) for variational autoencoders (VAE) that leads to a disentangled and interpretable latent space. Training SimVAE is a two-step process in which first a deep generator…

Machine Learning · Statistics 2019-11-20 Akash Srivastava , Jessie Rosenberg , Dan Gutfreund , David D. Cox

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

Machine Learning · Computer Science 2024-01-08 Ahmed Salah , David Yevick

Variational Autoencoders (VAEs) are powerful generative models that have been widely used in various fields, including image and text generation. However, one of the known challenges in using VAEs is the model's sensitivity to its…

Machine Learning · Computer Science 2024-12-31 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the…

Machine Learning · Statistics 2023-01-19 Ali Siahkoohi , Gabrio Rizzuti , Rafael Orozco , Felix J. Herrmann

Conditional variational autoencoders (CVAEs) are versatile deep generative models that extend the standard VAE framework by conditioning the generative model with auxiliary covariates. The original CVAE model assumes that the data samples…

Machine Learning · Statistics 2022-03-03 Siddharth Ramchandran , Gleb Tikhonov , Otto Lönnroth , Pekka Tiikkainen , Harri Lähdesmäki

Variational autoencoders (VAEs) are powerful deep generative models widely used to represent high-dimensional complex data through a low-dimensional latent space learned in an unsupervised manner. In the original VAE model, the input data…

Machine Learning · Computer Science 2022-07-05 Laurent Girin , Simon Leglaive , Xiaoyu Bie , Julien Diard , Thomas Hueber , Xavier Alameda-Pineda

The Variational AutoEncoder (VAE) learns simultaneously an inference and a generative model, but only one of these models can be learned at optimum, this behaviour is associated to the ELBO learning objective, that is optimised by a…

Machine Learning · Computer Science 2020-11-10 Vincenzo Crescimanna , Bruce Graham

Variational inference (VI) plays an essential role in approximate Bayesian inference due to its computational efficiency and broad applicability. Crucial to the performance of VI is the selection of the associated divergence measure, as VI…

Machine Learning · Computer Science 2021-06-24 Ruqi Zhang , Yingzhen Li , Christopher De Sa , Sam Devlin , Cheng Zhang

Recent work in synthetic data generation in the time-series domain has focused on the use of Generative Adversarial Networks. We propose a novel architecture for synthetically generating time-series data with the use of Variational…

Machine Learning · Computer Science 2021-12-08 Abhyuday Desai , Cynthia Freeman , Zuhui Wang , Ian Beaver

Deep hierarchical variational autoencoders (VAEs) are powerful latent variable generative models. In this paper, we introduce Hierarchical VAE with Diffusion-based Variational Mixture of the Posterior Prior (VampPrior). We apply…

Machine Learning · Computer Science 2024-12-03 Anna Kuzina , Jakub M. Tomczak

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

Machine Learning · Statistics 2023-05-12 Daniel G. Edelberg , Roy R. Lederman

Variational autoencoders (VAE) are a powerful and widely-used class of models to learn complex data distributions in an unsupervised fashion. One important limitation of VAEs is the prior assumption that latent sample representations are…

Machine Learning · Computer Science 2018-11-27 Francesco Paolo Casale , Adrian V Dalca , Luca Saglietti , Jennifer Listgarten , Nicolo Fusi

Stochastic models with global parameters and latent variables are common, and for which variational inference (VI) is popular. However, existing methods are often either slow or inaccurate in high dimensions. We suggest a fast and accurate…

Machine Learning · Statistics 2024-07-26 Weiben Zhang , Michael Stanley Smith , Worapree Maneesoonthorn , Ruben Loaiza-Maya

Sequential recommendation as an emerging topic has attracted increasing attention due to its important practical significance. Models based on deep learning and attention mechanism have achieved good performance in sequential…

Information Retrieval · Computer Science 2021-03-22 Zhe Xie , Chengxuan Liu , Yichi Zhang , Hongtao Lu , Dong Wang , Yue Ding

In this paper, we address the unsupervised speech enhancement problem based on recurrent variational autoencoder (RVAE). This approach offers promising generalization performance over the supervised counterpart. Nevertheless, the involved…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Mostafa Sadeghi , Romain Serizel

Amortized simulation-based inference (SBI) methods train neural networks on simulated data to perform Bayesian inference. While this strategy avoids the need for tractable likelihoods, it often requires a large number of simulations and has…

Machine Learning · Computer Science 2025-03-04 Manuel Gloeckler , Shoji Toyota , Kenji Fukumizu , Jakob H. Macke

We develop unbiased implicit variational inference (UIVI), a method that expands the applicability of variational inference by defining an expressive variational family. UIVI considers an implicit variational distribution obtained in a…

Machine Learning · Statistics 2019-02-07 Michalis K. Titsias , Francisco J. R. Ruiz

Recently, particle-based variational inference (ParVI) methods have gained interest because they can avoid arbitrary parametric assumptions that are common in variational inference. However, many ParVI approaches do not allow arbitrary…

Machine Learning · Computer Science 2021-08-12 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

The Variational Autoencoder (VAE) is a powerful deep generative model that is now extensively used to represent high-dimensional complex data via a low-dimensional latent space learned in an unsupervised manner. In the original VAE model,…

Sound · Computer Science 2021-06-15 Xiaoyu Bie , Laurent Girin , Simon Leglaive , Thomas Hueber , Xavier Alameda-Pineda

This study advances the Variational Autoencoder (VAE) framework by addressing challenges in Independent Component Analysis (ICA) under both determined and underdetermined conditions, focusing on enhancing the independence and…

Machine Learning · Statistics 2025-06-10 Yuan-Hao Wei , Yan-Jie Sun