English
Related papers

Related papers: Tackling Over-pruning in Variational Autoencoders

200 papers

Instance-based interpretation methods have been widely studied for supervised learning methods as they help explain how black box neural networks predict. However, instance-based interpretations remain ill-understood in the context of…

Machine Learning · Computer Science 2022-01-25 Zhifeng Kong , Kamalika Chaudhuri

Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work has focused largely on modifying the variational cost…

Machine Learning · Statistics 2019-09-12 Jan Stühmer , Richard E. Turner , Sebastian Nowozin

Euclidean geometry has historically been the typical "workhorse" for machine learning applications due to its power and simplicity. However, it has recently been shown that geometric spaces with constant non-zero curvature improve…

Machine Learning · Computer Science 2020-02-14 Ondrej Skopek , Octavian-Eugen Ganea , Gary Bécigneul

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

Machine Learning · Computer Science 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing

We present two deep generative models based on Variational Autoencoders to improve the accuracy of drug response prediction. Our models, Perturbation Variational Autoencoder and its semi-supervised extension, Drug Response Variational…

Machine Learning · Statistics 2017-07-07 Ladislav Rampasek , Daniel Hidru , Petr Smirnov , Benjamin Haibe-Kains , Anna Goldenberg

Continual or incremental learning holds tremendous potential in deep learning with different challenges including catastrophic forgetting. The advent of powerful foundation and generative models has propelled this paradigm even further,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Victor Enescu , Hichem Sahbi

We present a new method for improving the performances of variational autoencoder (VAE). In addition to enforcing the deep feature consistent principle thus ensuring the VAE output and its corresponding input images to have similar deep…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Xianxu Hou , Ke Sun , Linlin Shen , Guoping Qiu

Variational autoencdoers (VAE) are a popular approach to generative modelling. However, exploiting the capabilities of VAEs in practice can be difficult. Recent work on regularised and entropic autoencoders have begun to explore the…

Machine Learning · Computer Science 2022-03-02 Gregory A. Daly , Jonathan E. Fieldsend , Gavin Tabor

Variational autoencoders (VAE) often use Gaussian or category distribution to model the inference process. This puts a limit on variational learning because this simplified assumption does not match the true posterior distribution, which is…

Machine Learning · Computer Science 2017-02-28 Ke Sun , Xiangliang Zhang

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

Machine Learning · Statistics 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

The variational autoencoder (VAE) typically employs a standard normal prior as a regularizer for the probabilistic latent encoder. However, the Gaussian tail often decays too quickly to effectively accommodate the encoded points, failing to…

Machine Learning · Statistics 2024-03-05 Juno Kim , Jaehyuk Kwon , Mincheol Cho , Hyunjong Lee , Joong-Ho Won

As an important problem in causal inference, we discuss the estimation of treatment effects (TEs). Representing the confounder as a latent variable, we propose Intact-VAE, a new variant of variational autoencoder (VAE), motivated by the…

Machine Learning · Statistics 2022-04-22 Pengzhou Wu , Kenji Fukumizu

The ability to extract generative parameters from high-dimensional fields of data in an unsupervised manner is a highly desirable yet unrealized goal in computational physics. This work explores the use of variational autoencoders (VAEs)…

Computational Physics · Physics 2021-11-16 Christian Jacobsen , Karthik Duraisamy

Deep probabilistic generative models have achieved incredible success in many fields of application. Among such models, variational autoencoders (VAEs) have proved their ability in modeling a generative process by learning a latent…

Machine Learning · Computer Science 2022-12-16 Eleonora Grassucci , Danilo Comminiello , Aurelio Uncini

A large part of the literature on learning disentangled representations focuses on variational autoencoders (VAE). Recent developments demonstrate that disentanglement cannot be obtained in a fully unsupervised setting without inductive…

Machine Learning · Computer Science 2021-02-11 Graziano Mita , Maurizio Filippone , Pietro Michiardi

Deep generative models have achieved great success in unsupervised learning with the ability to capture complex nonlinear relationships between latent generating factors and observations. Among them, a factorized hierarchical variational…

Machine Learning · Statistics 2018-06-18 Wei-Ning Hsu , James Glass

Construction of dictionaries using nonnegative matrix factorisation (NMF) has extensive applications in signal processing and machine learning. With the advances in deep learning, training compact and robust dictionaries using deep neural…

Machine Learning · Computer Science 2023-01-19 Hong-Bo Xie , Caoyuan Li , Shuliang Wang , Richard Yi Da Xu , Kerrie Mengersen

In recent years, the field of machine learning has made phenomenal progress in the pursuit of simulating real-world data generation processes. One notable example of such success is the variational autoencoder (VAE). In this work, with a…

Machine Learning · Statistics 2021-12-30 Hwan Goh , Sheroze Sheriffdeen , Jonathan Wittmer , Tan Bui-Thanh

Paradoxically, a Variational Autoencoder (VAE) could be pushed in two opposite directions, utilizing powerful decoder model for generating realistic images but collapsing the learned representation, or increasing regularization coefficient…

Machine Learning · Computer Science 2022-03-30 Trung Ngo , Najwa Laabid , Ville Hautamäki , Merja Heinäniemi

Recently, audio-visual speech enhancement has been tackled in the unsupervised settings based on variational auto-encoders (VAEs), where during training only clean data is used to train a generative model for speech, which at test time is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Mostafa Sadeghi , Xavier Alameda-Pineda