English
Related papers

Related papers: Variational Autoencoders Pursue PCA Directions (by…

200 papers

Learning data representations that reflect the customers' creditworthiness can improve marketing campaigns, customer relationship management, data and process management or the credit risk assessment in retail banks. In this research, we…

Machine Learning · Statistics 2019-03-18 Rogelio A Mancisidor , Michael Kampffmeyer , Kjersti Aas , Robert Jenssen

Deep latent variable models, trained using variational autoencoders or generative adversarial networks, are now a key technique for representation learning of continuous structures. However, applying similar methods to discrete structures,…

Machine Learning · Computer Science 2018-07-02 Jake Zhao , Yoon Kim , Kelly Zhang , Alexander M. Rush , Yann LeCun

Although unsupervised generative modeling of an image dataset using a Variational AutoEncoder (VAE) has been used to detect anomalous images, or anomalous regions in images, recent works have shown that this method often identifies images…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 David Dehaene , Pierre Eline

Learning rich data representations from unlabeled data is a key challenge towards applying deep learning algorithms in downstream tasks. Several variants of variational autoencoders (VAEs) have been proposed to learn compact data…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Pan Xiao , Peijie Qiu , Sungmin Ha , Abdalla Bani , Shuang Zhou , Aristeidis Sotiras

Although substantial efforts have been made to learn disentangled representations under the variational autoencoder (VAE) framework, the fundamental properties to the dynamics of learning of most VAE models still remain unknown and…

Machine Learning · Computer Science 2020-07-14 Yanjun Li , Shujian Yu , Jose C. Principe , Xiaolin Li , Dapeng Wu

Recent advances in Convolutional Neural Network (CNN) model interpretability have led to impressive progress in visualizing and understanding model predictions. In particular, gradient-based visual attention methods have driven much recent…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Wenqian Liu , Runze Li , Meng Zheng , Srikrishna Karanam , Ziyan Wu , Bir Bhanu , Richard J. Radke , Octavia Camps

In this paper, we present an in-depth investigation of the convolutional autoencoder (CAE) bottleneck. Autoencoders (AE), and especially their convolutional variants, play a vital role in the current deep learning toolbox. Researchers and…

Machine Learning · Computer Science 2020-05-14 Ilja Manakov , Markus Rohm , Volker Tresp

Neural Networks play a growing role in many science disciplines, including physics. Variational Autoencoders (VAEs) are neural networks that are able to represent the essential information of a high dimensional data set in a low dimensional…

Machine Learning · Statistics 2021-12-08 Johannes Zacherl , Philipp Frank , Torsten A. Enßlin

Variational autoencoders (VAEs) are latent variable models that can generate complex objects and provide meaningful latent representations. Moreover, they could be further used in downstream tasks such as classification. As previous work…

Machine Learning · Computer Science 2022-10-13 Anna Kuzina , Max Welling , Jakub M. Tomczak

Deep generative models are stochastic neural networks capable of learning the distribution of data so as to generate new samples. Conditional Variational Autoencoder (CVAE) is a powerful deep generative model aiming at maximizing the lower…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Shima Kamyab , Rasool Sabzi , Zohreh Azimifar

This paper presents an infinite variational autoencoder (VAE) whose capacity adapts to suit the input data. This is achieved using a mixture model where the mixing coefficients are modeled by a Dirichlet process, allowing us to integrate…

Machine Learning · Computer Science 2016-11-28 Ehsan Abbasnejad , Anthony Dick , Anton van den Hengel

We develop a generalisation of disentanglement in VAEs---decomposition of the latent representation---characterising it as the fulfilment of two factors: a) the latent encodings of the data having an appropriate level of overlap, and b) the…

Machine Learning · Statistics 2019-06-13 Emile Mathieu , Tom Rainforth , N. Siddharth , Yee Whye Teh

Over the last few years, graph autoencoders (AE) and variational autoencoders (VAE) emerged as powerful node embedding methods, with promising performances on challenging tasks such as link prediction and node clustering. Graph AE, VAE and…

Machine Learning · Computer Science 2020-06-18 Guillaume Salha , Romain Hennequin , Michalis Vazirgiannis

In many data analysis tasks, it is beneficial to learn representations where each dimension is statistically independent and thus disentangled from the others. If data generating factors are also statistically independent, disentangled…

Machine Learning · Statistics 2019-12-12 Harshvardhan Sikka , Weishun Zhong , Jun Yin , Cengiz Pehlevan

Variational autoencoders employ an amortized inference model to approximate the posterior of latent variables. However, such amortized variational inference faces two challenges: (1) the limited posterior expressiveness of fully-factorized…

Machine Learning · Computer Science 2022-12-01 Yookoon Park , Chris Dongjoo Kim , Gunhee Kim

One major challenge of disentanglement learning with variational autoencoders is the trade-off between disentanglement and reconstruction fidelity. Previous studies, which increase the information bottleneck during training, tend to lose…

Machine Learning · Computer Science 2023-10-05 Jiantao Wu , Shentong Mo , Xiang Yang , Muhammad Awais , Sara Atito , Xingshen Zhang , Lin Wang , Xiang Yang

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

Machine Learning · Computer Science 2024-01-08 Ahmed Salah , David Yevick

Motivation: Despite advances in the computational analysis of high-throughput molecular profiling assays (e.g. transcriptomics), a dichotomy exists between methods that are simple and interpretable, and ones that are complex but with lower…

Machine Learning · Computer Science 2023-06-12 Pedro Henrique da Costa Avelar , Min Wu , Sophia Tsoka

Deep learning (DL) methods where interpretability is intrinsically considered as part of the model are required to better understand the relationship of clinical and imaging-based attributes with DL outcomes, thus facilitating their use in…

Image and Video Processing · Electrical Eng. & Systems 2022-12-13 Irem Cetin , Maialen Stephens , Oscar Camara , Miguel Angel Gonzalez Ballester

Learning useful representations without supervision remains a key challenge in machine learning. In this paper, we propose a simple yet powerful generative model that learns such discrete representations. Our model, the Vector…

Machine Learning · Computer Science 2018-05-31 Aaron van den Oord , Oriol Vinyals , Koray Kavukcuoglu