English
Related papers

Related papers: Gaussian Process Prior Variational Autoencoders

200 papers

Variational autoencoder (VAE) is a deep generative model for unsupervised learning, allowing to encode observations into the meaningful latent space. VAE is prone to catastrophic forgetting when tasks arrive sequentially, and only the data…

Machine Learning · Computer Science 2021-11-04 Anna Kuzina , Evgenii Egorov , Evgeny Burnaev

We would like to learn latent representations that are low-dimensional and highly interpretable. A model that has these characteristics is the Gaussian Process Latent Variable Model. The benefits and negative of the GP-LVM are complementary…

Machine Learning · Statistics 2017-12-19 Erik Bodin , Iman Malik , Carl Henrik Ek , Neill D. F. Campbell

The Variational Autoencoder (VAE) is a powerful architecture capable of representation learning and generative modeling. When it comes to learning interpretable (disentangled) representations, VAE and its variants show unparalleled…

Machine Learning · Computer Science 2019-04-17 Michal Rolinek , Dominik Zietlow , Georg Martius

It is crucial to choose actions from an appropriate distribution while learning a sequential decision-making process in which a set of actions is expected given the states and previous reward. Yet, if there are more than two latent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Fatemeh Nouri , Robert Bergevin

Vector Quantized-Variational AutoEncoders (VQ-VAE) are generative models based on discrete latent representations of the data, where inputs are mapped to a finite set of learned embeddings.To generate new samples, an autoregressive prior…

Machine Learning · Statistics 2022-08-04 Max Cohen , Guillaume Quispe , Sylvain Le Corff , Charles Ollion , Eric Moulines

The rising use of machine learning in various fields requires robust methods to create synthetic tabular data. Data should preserve key characteristics while addressing data scarcity challenges. Current approaches based on Generative…

Machine Learning · Computer Science 2024-11-15 Patricia A. Apellániz , Juan Parras , Santiago Zazo

The variational autoencoder (VAE) is a popular probabilistic generative model. However, one shortcoming of VAEs is that the latent variables cannot be discrete, which makes it difficult to generate data from different modes of a…

Machine Learning · Statistics 2017-11-21 Jay A. Hennig , Akash Umakantha , Ryan C. Williamson

Modern machine learning systems achieve great success when trained on large datasets. However, these datasets usually contain sensitive information (e.g. medical records, face images), leading to serious privacy concerns. Differentially…

Machine Learning · Computer Science 2022-11-04 Dihong Jiang , Guojun Zhang , Mahdi Karami , Xi Chen , Yunfeng Shao , Yaoliang Yu

VAEs (Variational AutoEncoders) have proved to be powerful in the context of density modeling and have been used in a variety of contexts for creative purposes. In many settings, the data we model possesses continuous attributes that we…

Machine Learning · Computer Science 2017-07-18 Gaëtan Hadjeres , Frank Nielsen , François Pachet

Multivariate time series with missing values are common in areas such as healthcare and finance, and have grown in number and complexity over the years. This raises the question whether deep learning methodologies can outperform classical…

Machine Learning · Statistics 2020-02-21 Vincent Fortuin , Dmitry Baranchuk , Gunnar Rätsch , Stephan Mandt

The Variational Auto-Encoder (VAE) is a simple, efficient, and popular deep maximum likelihood model. Though usage of VAEs is widespread, the derivation of the VAE is not as widely understood. In this tutorial, we will provide an overview…

Machine Learning · Computer Science 2020-07-02 Ronald Yu

Deep generative models have achieved impressive success in recent years. Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), as emerging families for generative model learning, have largely been considered as two…

Machine Learning · Computer Science 2018-07-12 Zhiting Hu , Zichao Yang , Ruslan Salakhutdinov , Eric P. Xing

In large studies involving multi protocol Magnetic Resonance Imaging (MRI), it can occur to miss one or more sub-modalities for a given patient owing to poor quality (e.g. imaging artifacts), failed acquisitions, or hallway interrupted…

Image and Video Processing · Electrical Eng. & Systems 2021-07-09 Mohammad Hamghalam , Alejandro F. Frangi , Baiying Lei , Amber L. Simpson

Variational autoencoders often assume isotropic Gaussian priors and mean-field posteriors, hence do not exploit structure in scenarios where we may expect similarity or consistency across latent variables. Gaussian process variational…

Machine Learning · Statistics 2020-11-17 Metod Jazbec , Michael Pearce , Vincent Fortuin

The Gaussian process (GP) regression model is a widely employed surrogate modeling technique for computer experiments, offering precise predictions and statistical inference for the computer simulators that generate experimental data.…

Methodology · Statistics 2024-04-02 Lulu Kang , Yuanxing Cheng , Yiwei Wang , Chun Liu

In this paper, we present a novel approach for training a Variational Autoencoder (VAE) on a highly imbalanced data set. The proposed training of a high-resolution VAE model begins with the training of a low-resolution core model, which can…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Dmitry Utyamishev , Inna Partin-Vaisband

Recent state-of-the-art autoencoder based generative models have an encoder-decoder structure and learn a latent representation with a pre-defined distribution that can be sampled from. Implementing the encoder networks of these models in a…

Machine Learning · Computer Science 2020-05-11 D. T. Braithwaite , M. O'Connor , W. B. Kleijn

Bayesian optimisation in the latent space of a Variational AutoEncoder (VAE) is a powerful framework for optimisation tasks over complex structured domains, such as the space of scientifically interesting molecules. However, existing…

Machine Learning · Computer Science 2025-07-08 Henry B. Moss , Sebastian W. Ober , Tom Diethe

With the development of deep learning techniques, the combination of deep learning with image compression has drawn lots of attention. Recently, learned image compression methods had exceeded their classical counterparts in terms of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-03 Ze Cui , Jing Wang , Shangyin Gao , Bo Bai , Tiansheng Guo , Yihui Feng

Optimal computations under uncertainty require an adequate probabilistic representation about beliefs. Deep generative models, and specifically Variational Autoencoders (VAEs), have the potential to meet this demand by building latent…