中文
相关论文

相关论文: How do Variational Autoencoders Learn? Insights fr…

200 篇论文

Variational Autoencoders (VAEs) have been shown to be remarkably effective in recovering model latent spaces for several computer vision tasks. However, currently trained VAEs, for a number of reasons, seem to fall short in learning…

机器学习 · 计算机科学 2021-07-27 Chandrajit Bajaj , Avik Roy , Haoran Zhang

Intelligent behaviour in the real-world requires the ability to acquire new knowledge from an ongoing sequence of experiences while preserving and reusing past knowledge. We propose a novel algorithm for unsupervised representation learning…

We develop data-driven methods for incorporating physical information for priors to learn parsimonious representations of nonlinear systems arising from parameterized PDEs and mechanics. Our approach is based on Variational Autoencoders…

机器学习 · 计算机科学 2021-03-17 Ryan Lopez , Paul J. Atzberger

In this paper, we study two aspects of the variational autoencoder (VAE): the prior distribution over the latent variables and its corresponding posterior. First, we decompose the learning of VAEs into layerwise density estimation, and…

Understanding the latent spaces learned by deep learning models is crucial in exploring how they represent and generate complex data. Autoencoders (AEs) have played a key role in the area of representation learning, with numerous…

机器学习 · 计算机科学 2025-01-17 Anika Shrivastava , Renu Rameshan , Samar Agnihotri

Variational Autoencoders (VAE) and their variants have been widely used in a variety of applications, such as dialog generation, image generation and disentangled representation learning. However, the existing VAE models have some…

机器学习 · 计算机科学 2020-06-23 Huajie Shao , Shuochao Yao , Dachun Sun , Aston Zhang , Shengzhong Liu , Dongxin Liu , Jun Wang , Tarek Abdelzaher

$\beta$-VAE is a follow-up technique to variational autoencoders that proposes special weighting of the KL divergence term in the VAE loss to obtain disentangled representations. Unsupervised learning is known to be brittle even on toy…

机器学习 · 计算机科学 2022-01-03 Miroslav Fil , Munib Mesinovic , Matthew Morris , Jonas Wildberger

Variational Autoencoders (VAEs) have become a popular approach for dimensionality reduction. However, despite their ability to identify latent low-dimensional structures embedded within high-dimensional data, these latent representations…

机器学习 · 统计学 2020-08-27 Kaspar Märtens , Christopher Yau

A large part of the literature on learning disentangled representations focuses on variational autoencoders (VAE). Recent developments demonstrate that disentanglement cannot be obtained in a fully unsupervised setting without inductive…

机器学习 · 计算机科学 2021-02-11 Graziano Mita , Maurizio Filippone , Pietro Michiardi

A new form of variational autoencoder (VAE) is developed, in which the joint distribution of data and codes is considered in two (symmetric) forms: ($i$) from observed data fed through the encoder to yield codes, and ($ii$) from latent…

机器学习 · 计算机科学 2017-11-21 Yunchen Pu , Weiyao Wang , Ricardo Henao , Liqun Chen , Zhe Gan , Chunyuan Li , Lawrence Carin

A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a disentangled…

机器学习 · 计算机科学 2020-03-23 Luis A. Pérez Rey

Learning disentangled representations without supervision or inductive biases, often leads to non-interpretable or undesirable representations. On the other hand, strict supervision requires detailed knowledge of the true generative…

机器学习 · 计算机科学 2020-08-25 Vasilis Margonis , Athanasios Davvetas , Iraklis A. Klampanos

The recently proposed identifiable variational autoencoder (iVAE) framework provides a promising approach for learning latent independent components (ICs). iVAEs use auxiliary covariates to build an identifiable generation structure from…

机器学习 · 统计学 2022-10-17 Young-geun Kim , Ying Liu , Xuexin Wei

Disentangled representation learning aims to learn low-dimensional representations where each dimension corresponds to an underlying generative factor. While the Variational Auto-Encoder (VAE) is widely used for this purpose, most existing…

机器学习 · 计算机科学 2024-12-31 Di Fan , Yannian Kou , Chuanhou Gao

Variational autoencoders (VAEs) have received much attention recently as an end-to-end architecture for text generation with latent variables. In this paper, we investigate several multi-level structures to learn a VAE model to generate…

计算与语言 · 计算机科学 2019-06-21 Dinghan Shen , Asli Celikyilmaz , Yizhe Zhang , Liqun Chen , Xin Wang , Jianfeng Gao , Lawrence Carin

Variational Autoencoders (VAEs) are powerful in data representation inference, but it cannot learn relations between features with its vanilla form and common variations. The ability to capture relations within data can provide the much…

机器学习 · 计算机科学 2020-07-23 Chen Wang , Chengyuan Deng , Vladimir Ivanov

Variational autoencoders (VAEs) hold great potential for modelling text, as they could in theory separate high-level semantic and syntactic properties from local regularities of natural language. Practically, however, VAEs with…

机器学习 · 计算机科学 2020-11-11 Teng Long , Yanshuai Cao , Jackie Chi Kit Cheung

Semi-supervised learning is attracting increasing attention due to the fact that datasets of many domains lack enough labeled data. Variational Auto-Encoder (VAE), in particular, has demonstrated the benefits of semi-supervised learning.…

机器学习 · 计算机科学 2018-12-04 Yang Li , Quan Pan , Suhang Wang , Haiyun Peng , Tao Yang , Erik Cambria

Structured variational autoencoders (SVAEs) combine probabilistic graphical model priors on latent variables, deep neural networks to link latent variables to observed data, and structure-exploiting algorithms for approximate posterior…

机器学习 · 统计学 2023-05-29 Yixiu Zhao , Scott W. Linderman

We propose a sequential variational autoencoder to learn disentangled representations of sequential data (e.g., videos and audios) under self-supervision. Specifically, we exploit the benefits of some readily accessible supervisory signals…

计算机视觉与模式识别 · 计算机科学 2020-05-26 Yizhe Zhu , Martin Renqiang Min , Asim Kadav , Hans Peter Graf