中文
相关论文

相关论文: Neural Gaussian Copula for Variational Autoencoder

200 篇论文

Variational auto-encoders (VAE) are popular deep latent variable models which are trained by maximizing an Evidence Lower Bound (ELBO). To obtain tighter ELBO and hence better variational approximations, it has been proposed to use…

机器学习 · 统计学 2021-07-22 Achille Thin , Nikita Kotelevskii , Arnaud Doucet , Alain Durmus , Eric Moulines , Maxim Panov

Variational autoencoder (VAE) is a widely used generative model for learning latent representations. Burda et al. in their seminal paper showed that learning capacity of VAE is limited by over-pruning. It is a phenomenon where a significant…

机器学习 · 计算机科学 2020-08-10 Rayyan Ahmad Khan , Muhammad Umer Anwaar , Martin Kleinsteuber

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Learning useful representations without supervision remains a key challenge in machine learning. In this paper, we propose a simple yet powerful generative model that learns such discrete representations. Our model, the Vector…

机器学习 · 计算机科学 2018-05-31 Aaron van den Oord , Oriol Vinyals , Koray Kavukcuoglu

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

机器学习 · 统计学 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Xianxu Hou , Linlin Shen , Ke Sun , Guoping Qiu

The standard approach for neural topic modeling uses a variational autoencoder (VAE) framework that jointly minimizes the KL divergence between the estimated posterior and prior, in addition to the reconstruction loss. Since neural topic…

计算与语言 · 计算机科学 2023-05-29 Raymond Li , Felipe González-Pizarro , Linzi Xing , Gabriel Murray , Giuseppe Carenini

Variational autoencoders (VAEs) are one of the powerful likelihood-based generative models with applications in many domains. However, they struggle to generate high-quality images, especially when samples are obtained from the prior…

机器学习 · 计算机科学 2021-11-05 Jyoti Aneja , Alexander Schwing , Jan Kautz , Arash Vahdat

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

机器学习 · 统计学 2023-05-12 Daniel G. Edelberg , Roy R. Lederman

Deep generative models are commonly used for generating images and text. Interpretability of these models is one important pursuit, other than the generation quality. Variational auto-encoder (VAE) with Gaussian distribution as prior has…

机器学习 · 计算机科学 2020-08-24 Wenxian Shi , Hao Zhou , Ning Miao , Lei Li

Variational autoencoders often assume isotropic Gaussian priors and mean-field posteriors, hence do not exploit structure in scenarios where we may expect similarity or consistency across latent variables. Gaussian process variational…

机器学习 · 统计学 2020-11-17 Metod Jazbec , Michael Pearce , Vincent Fortuin

The recently proposed identifiable variational autoencoder (iVAE) framework provides a promising approach for learning latent independent components (ICs). iVAEs use auxiliary covariates to build an identifiable generation structure from…

机器学习 · 统计学 2022-10-17 Young-geun Kim , Ying Liu , Xuexin Wei

Learning disentanglement aims at finding a low dimensional representation which consists of multiple explanatory and generative factors of the observational data. The framework of variational autoencoder (VAE) is commonly used to…

机器学习 · 计算机科学 2023-12-20 Mengyue Yang , Furui Liu , Zhitang Chen , Xinwei Shen , Jianye Hao , Jun Wang

As deep Variational Auto-Encoder (VAE) frameworks become more widely used for modeling biomolecular simulation data, we emphasize the capability of the VAE architecture to concurrently maximize the timescale of the latent space while…

化学物理 · 物理学 2021-12-08 Hannah K. Wayment-Steele , Vijay S. Pande

A new form of the variational autoencoder (VAE) is proposed, based on the symmetric Kullback-Leibler divergence. It is demonstrated that learning of the resulting symmetric VAE (sVAE) has close connections to previously developed…

机器学习 · 统计学 2017-10-23 Liqun Chen , Shuyang Dai , Yunchen Pu , Chunyuan Li , Qinliang Su , Lawrence Carin

Variational Autoencoder (VAE)-based generative models offer flexible representation learning by incorporating meta-priors, general premises considered beneficial for downstream tasks. However, the incorporated meta-priors often involve…

机器学习 · 计算机科学 2023-02-27 Nao Nakagawa , Ren Togo , Takahiro Ogawa , Miki Haseyama

One noted issue of vector-quantized variational autoencoder (VQ-VAE) is that the learned discrete representation uses only a fraction of the full capacity of the codebook, also known as codebook collapse. We hypothesize that the training…

Variational Auto-encoders (VAEs) are deep generative latent variable models that are widely used for a number of downstream tasks. While it has been demonstrated that VAE training can suffer from a number of pathologies, existing literature…

机器学习 · 统计学 2022-03-17 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

The variational autoencoder (VAE) framework remains a popular option for training unsupervised generative models, especially for discrete data where generative adversarial networks (GANs) require workaround to create gradient for the…

机器学习 · 计算机科学 2019-04-24 Jason Chou , Gautam Hathi

Variational Autoencoder (VAE), a simple and effective deep generative model, has led to a number of impressive empirical successes and spawned many advanced variants and theoretical investigations. However, recent studies demonstrate that,…

机器学习 · 计算机科学 2019-01-08 Xuezhe Ma , Chunting Zhou , Eduard Hovy