中文
相关论文

相关论文: Generalizing Variational Autoencoders with Hierarc…

200 篇论文

In variational autoencoders (VAEs), the variational posterior often collapses to the prior, known as posterior collapse, which leads to poor representation learning quality. An adjustable hyperparameter beta has been introduced in VAEs to…

机器学习 · 统计学 2025-07-22 Yuma Ichikawa , Koji Hukushima

The variational autoencoder (VAE) framework is a popular option for training unsupervised generative models, featuring ease of training and latent representation of data. The objective function of VAE does not guarantee to achieve the…

机器学习 · 计算机科学 2019-04-25 Jason Chou

Multimodal variational autoencoders (VAEs) are widely used for weakly supervised generative learning with multiple modalities. Predominant methods aggregate unimodal inference distributions using either a product of experts (PoE), a mixture…

机器学习 · 计算机科学 2026-04-01 Huyen Vo , Isabel Valera

Successfully training Variational Autoencoders (VAEs) with a hierarchy of discrete latent variables remains an area of active research. Vector-Quantised VAEs are a powerful approach to discrete VAEs, but naive hierarchical extensions can be…

机器学习 · 统计学 2021-02-05 Matthew Willetts , Xenia Miscouridou , Stephen Roberts , Chris Holmes

Variational autoencoders (VAEs) face a notorious problem wherein the variational posterior often aligns closely with the prior, a phenomenon known as posterior collapse, which hinders the quality of representation learning. To mitigate this…

机器学习 · 统计学 2023-10-25 Yuma Ichikawa , Koji Hukushima

Variational Auto-encoders (VAEs) are deep generative latent variable models consisting of two components: a generative model that captures a data distribution p(x) by transforming a distribution p(z) over latent space, and an inference…

机器学习 · 计算机科学 2022-08-25 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

Being one of the most popular generative framework, variational autoencoders(VAE) are known to suffer from a phenomenon termed posterior collapse, i.e. the latent variational distributions collapse to the prior, especially when a strong…

机器学习 · 计算机科学 2021-03-23 Renfei Tu , Yang Liu , Yongzeng Xue , Cheng Wang , Maozu Guo

The variational autoencoder (VAE) is a well-studied, deep, latent-variable model (DLVM) that efficiently optimizes the variational lower bound of the log marginal data likelihood and has a strong theoretical foundation. However, the VAE's…

机器学习 · 计算机科学 2024-10-08 Surojit Saha , Sarang Joshi , Ross Whitaker

We consider the problem of learning Variational Autoencoders (VAEs), i.e., a type of deep generative model, from data with missing values. Such data is omnipresent in real-world applications of machine learning because complete data is…

机器学习 · 计算机科学 2023-10-26 Timur Sudak , Sebastian Tschiatschek

Current state-of-the-art generative approaches frequently rely on a two-stage training procedure, where an autoencoder (often a VAE) first performs dimensionality reduction, followed by training a generative model on the learned latent…

机器学习 · 统计学 2025-07-15 Gianluigi Silvestri , Luca Ambrogioni

Traditional Variational Autoencoders (VAEs) are constrained by the limitations of the Evidence Lower Bound (ELBO) formulation, particularly when utilizing simplistic, non-analytic, or unknown prior distributions. These limitations inhibit…

机器学习 · 计算机科学 2024-07-10 Fotios Lygerakis , Elmar Rueckert

Purpose: Handling heterogeneous and mixed data types has become increasingly critical with the exponential growth in real-world databases. While deep generative models attempt to merge diverse data views into a common latent space, they…

Variational autoencoders (VAEs) are deep probabilistic models that are used in scientific applications. Many works try to mitigate this problem from the probabilistic methods perspective by new inference techniques or training procedures.…

机器学习 · 统计学 2024-12-24 Tim Z. Xiao , Johannes Zenn , Robert Bamler

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. We develop three variations on VAEs by introducing a second parameterized encoder/decoder pair and,…

机器学习 · 计算机科学 2023-04-06 R. I. Cukier

Inference for Variational Autoencoders (VAEs) consists of learning two models: (1) a generative model, which transforms a simple distribution over a latent space into the distribution over observed data, and (2) an inference model, which…

机器学习 · 统计学 2024-06-14 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

Variational auto-encoders (VAEs) are a powerful approach to unsupervised learning. They enable scalable approximate posterior inference in latent-variable models using variational inference (VI). A VAE posits a variational family…

机器学习 · 计算机科学 2022-06-08 Samarth Sinha , Adji B. Dieng

Variational autoencoders (VAEs) provide an effective and simple method for modeling complex distributions. However, training VAEs often requires considerable hyperparameter tuning to determine the optimal amount of information retained by…

机器学习 · 计算机科学 2021-07-13 Oleh Rybkin , Kostas Daniilidis , Sergey Levine

Optimal computations under uncertainty require an adequate probabilistic representation about beliefs. Deep generative models, and specifically Variational Autoencoders (VAEs), have the potential to meet this demand by building latent…

Learning latent representations that are simultaneously expressive, geometrically well-structured, and reliably calibrated remains a central challenge for Variational Autoencoders (VAEs). Standard VAEs typically assume a diagonal Gaussian…

机器学习 · 计算机科学 2025-12-02 Mehmet Can Yavuz

An implicit goal in works on deep generative models is that such models should be able to generate novel examples that were not previously seen in the training data. In this paper, we investigate to what extent this property holds for…

机器学习 · 计算机科学 2018-12-27 Alican Bozkurt , Babak Esmaeili , Dana H. Brooks , Jennifer G. Dy , Jan-Willem van de Meent