中文
相关论文

相关论文: On Posterior Collapse and Encoder Feature Dispersi…

200 篇论文

The key idea of variational auto-encoders (VAEs) resembles that of traditional auto-encoder models in which spatial information is supposed to be explicitly encoded in the latent space. However, the latent variables in VAEs are vectors,…

机器学习 · 计算机科学 2019-01-23 Zhengyang Wang , Hao Yuan , Shuiwang Ji

Variational auto-encoders (VAEs) are deep generative latent variable models that can be used for learning the distribution of complex data. VAEs have been successfully used to learn a probabilistic prior over speech signals, which is then…

声音 · 计算机科学 2020-12-18 Mostafa Sadeghi , Simon Leglaive , Xavier Alameda-PIneda , Laurent Girin , Radu Horaud

Disentangling content and speaking style information is essential for zero-shot non-parallel voice conversion (VC). Our previous study investigated a novel framework with disentangled sequential variational autoencoder (DSVAE) as the…

音频与语音处理 · 电气工程与系统科学 2022-06-22 Jiachen Lian , Chunlei Zhang , Gopala Krishna Anumanchipalli , Dong Yu

Variational auto-encoders (VAEs) are a powerful approach to unsupervised learning. They enable scalable approximate posterior inference in latent-variable models using variational inference (VI). A VAE posits a variational family…

机器学习 · 计算机科学 2022-06-08 Samarth Sinha , Adji B. Dieng

Variational autoencoder-based voice conversion (VAE-VC) has the advantage of requiring only pairs of speeches and speaker labels for training. Unlike the majority of the research in VAE-VC which focuses on utilizing auxiliary losses or…

声音 · 计算机科学 2021-12-07 Kei Akuzawa , Kotaro Onishi , Keisuke Takiguchi , Kohki Mametani , Koichiro Mori

Multimodal variational autoencoders (VAEs) are widely used for weakly supervised generative learning with multiple modalities. Predominant methods aggregate unimodal inference distributions using either a product of experts (PoE), a mixture…

机器学习 · 计算机科学 2026-04-01 Huyen Vo , Isabel Valera

Learning disentangled representations of real-world data is a challenging open problem. Most previous methods have focused on either supervised approaches which use attribute labels or unsupervised approaches that manipulate the…

计算与语言 · 计算机科学 2021-01-26 Vikash Balasubramanian , Ivan Kobyzev , Hareesh Bahuleyan , Ilya Shapiro , Olga Vechtomova

Selective manipulation of data attributes using deep generative models is an active area of research. In this paper, we present a novel method to structure the latent space of a Variational Auto-Encoder (VAE) to encode different…

机器学习 · 计算机科学 2020-07-30 Ashis Pati , Alexander Lerch

In this paper, we present an in-depth investigation of the convolutional autoencoder (CAE) bottleneck. Autoencoders (AE), and especially their convolutional variants, play a vital role in the current deep learning toolbox. Researchers and…

机器学习 · 计算机科学 2020-05-14 Ilja Manakov , Markus Rohm , Volker Tresp

We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs…

机器学习 · 计算机科学 2025-11-25 Shichen Cao , Jingjing Li , Kenric P. Nelson , Mark A. Kon

Variational autoencoders (VAEs) are powerful generative modelling methods, however they suffer from blurry generated samples and reconstructions compared to the images they have been trained on. Significant research effort has been spent to…

计算机视觉与模式识别 · 计算机科学 2023-04-13 Gustav Bredell , Kyriakos Flouris , Krishna Chaitanya , Ertunc Erdil , Ender Konukoglu

Variational Auto-Encoder (VAE) has been widely applied as a fundamental generative model in machine learning. For complex samples like imagery objects or scenes, however, VAE suffers from the dimensional dilemma between reconstruction…

机器学习 · 计算机科学 2020-02-18 Deli Zhao , Jiapeng Zhu , Bo Zhang

One noted issue of vector-quantized variational autoencoder (VQ-VAE) is that the learned discrete representation uses only a fraction of the full capacity of the codebook, also known as codebook collapse. We hypothesize that the training…

Probabilistic generative models are attractive for scientific modeling because their inferred parameters can be used to generate hypotheses and design experiments. This requires that the learned model provide an accurate representation of…

机器学习 · 统计学 2023-01-18 Liyun Tu , Austin Talbot , Neil Gallagher , David Carlson

Variational Autoencoder (VAE) aims to compress pixel data into low-dimensional latent space, playing an important role in OpenAI's Sora and other latent video diffusion generation models. While most of existing video VAEs inflate a…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Pingyu Wu , Kai Zhu , Yu Liu , Liming Zhao , Wei Zhai , Yang Cao , Zheng-Jun Zha

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

机器学习 · 统计学 2023-05-12 Daniel G. Edelberg , Roy R. Lederman

The standard approach for neural topic modeling uses a variational autoencoder (VAE) framework that jointly minimizes the KL divergence between the estimated posterior and prior, in addition to the reconstruction loss. Since neural topic…

计算与语言 · 计算机科学 2023-05-29 Raymond Li , Felipe González-Pizarro , Linzi Xing , Gabriel Murray , Giuseppe Carenini

Variational autoencoders (VAEs) are a popular framework for modeling complex data distributions; they can be efficiently trained via variational inference by maximizing the evidence lower bound (ELBO), at the expense of a gap to the exact…

It has been previously observed that training Variational Recurrent Autoencoders (VRAE) for text generation suffers from serious uninformative latent variables problem. The model would collapse into a plain language model that totally…

计算与语言 · 计算机科学 2019-11-20 Dayiheng Liu , Xu Yang , Feng He , Yuanyuan Chen , Jiancheng Lv

Current state-of-the-art generative approaches frequently rely on a two-stage training procedure, where an autoencoder (often a VAE) first performs dimensionality reduction, followed by training a generative model on the learned latent…

机器学习 · 统计学 2025-07-15 Gianluigi Silvestri , Luca Ambrogioni