中文
相关论文

相关论文: BooVAE: Boosting Approach for Continual Learning o…

200 篇论文

The Variational Autoencoder (VAE) is a popular and powerful model applied to text modelling to generate diverse sentences. However, an issue known as posterior collapse (or KL loss vanishing) happens when the VAE is used in text modelling,…

计算与语言 · 计算机科学 2020-11-04 Ruizhe Li , Xiao Li , Guanyi Chen , Chenghua Lin

Variational auto-encoders (VAEs) provide an attractive solution to image generation problem. However, they tend to produce blurred and over-smoothed images due to their dependence on pixel-wise reconstruction loss. This paper introduces a…

计算机视觉与模式识别 · 计算机科学 2018-04-30 Salman H. Khan , Munawar Hayat , Nick Barnes

With the introduction of the variational autoencoder (VAE), probabilistic latent variable models have received renewed attention as powerful generative models. However, their performance in terms of test likelihood and quality of generated…

机器学习 · 统计学 2020-01-13 Lars Maaløe , Marco Fraccaro , Valentin Liévin , Ole Winther

Using a discriminative representation obtained by supervised deep learning methods showed promising results on diverse Content-Based Image Retrieval (CBIR) problems. However, existing methods exploiting labels during training try to…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Mehdi Rafiei , Alexandros Iosifidis

Continual learning refers to the ability to acquire and transfer knowledge without catastrophically forgetting what was previously learned. In this work, we consider \emph{few-shot} continual learning in classification tasks, and we propose…

计算机视觉与模式识别 · 计算机科学 2020-02-18 Mengmi Zhang , Tao Wang , Joo Hwee Lim , Gabriel Kreiman , Jiashi Feng

Auto-encoding Variational Bayes (AEVB) is a powerful and general algorithm for fitting latent variable models (a promising direction for unsupervised learning), and is well-known for training the Variational Auto-Encoder (VAE). In this…

机器学习 · 计算机科学 2022-08-17 Yang Zhi-Han

Variational autoencoder (VAE) is a widely used generative model for learning latent representations. Burda et al. in their seminal paper showed that learning capacity of VAE is limited by over-pruning. It is a phenomenon where a significant…

机器学习 · 计算机科学 2020-08-10 Rayyan Ahmad Khan , Muhammad Umer Anwaar , Martin Kleinsteuber

The ability of Variational Autoencoders (VAEs) to learn disentangled representations has made them popular for practical applications. However, their behaviour is not yet fully understood. For example, the questions of when they can provide…

机器学习 · 计算机科学 2022-09-27 Lisa Bonheme , Marek Grzes

In this paper, we are interested in unsupervised (unknown noise) audio-visual speech enhancement based on variational autoencoders (VAEs), where the probability distribution of clean speech spectra is simulated using an encoder-decoder…

音频与语音处理 · 电气工程与系统科学 2021-03-10 Mostafa Sadeghi , Xavier Alameda-Pineda

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amortized approaches were…

机器学习 · 计算机科学 2020-11-18 Minyoung Kim , Vladimir Pavlovic

The variational auto-encoder (VAE) is a deep latent variable model that has two neural networks in an autoencoder-like architecture; one of them parameterizes the model's likelihood. Fitting its parameters via maximum likelihood (ML) is…

机器学习 · 计算机科学 2021-06-03 Francisco J. R. Ruiz , Michalis K. Titsias , Taylan Cemgil , Arnaud Doucet

The posterior collapse phenomenon in variational autoencoder (VAE), where the variational posterior distribution closely matches the prior distribution, can hinder the quality of the learned latent variables. As a consequence of posterior…

机器学习 · 统计学 2024-05-14 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

Purpose: Handling heterogeneous and mixed data types has become increasingly critical with the exponential growth in real-world databases. While deep generative models attempt to merge diverse data views into a common latent space, they…

The variational autoencoder (VAE) is a powerful generative model that can estimate the probability of a data point by using latent variables. In the VAE, the posterior of the latent variable given the data point is regularized by the prior…

机器学习 · 统计学 2019-12-30 Hiroshi Takahashi , Tomoharu Iwata , Yuki Yamanaka , Masanori Yamada , Satoshi Yagi

In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function…

机器学习 · 统计学 2021-01-05 Carl Doersch

One of the major shortcomings of variational autoencoders is the inability to produce generations from the individual modalities of data originating from mixture distributions. This is primarily due to the use of a simple isotropic Gaussian…

机器学习 · 计算机科学 2019-12-02 Frantzeska Lavda , Magda Gregorová , Alexandros Kalousis

Variational autoencoders (VAEs) employ Bayesian inference to interpret sensory inputs, mirroring processes that occur in primate vision across both ventral (Higgins et al., 2021) and dorsal (Vafaii et al., 2023) pathways. Despite their…

机器学习 · 计算机科学 2024-12-10 Hadi Vafaii , Dekel Galor , Jacob L. Yates

When trained effectively, the Variational Autoencoder (VAE) is both a powerful language model and an effective representation learning framework. In practice, however, VAEs are trained with the evidence lower bound (ELBO) as a surrogate…

机器学习 · 计算机科学 2019-09-04 Bohan Li , Junxian He , Graham Neubig , Taylor Berg-Kirkpatrick , Yiming Yang

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Xianxu Hou , Linlin Shen , Ke Sun , Guoping Qiu

Variational Auto-encoders (VAEs) have been very successful as methods for forming compressed latent representations of complex, often high-dimensional, data. In this paper, we derive an alternative variational lower bound from the one…

机器学习 · 计算机科学 2019-03-20 Shuyu Lin , Ronald Clark , Robert Birke , Niki Trigoni , Stephen Roberts