中文
相关论文

相关论文: Preventing Oversmoothing in VAE via Generalized Va…

200 篇论文

We address the problem of one-to-many mappings in supervised learning, where a single instance has many different solutions of possibly equal cost. The framework of conditional variational autoencoders describes a class of methods to tackle…

机器学习 · 统计学 2019-09-11 Alexej Klushyn , Nutan Chen , Botond Cseke , Justin Bayer , Patrick van der Smagt

Variational Auto-Encoder (VAE) has been widely applied as a fundamental generative model in machine learning. For complex samples like imagery objects or scenes, however, VAE suffers from the dimensional dilemma between reconstruction…

机器学习 · 计算机科学 2020-02-18 Deli Zhao , Jiapeng Zhu , Bo Zhang

Due to their unsupervised training and uncertainty estimation, deep Variational Autoencoders (VAEs) have become powerful tools for reconstruction-based Time Series Anomaly Detection (TSAD). Existing VAE-based TSAD methods, either…

机器学习 · 计算机科学 2024-01-09 Zhangkai Wu , Longbing Cao , Qi Zhang , Junxian Zhou , Hui Chen

Variational autoencoders (VAEs) are one of the deep generative models that have experienced enormous success over the past decades. However, in practice, they suffer from a problem called posterior collapse, which occurs when the encoder…

机器学习 · 计算机科学 2024-02-06 Yuri Kinoshita , Kenta Oono , Kenji Fukumizu , Yuichi Yoshida , Shin-ichi Maeda

Does a Variational AutoEncoder (VAE) consistently encode typical samples generated from its decoder? This paper shows that the perhaps surprising answer to this question is `No'; a (nominally trained) VAE does not necessarily amortize…

机器学习 · 计算机科学 2020-12-08 A. Taylan Cemgil , Sumedh Ghaisas , Krishnamurthy Dvijotham , Sven Gowal , Pushmeet Kohli

Recent state-of-the-art autoencoder based generative models have an encoder-decoder structure and learn a latent representation with a pre-defined distribution that can be sampled from. Implementing the encoder networks of these models in a…

机器学习 · 计算机科学 2020-05-11 D. T. Braithwaite , M. O'Connor , W. B. Kleijn

We propose a new family of optimization criteria for variational auto-encoding models, generalizing the standard evidence lower bound. We provide conditions under which they recover the data distribution and learn latent features, and…

机器学习 · 计算机科学 2017-03-01 Shengjia Zhao , Jiaming Song , Stefano Ermon

The variational autoencoder (VAE) typically employs a standard normal prior as a regularizer for the probabilistic latent encoder. However, the Gaussian tail often decays too quickly to effectively accommodate the encoded points, failing to…

机器学习 · 统计学 2024-03-05 Juno Kim , Jaehyuk Kwon , Mincheol Cho , Hyunjong Lee , Joong-Ho Won

In this paper, we consider variational autoencoders (VAE) for general state space models. We consider a backward factorization of the variational distributions to analyze the excess risk associated with VAE. Such backward factorizations…

统计方法学 · 统计学 2023-12-18 Élisabeth Gassiat , Sylvain Le Corff

Variational autoencoders (VAEs) are one of the powerful likelihood-based generative models with applications in many domains. However, they struggle to generate high-quality images, especially when samples are obtained from the prior…

机器学习 · 计算机科学 2021-11-05 Jyoti Aneja , Alexander Schwing , Jan Kautz , Arash Vahdat

VAE, or variational auto-encoder, compresses data into latent attributes, and generates new data of different varieties. VAE based on KL divergence has been considered as an effective technique for data augmentation. In this paper, we…

机器学习 · 计算机科学 2022-08-17 Zichuan Chen , Peng Liu

We propose a new method for unsupervised generative continual learning through realignment of Variational Autoencoder's latent space. Deep generative models suffer from catastrophic forgetting in the same way as other neural structures.…

机器学习 · 计算机科学 2022-06-06 Kamil Deja , Paweł Wawrzyński , Wojciech Masarczyk , Daniel Marczak , Tomasz Trzciński

Variational autoencoder (VAE) is one of the most common techniques in the field of medical image generation, where this architecture has shown advanced researchers in recent years and has developed into various architectures. VAE has…

机器学习 · 计算机科学 2024-11-13 Khadija Rais , Mohamed Amroune , Abdelmadjid Benmachiche , Mohamed Yassine Haouam

Variational Auto-Encoders (VAEs) are capable of learning latent representations for high dimensional data. However, due to the i.i.d. assumption, VAEs only optimize the singleton variational distributions and fail to account for the…

机器学习 · 计算机科学 2020-04-20 Da Tang , Dawen Liang , Tony Jebara , Nicholas Ruozzi

Variational Autoencoders (VAEs) are powerful generative models capable of learning compact latent representations. However, conventional VAEs often generate relatively blurry images due to their assumption of an isotropic Gaussian latent…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Andrew Kiruluta

The latent variables learned by VAEs have seen considerable interest as an unsupervised way of extracting features, which can then be used for downstream tasks. There is a growing interest in the question of whether features learned on one…

机器学习 · 计算机科学 2020-05-13 Saeid Asgari Taghanaki , Mohammad Havaei , Alex Lamb , Aditya Sanghi , Ara Danielyan , Tonya Custis

Variational autoencoder (VAE) is a popular method for drug discovery and there had been a great deal of architectures and pipelines proposed to improve its performance. But the VAE model itself suffers from deficiencies such as poor…

机器学习 · 计算机科学 2022-12-07 Chenghui Zhou , Barnabas Poczos

Multimodal variational autoencoders (VAEs) have shown promise as efficient generative models for weakly-supervised data. Yet, despite their advantage of weak supervision, they exhibit a gap in generative quality compared to unimodal VAEs,…

机器学习 · 计算机科学 2022-04-08 Imant Daunhawer , Thomas M. Sutter , Kieran Chin-Cheong , Emanuele Palumbo , Julia E. Vogt

Unsupervised learning is becoming more and more important recently. As one of its key components, the autoencoder (AE) aims to learn a latent feature representation of data which is more robust and discriminative. However, most AE based…

机器学习 · 计算机科学 2019-04-02 Jingcai Guo , Song Guo

Variational language models seek to estimate the posterior of latent variables with an approximated variational posterior. The model often assumes the variational posterior to be factorized even when the true posterior is not. The learned…

计算与语言 · 计算机科学 2019-09-10 Prince Zizhuang Wang , William Yang Wang