中文
相关论文

相关论文: Generated Loss and Augmented Training of MNIST VAE

200 篇论文

Variational Autoencoders (VAE) and their variants have been widely used in a variety of applications, such as dialog generation, image generation and disentangled representation learning. However, the existing VAE models have some…

机器学习 · 计算机科学 2020-06-23 Huajie Shao , Shuochao Yao , Dachun Sun , Aston Zhang , Shengzhong Liu , Dongxin Liu , Jun Wang , Tarek Abdelzaher

Deep latent variable models (LVM) such as variational auto-encoder (VAE) have recently played an important role in text generation. One key factor is the exploitation of smooth latent structures to guide the generation. However, the…

机器学习 · 计算机科学 2019-12-02 Le Fang , Chunyuan Li , Jianfeng Gao , Wen Dong , Changyou Chen

The variational autoencoder (VAE; Kingma, Welling (2014)) is a recently proposed generative model pairing a top-down generative network with a bottom-up recognition network which approximates posterior inference. It typically makes strong…

机器学习 · 计算机科学 2016-11-08 Yuri Burda , Roger Grosse , Ruslan Salakhutdinov

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference. However, when the decoder network is sufficiently expressive, VAE may lead…

机器学习 · 计算机科学 2021-10-26 Dazhong Shen , Chuan Qin , Chao Wang , Hengshu Zhu , Enhong Chen , Hui Xiong

The surrogate loss of variational autoencoders (VAEs) poses various challenges to their training, inducing the imbalance between task fitting and representation inference. To avert this, the existing strategies for VAEs focus on adjusting…

神经与进化计算 · 计算机科学 2024-04-02 Zhangkai Wu , Longbing Cao , Lei Qi

Generative models often incur the catastrophic forgetting problem when they are used to sequentially learning multiple tasks, i.e., lifelong generative learning. Although there are some endeavors to tackle this problem, they suffer from…

机器学习 · 计算机科学 2022-01-20 Libo Huang , Zhulin An , Xiang Zhi , Yongjun Xu

Although variational autoencoders (VAEs) represent a widely influential deep generative model, many aspects of the underlying energy function remain poorly understood. In particular, it is commonly believed that Gaussian encoder/decoder…

机器学习 · 计算机科学 2019-10-31 Bin Dai , David Wipf

Variational autoencoders (VAEs) face a notorious problem wherein the variational posterior often aligns closely with the prior, a phenomenon known as posterior collapse, which hinders the quality of representation learning. To mitigate this…

机器学习 · 统计学 2023-10-25 Yuma Ichikawa , Koji Hukushima

The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying quantities such as heterogeneous material properties and turbulent flows. Deep generative…

Variational Autoencoder (VAE) and its variations are classic generative models by learning a low-dimensional latent representation to satisfy some prior distribution (e.g., Gaussian distribution). Their advantages over GAN are that they can…

计算机视觉与模式识别 · 计算机科学 2020-09-24 Cong Geng , Jia Wang , Li Chen , Zhiyong Gao

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder.…

机器学习 · 统计学 2017-07-12 Gautam Ramachandra

Molecule generation is to design new molecules with specific chemical properties and further to optimize the desired chemical properties. Following previous work, we encode molecules into continuous vectors in the latent space and then…

机器学习 · 计算机科学 2020-01-16 Chaochao Yan , Sheng Wang , Jinyu Yang , Tingyang Xu , Junzhou Huang

Disentangled and interpretable latent representations in generative models typically come at the cost of generation quality. The $\beta$-VAE framework introduces a hyperparameter $\beta$ to balance disentanglement and reconstruction…

机器学习 · 计算机科学 2025-07-10 Anshuk Uppal , Yuhta Takida , Chieh-Hsin Lai , Yuki Mitsufuji

Variational autoencoders (VAEs) are one of the powerful likelihood-based generative models with applications in many domains. However, they struggle to generate high-quality images, especially when samples are obtained from the prior…

机器学习 · 计算机科学 2021-11-05 Jyoti Aneja , Alexander Schwing , Jan Kautz , Arash Vahdat

We present a new generative autoencoder model with dual contradistinctive losses to improve generative autoencoder that performs simultaneous inference (reconstruction) and synthesis (sampling). Our model, named dual contradistinctive…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Gaurav Parmar , Dacheng Li , Kwonjoon Lee , Zhuowen Tu

The posterior collapse phenomenon in variational autoencoder (VAE), where the variational posterior distribution closely matches the prior distribution, can hinder the quality of the learned latent variables. As a consequence of posterior…

机器学习 · 统计学 2024-05-14 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

Variational autoencoders (VAEs), one of the most widely used generative models, are known to suffer from posterior collapse, a phenomenon that reduces the diversity of generated samples. To avoid posterior collapse, many prior works have…

机器学习 · 计算机科学 2025-08-19 Hyunsoo Song , Seungwhan Kim , Seungkyu Lee

Variational Autoencoders (VAEs) have experienced recent success as data-generating models by using simple architectures that do not require significant fine-tuning of hyperparameters. However, VAEs are known to suffer from…

机器学习 · 统计学 2020-07-22 Wei Cheng , Gregory Darnell , Sohini Ramachandran , Lorin Crawford

The variational autoencoder (VAE) is a powerful generative model that can estimate the probability of a data point by using latent variables. In the VAE, the posterior of the latent variable given the data point is regularized by the prior…

机器学习 · 统计学 2019-12-30 Hiroshi Takahashi , Tomoharu Iwata , Yuki Yamanaka , Masanori Yamada , Satoshi Yagi

Recent proposals for quantum generative adversarial networks (GANs) suffer from the issue of mode collapse, analogous to classical GANs, wherein the distribution learnt by the GAN fails to capture the high mode complexities of the target…

量子物理 · 物理学 2025-05-23 Aaron Mark Thomas , Harry Youel , Sharu Theresa Jose