中文
相关论文

相关论文: Variance Loss in Variational Autoencoders

200 篇论文

Variational Autoencoder (VAE) encoders play a critical role in modern generative models, yet their computational cost often motivates the use of knowledge distillation or quantification to obtain compact alternatives. Existing studies…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Jiaming Chu , Tao Wang , Lei Jin

We present a new method for improving the performances of variational autoencoder (VAE). In addition to enforcing the deep feature consistent principle thus ensuring the VAE output and its corresponding input images to have similar deep…

计算机视觉与模式识别 · 计算机科学 2019-06-06 Xianxu Hou , Ke Sun , Linlin Shen , Guoping Qiu

In autoencoder, the encoder generally approximates the latent distribution over the dataset, and the decoder generates samples using this learned latent distribution. There is very little control over the latent vector as using the random…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Sanket Kalwar , Animikh Aich , Tanay Dixit , Adit Chhabra

Distributed learning and Edge AI necessitate efficient data processing, low-latency communication, decentralized model training, and stringent data privacy to facilitate real-time intelligence on edge devices while reducing dependency on…

机器学习 · 计算机科学 2025-07-08 Lucas Heublein , Simon Kocher , Tobias Feigl , Alexander Rügamer , Christopher Mutschler , Felix Ott

Variational auto-encoders (VAEs) have proven to be a well suited tool for performing dimensionality reduction by extracting latent variables lying in a potentially much smaller dimensional space than the data. Their ability to capture…

机器学习 · 统计学 2020-10-23 Clément Chadebec , Clément Mantoux , Stéphanie Allassonnière

Recent advances in Conditional Diffusion Models have led to substantial capabilities in various domains. However, understanding the impact of variations in the initial seed vector remains an underexplored area of concern. Particularly,…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Mao Po-Yuan , Shashank Kotyan , Tham Yik Foong , Danilo Vasconcellos Vargas

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

机器学习 · 计算机科学 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

Video variational autoencoders (VAEs) used in latent diffusion models typically require a sufficiently large number of latent channels to ensure high-quality video reconstruction. However, recent studies have revealed that an excessive…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Jiarui Guan , Wenshuai Zhao , Zhengtao Zou , Juho Kannala , Arno Solin

Variational autoencoder (VAE) is a widely used generative model for learning latent representations. Burda et al. in their seminal paper showed that learning capacity of VAE is limited by over-pruning. It is a phenomenon where a significant…

机器学习 · 计算机科学 2020-08-10 Rayyan Ahmad Khan , Muhammad Umer Anwaar , Martin Kleinsteuber

To address the lack of public power system data for machine learning research in energy networks, we investigate the use of variational graph autoencoders (VGAEs) for synthetic distribution grid generation. Using two open-source datasets,…

机器学习 · 计算机科学 2025-12-02 Syed Zain Abbas , Ehimare Okoyomon

The variational autoencoder (VAE; Kingma, Welling (2014)) is a recently proposed generative model pairing a top-down generative network with a bottom-up recognition network which approximates posterior inference. It typically makes strong…

机器学习 · 计算机科学 2016-11-08 Yuri Burda , Roger Grosse , Ruslan Salakhutdinov

This paper aims to conduct a comparative analysis of contemporary Variational Autoencoder (VAE) architectures employed in anomaly detection, elucidating their performance and behavioral characteristics within this specific task. The…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Huy Hoang Nguyen , Cuong Nhat Nguyen , Xuan Tung Dao , Quoc Trung Duong , Dzung Pham Thi Kim , Minh-Tan Pham

Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source---the latent space---to samples from a more complex distribution…

Variational autoencoders (VAEs) provide an effective and simple method for modeling complex distributions. However, training VAEs often requires considerable hyperparameter tuning to determine the optimal amount of information retained by…

机器学习 · 计算机科学 2021-07-13 Oleh Rybkin , Kostas Daniilidis , Sergey Levine

Popular generative model learning methods such as Generative Adversarial Networks (GANs), and Variational Autoencoders (VAE) enforce the latent representation to follow simple distributions such as isotropic Gaussian. In this paper, we…

机器学习 · 计算机科学 2018-03-15 Cem Subakan , Oluwasanmi Koyejo , Paris Smaragdis

We propose a framework for the statistical evaluation of variational auto-encoders (VAEs) and test two instances of this framework in the context of modelling images of handwritten digits and a corpus of English text. Our take on evaluation…

机器学习 · 计算机科学 2022-04-08 Claartje Barkhof , Wilker Aziz

We propose a new family of optimization criteria for variational auto-encoding models, generalizing the standard evidence lower bound. We provide conditions under which they recover the data distribution and learn latent features, and…

机器学习 · 计算机科学 2017-03-01 Shengjia Zhao , Jiaming Song , Stefano Ermon

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

机器学习 · 统计学 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

The key idea of variational auto-encoders (VAEs) resembles that of traditional auto-encoder models in which spatial information is supposed to be explicitly encoded in the latent space. However, the latent variables in VAEs are vectors,…

机器学习 · 计算机科学 2019-01-23 Zhengyang Wang , Hao Yuan , Shuiwang Ji

The growing popularity of generative music models underlines the need for perceptually relevant, objective music quality metrics. The Frechet Audio Distance (FAD) is commonly used for this purpose even though its correlation with perceptual…

音频与语音处理 · 电气工程与系统科学 2024-03-07 Azalea Gui , Hannes Gamper , Sebastian Braun , Dimitra Emmanouilidou