中文
相关论文

相关论文: Variance Loss in Variational Autoencoders

200 篇论文

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

机器学习 · 统计学 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

As with many machine learning problems, the progress of image generation methods hinges on good evaluation metrics. One of the most popular is the Frechet Inception Distance (FID). FID estimates the distance between a distribution of…

计算机视觉与模式识别 · 计算机科学 2024-01-29 Sadeep Jayasumana , Srikumar Ramalingam , Andreas Veit , Daniel Glasner , Ayan Chakrabarti , Sanjiv Kumar

Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to…

音频与语音处理 · 电气工程与系统科学 2021-05-18 Huajian Fang , Guillaume Carbajal , Stefan Wermter , Timo Gerkmann

An important property for deep neural networks is the ability to perform robust out-of-distribution detection on previously unseen data. This property is essential for safety purposes when deploying models for real world applications.…

机器学习 · 计算机科学 2022-04-14 Griffin Floto , Stefan Kremer , Mihai Nica

Recent advances in generative modeling have led to an increased interest in the study of statistical divergences as means of model comparison. Commonly used evaluation methods, such as the Frechet Inception Distance (FID), correlate well…

机器学习 · 统计学 2018-10-30 Mehdi S. M. Sajjadi , Olivier Bachem , Mario Lucic , Olivier Bousquet , Sylvain Gelly

In this paper, we provide the first focused study on the discontinuities (aka. holes) in the latent space of Variational Auto-Encoders (VAEs), a phenomenon which has been shown to have a detrimental effect on model capacity. When…

机器学习 · 计算机科学 2021-10-08 Ruizhe Li , Xutan Peng , Chenghua Lin

We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large scale image generation. To this end, we scale and enhance the autoregressive priors used in VQ-VAE to generate synthetic samples of much higher…

机器学习 · 计算机科学 2019-06-04 Ali Razavi , Aaron van den Oord , Oriol Vinyals

The Gaussianity assumption has been consistently criticized as a main limitation of the Variational Autoencoder (VAE) despite its efficiency in computational modeling. In this paper, we propose a new approach that expands the model capacity…

机器学习 · 统计学 2023-10-30 Seunghwan An , Jong-June Jeon

Variational Autoencoders (VAEs) have been a pioneering force in the realm of deep generative models. Amongst its legions of progenies, Wasserstein Autoencoders (WAEs) stand out in particular due to the dual offering of heightened generative…

机器学习 · 统计学 2023-12-12 Anish Chakrabarty , Arkaprabha Basu , Swagatam Das

A great interest has arisen in using Deep Generative Models (DGM) for generative design. When assessing the quality of the generated designs, human designers focus more on structural plausibility, e.g., no missing component, rather than…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Jiajie Fan , Amal Trigui , Thomas Bäck , Hao Wang

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Xianxu Hou , Linlin Shen , Ke Sun , Guoping Qiu

Variational autoencoders (VAEs) are deep probabilistic models that are used in scientific applications. Many works try to mitigate this problem from the probabilistic methods perspective by new inference techniques or training procedures.…

机器学习 · 统计学 2024-12-24 Tim Z. Xiao , Johannes Zenn , Robert Bamler

Generative adversarial networks or GANs are a type of generative modeling framework. GANs involve a pair of neural networks engaged in a competition in iteratively creating fake data, indistinguishable from the real data. One notable…

计算机视觉与模式识别 · 计算机科学 2021-06-17 Eric J. Nunn , Pejman Khadivi , Shadrokh Samavi

Variational autoencoder (VAE) has widely been utilized for modeling data distributions because it is theoretically elegant, easy to train, and has nice manifold representations. However, when applied to image reconstruction and synthesis…

计算机视觉与模式识别 · 计算机科学 2022-07-12 Dooseop Choi , KyoungWook Min

One of the major shortcomings of variational autoencoders is the inability to produce generations from the individual modalities of data originating from mixture distributions. This is primarily due to the use of a simple isotropic Gaussian…

机器学习 · 计算机科学 2019-12-02 Frantzeska Lavda , Magda Gregorová , Alexandros Kalousis

Modern metrics for generative learning like Fr\'echet Inception Distance (FID) and DINOv2-Fr\'echet Distance (FD-DINOv2) demonstrate impressive performance. However, they suffer from various shortcomings, like a bias towards specific…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Lokesh Veeramacheneni , Moritz Wolter , Hildegard Kuehne , Juergen Gall

The variational autoencoder (VAE) is a popular probabilistic generative model. However, one shortcoming of VAEs is that the latent variables cannot be discrete, which makes it difficult to generate data from different modes of a…

机器学习 · 统计学 2017-11-21 Jay A. Hennig , Akash Umakantha , Ryan C. Williamson

We propose to utilize a variational autoencoder (VAE) for data-driven channel estimation. The underlying true and unknown channel distribution is modeled by the VAE as a conditional Gaussian distribution in a novel way, parameterized by the…

信号处理 · 电气工程与系统科学 2023-04-07 Michael Baur , Benedikt Fesl , Michael Koller , Wolfgang Utschick

Recently, with increasing interest in pet healthcare, the demand for computer-aided diagnosis (CAD) systems in veterinary medicine has increased. The development of veterinary CAD has stagnated due to a lack of sufficient radiology data. To…

图像与视频处理 · 电气工程与系统科学 2024-03-07 In-Gyu Lee , Jun-Young Oh , Hee-Jung Yu , Jae-Hwan Kim , Ki-Dong Eom , Ji-Hoon Jeong

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

机器学习 · 计算机科学 2018-12-18 Jack Klys , Jake Snell , Richard Zemel