中文
相关论文

相关论文: Towards Better Data Augmentation using Wasserstein…

200 篇论文

Variational Autoencoders (VAEs) are known to suffer from learning uninformative latent representation of the input due to issues such as approximated posterior collapse, or entanglement of the latent space. We impose an explicit constraint…

计算与语言 · 计算机科学 2019-10-01 Victor Prokhorov , Ehsan Shareghi , Yingzhen Li , Mohammad Taher Pilehvar , Nigel Collier

Variational autoencoder (VAE) estimates the posterior parameters (mean and variance) of latent variables corresponding to each input data. While it is used for many tasks, the transparency of the model is still an underlying issue. This…

机器学习 · 统计学 2023-02-23 Akira Nakagawa , Keizo Kato , Taiji Suzuki

There have been many recent advances in representation learning; however, unsupervised representation learning can still struggle with model identification issues related to rotations of the latent space. Variational Auto-Encoders (VAEs)…

机器学习 · 计算机科学 2021-10-29 Travers Rhodes , Daniel D. Lee

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Xianxu Hou , Linlin Shen , Ke Sun , Guoping Qiu

Machine learning methods often need a large amount of labeled training data. Since the training data is assumed to be the ground truth, outliers can severely degrade learned representations and performance of trained models. Here we apply…

机器学习 · 统计学 2019-12-24 Haleh Akrami , Anand A. Joshi , Jian Li , Sergul Aydore , Richard M. Leahy

In this paper we present a new implementation of a Variational Autoencoder (VAE) for the calibration of sensors. We propose that the VAE can be used to calibrate sensor data by training the latent space as a calibration output. We discuss…

机器学习 · 计算机科学 2025-11-04 Travis Barrett , Amit Kumar Mishra , Joyce Mwangama

Variational autoencoders (VAEs) face a notorious problem wherein the variational posterior often aligns closely with the prior, a phenomenon known as posterior collapse, which hinders the quality of representation learning. To mitigate this…

机器学习 · 统计学 2023-10-25 Yuma Ichikawa , Koji Hukushima

Variational Autoencoder (VAE) is a powerful method for learning representations of high-dimensional data. However, VAEs can suffer from an issue known as latent variable collapse (or KL loss vanishing), where the posterior collapses to the…

计算与语言 · 计算机科学 2019-11-14 Ruizhe Li , Xiao Li , Chenghua Lin , Matthew Collinson , Rui Mao

Recurrent Variational Autoencoder has been widely used for language modeling and text generation tasks. These models often face a difficult optimization problem, also known as the Kullback-Leibler (KL) term vanishing issue, where the…

计算与语言 · 计算机科学 2019-04-24 Prince Zizhuang Wang , William Yang Wang

Optimal transport offers an alternative to maximum likelihood for learning generative autoencoding models. We show that minimizing the p-Wasserstein distance between the generator and the true data distribution is equivalent to the…

Variational Autoencoders (VAEs) have recently been highly successful at imputing and acquiring heterogeneous missing data. However, within this specific application domain, existing VAE methods are restricted by using only one layer of…

机器学习 · 计算机科学 2022-12-23 Ignacio Peis , Chao Ma , José Miguel Hernández-Lobato

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

机器学习 · 计算机科学 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

A variational autoencoder (VAE) derived from Tsallis statistics called q-VAE is proposed. In the proposed method, a standard VAE is employed to statistically extract latent space hidden in sampled data, and this latent space helps make…

机器学习 · 计算机科学 2021-08-27 Taisuke Kobayashi

A framework to boost the efficiency of Bayesian inference in probabilistic programs is introduced by embedding a sampler inside a variational posterior approximation. We call it the refined variational approximation. Its strength lies both…

机器学习 · 计算机科学 2020-02-25 Victor Gallego , David Rios Insua

Recent state-of-the-art autoencoder based generative models have an encoder-decoder structure and learn a latent representation with a pre-defined distribution that can be sampled from. Implementing the encoder networks of these models in a…

机器学习 · 计算机科学 2020-05-11 D. T. Braithwaite , M. O'Connor , W. B. Kleijn

Posterior collapse plagues VAEs for text, especially for conditional text generation with strong autoregressive decoders. In this work, we address this problem in variational neural machine translation by explicitly promoting mutual…

计算与语言 · 计算机科学 2019-09-23 Arya D. McCarthy , Xian Li , Jiatao Gu , Ning Dong

Variational autoencoders (VAEs) often suffer from posterior collapse, which is a phenomenon in which the learned latent space becomes uninformative. This is often related to the hyperparameter resembling the data variance. It can be shown…

机器学习 · 计算机科学 2022-08-23 Yuhta Takida , Wei-Hsiang Liao , Chieh-Hsin Lai , Toshimitsu Uesaka , Shusuke Takahashi , Yuki Mitsufuji

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

机器学习 · 计算机科学 2024-01-08 Ahmed Salah , David Yevick

Variational autoencoder (VAE) neural networks can be trained to generate power system states that capture both marginal distribution and multivariate dependencies of historical data. The coordinates of the latent space codes of VAEs have…

系统与控制 · 电气工程与系统科学 2023-03-22 Chenguang Wang , Ensieh Sharifnia , Simon H. Tindemans , Peter Palensky

This paper presents a new variational data assimilation (VDA) approach for the formal treatment of bias in both model outputs and observations. This approach relies on the Wasserstein metric stemming from the theory of optimal mass…

统计方法学 · 统计学 2020-08-04 Sagar K. Tamang , Ardeshir Ebtehaj , Dongmian Zou , Gilad Lerman