中文
相关论文

相关论文: Matching aggregate posteriors in the variational a…

200 篇论文

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

机器学习 · 统计学 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

Due to the phenomenon of "posterior collapse," current latent variable generative models pose a challenging design choice that either weakens the capacity of the decoder or requires augmenting the objective so it does not only maximize the…

机器学习 · 计算机科学 2019-01-14 Ali Razavi , Aäron van den Oord , Ben Poole , Oriol Vinyals

Making sense of multiple modalities can yield a more comprehensive description of real-world phenomena. However, learning the co-representation of diverse modalities is still a long-standing endeavor in emerging machine learning…

人工智能 · 计算机科学 2022-12-21 Jinzhao Zhou , Yiqun Duan , Zhihong Chen , Yu-Cheng Chang , Chin-Teng Lin

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amortized approaches were…

机器学习 · 计算机科学 2020-11-18 Minyoung Kim , Vladimir Pavlovic

We present a novel method for constructing Variational Autoencoder (VAE). Instead of using pixel-by-pixel loss, we enforce deep feature consistency between the input and the output of a VAE, which ensures the VAE's output to preserve the…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Xianxu Hou , Linlin Shen , Ke Sun , Guoping Qiu

The Variational Autoencoder (VAE) is a powerful deep generative model that is now extensively used to represent high-dimensional complex data via a low-dimensional latent space learned in an unsupervised manner. In the original VAE model,…

声音 · 计算机科学 2021-06-15 Xiaoyu Bie , Laurent Girin , Simon Leglaive , Thomas Hueber , Xavier Alameda-Pineda

Variational autoencoders (VAEs) have been widely applied for text modeling. In practice, however, they are troubled by two challenges: information underrepresentation and posterior collapse. The former arises as only the last hidden state…

机器学习 · 计算机科学 2021-06-17 Xianghong Fang , Haoli Bai , Jian Li , Zenglin Xu , Michael Lyu , Irwin King

The variational auto-encoder (VAE) is a deep latent variable model that has two neural networks in an autoencoder-like architecture; one of them parameterizes the model's likelihood. Fitting its parameters via maximum likelihood (ML) is…

机器学习 · 计算机科学 2021-06-03 Francisco J. R. Ruiz , Michalis K. Titsias , Taylan Cemgil , Arnaud Doucet

The Variational Autoencoder (VAE) has proven to be an effective model for producing semantically meaningful latent representations for natural data. However, it has thus far seen limited application to sequential data, and, as we…

机器学习 · 计算机科学 2019-11-12 Adam Roberts , Jesse Engel , Colin Raffel , Curtis Hawthorne , Douglas Eck

Deep Generative Networks (DGNs) with probabilistic modeling of their output and latent space are currently trained via Variational Autoencoders (VAEs). In the absence of a known analytical form for the posterior and likelihood expectation,…

机器学习 · 计算机科学 2020-06-18 Randall Balestriero , Sebastien Paris , Richard G. Baraniuk

Variational autoencoders (VAEs) and generative adversarial networks (GANs) enjoy an intuitive connection to manifold learning: in training the decoder/generator is optimized to approximate a homeomorphism between the data distribution and…

机器学习 · 计算机科学 2020-08-28 Henry Li , Ofir Lindenbaum , Xiuyuan Cheng , Alexander Cloninger

Variational autoencoders (VAEs) are one of the deep generative models that have experienced enormous success over the past decades. However, in practice, they suffer from a problem called posterior collapse, which occurs when the encoder…

机器学习 · 计算机科学 2024-02-06 Yuri Kinoshita , Kenta Oono , Kenji Fukumizu , Yuichi Yoshida , Shin-ichi Maeda

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

机器学习 · 统计学 2023-05-12 Daniel G. Edelberg , Roy R. Lederman

Data assimilation refers to a set of algorithms designed to compute the optimal estimate of a system's state by refining the prior prediction (known as background states) using observed data. Variational assimilation methods rely on the…

机器学习 · 计算机科学 2024-05-24 Yi Xiao , Qilong Jia , Wei Xue , Lei Bai

The surrogate loss of variational autoencoders (VAEs) poses various challenges to their training, inducing the imbalance between task fitting and representation inference. To avert this, the existing strategies for VAEs focus on adjusting…

神经与进化计算 · 计算机科学 2024-04-02 Zhangkai Wu , Longbing Cao , Lei Qi

Variational autoencoders (VAEs) have been used extensively to discover low-dimensional latent factors governing neural activity and animal behavior. However, without careful model selection, the uncovered latent factors may reflect noise in…

机器学习 · 计算机科学 2023-12-13 Julia Huiming Wang , Dexter Tsin , Tatiana Engel

Purpose: Handling heterogeneous and mixed data types has become increasingly critical with the exponential growth in real-world databases. While deep generative models attempt to merge diverse data views into a common latent space, they…

Conditional variational autoencoders (CVAEs) are versatile deep generative models that extend the standard VAE framework by conditioning the generative model with auxiliary covariates. The original CVAE model assumes that the data samples…

Variational autoencoders (VAEs) are powerful deep generative models widely used to represent high-dimensional complex data through a low-dimensional latent space learned in an unsupervised manner. In the original VAE model, the input data…

机器学习 · 计算机科学 2022-07-05 Laurent Girin , Simon Leglaive , Xiaoyu Bie , Julien Diard , Thomas Hueber , Xavier Alameda-Pineda

In this paper, we consider variational autoencoders (VAE) for general state space models. We consider a backward factorization of the variational distributions to analyze the excess risk associated with VAE. Such backward factorizations…

统计方法学 · 统计学 2023-12-18 Élisabeth Gassiat , Sylvain Le Corff