中文
相关论文

相关论文: Finetuning Pretrained Transformers into Variationa…

200 篇论文

Variational autoencoders (VAEs) provide an effective and simple method for modeling complex distributions. However, training VAEs often requires considerable hyperparameter tuning to determine the optimal amount of information retained by…

机器学习 · 计算机科学 2021-07-13 Oleh Rybkin , Kostas Daniilidis , Sergey Levine

Structured variational autoencoders (SVAEs) combine probabilistic graphical model priors on latent variables, deep neural networks to link latent variables to observed data, and structure-exploiting algorithms for approximate posterior…

机器学习 · 统计学 2023-05-29 Yixiu Zhao , Scott W. Linderman

Variational Autoencoder (VAE) is widely used as a generative model to approximate a model's posterior on latent variables by combining the amortized variational inference and deep neural networks. However, when paired with strong…

机器学习 · 计算机科学 2020-06-02 Qile Zhu , Jianlin Su , Wei Bi , Xiaojiang Liu , Xiyao Ma , Xiaolin Li , Dapeng Wu

Variational Auto-Encoders (VAEs) are capable of learning latent representations for high dimensional data. However, due to the i.i.d. assumption, VAEs only optimize the singleton variational distributions and fail to account for the…

机器学习 · 计算机科学 2020-04-20 Da Tang , Dawen Liang , Tony Jebara , Nicholas Ruozzi

Variational autoencoders learn unsupervised data representations, but these models frequently converge to minima that fail to preserve meaningful semantic information. For example, variational autoencoders with autoregressive decoders often…

机器学习 · 计算机科学 2019-05-21 Bryan Seybold , Emily Fertig , Alex Alemi , Ian Fischer

Audio classification and restoration are among major downstream tasks in audio signal processing. However, restoration derives less of a benefit from pretrained models compared to the overwhelming success of pretrained models in…

In this paper, we introduce the Variational Autoencoder (VAE) to an end-to-end speech synthesis model, to learn the latent representation of speaking styles in an unsupervised manner. The style representation learned through VAE shows good…

计算与语言 · 计算机科学 2019-02-15 Ya-Jie Zhang , Shifeng Pan , Lei He , Zhen-Hua Ling

Classical methods for model order selection often fail in scenarios with low SNR or few snapshots. Deep learning-based methods are promising alternatives for such challenging situations as they compensate lack of information in the…

信号处理 · 电气工程与系统科学 2023-12-07 Michael Baur , Franz Weißer , Benedikt Böck , Wolfgang Utschick

Variational autoencoders (VAEs) have recently been shown to be vulnerable to adversarial attacks, wherein they are fooled into reconstructing a chosen target image. However, how to defend against such attacks remains an open problem. We…

机器学习 · 统计学 2021-02-01 Matthew Willetts , Alexander Camuto , Tom Rainforth , Stephen Roberts , Chris Holmes

Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to…

音频与语音处理 · 电气工程与系统科学 2021-05-18 Huajian Fang , Guillaume Carbajal , Stefan Wermter , Timo Gerkmann

In just three years, Variational Autoencoders (VAEs) have emerged as one of the most popular approaches to unsupervised learning of complicated distributions. VAEs are appealing because they are built on top of standard function…

机器学习 · 统计学 2021-01-05 Carl Doersch

Due to the phenomenon of "posterior collapse," current latent variable generative models pose a challenging design choice that either weakens the capacity of the decoder or requires augmenting the objective so it does not only maximize the…

机器学习 · 计算机科学 2019-01-14 Ali Razavi , Aäron van den Oord , Ben Poole , Oriol Vinyals

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

机器学习 · 计算机科学 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

机器学习 · 统计学 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

Learning latent representations that are simultaneously expressive, geometrically well-structured, and reliably calibrated remains a central challenge for Variational Autoencoders (VAEs). Standard VAEs typically assume a diagonal Gaussian…

机器学习 · 计算机科学 2025-12-02 Mehmet Can Yavuz

Variational Autoencoders are one of the most commonly used generative models, particularly for image data. A prominent difficulty in training VAEs is data that is supported on a lower-dimensional manifold. Recent work by Dai and Wipf (2020)…

机器学习 · 计算机科学 2022-05-19 Frederic Koehler , Viraj Mehta , Chenghui Zhou , Andrej Risteski

Variational autoencoders (VAEs), one of the most widely used generative models, are known to suffer from posterior collapse, a phenomenon that reduces the diversity of generated samples. To avoid posterior collapse, many prior works have…

机器学习 · 计算机科学 2025-08-19 Hyunsoo Song , Seungwhan Kim , Seungkyu Lee

In this thesis, we develop methods to enhance the interpretability of recent representation learning techniques in natural language processing (NLP) while accounting for the unavailability of annotated data. We choose to leverage…

计算与语言 · 计算机科学 2023-05-05 Ghazi Felhi

Variational autoencoders (VAEs) have been used extensively to discover low-dimensional latent factors governing neural activity and animal behavior. However, without careful model selection, the uncovered latent factors may reflect noise in…

机器学习 · 计算机科学 2023-12-13 Julia Huiming Wang , Dexter Tsin , Tatiana Engel

The Variational Autoencoder (VAE) is a powerful architecture capable of representation learning and generative modeling. When it comes to learning interpretable (disentangled) representations, VAE and its variants show unparalleled…

机器学习 · 计算机科学 2019-04-17 Michal Rolinek , Dominik Zietlow , Georg Martius