中文
相关论文

相关论文: Finetuning Pretrained Transformers into Variationa…

200 篇论文

The Variational Autoencoder (VAE) is a powerful framework for learning probabilistic latent variable generative models. However, typical assumptions on the approximate posterior distribution of the encoder and/or the prior, seriously…

机器学习 · 计算机科学 2020-07-13 Ifigeneia Apostolopoulou , Elan Rosenfeld , Artur Dubrawski

Variational Autoencoders (VAEs) provide a flexible and scalable framework for non-linear dimensionality reduction. However, in application domains such as genomics where data sets are typically tabular and high-dimensional, a black-box…

机器学习 · 统计学 2020-03-10 Kaspar Märtens , Christopher Yau

Variational auto-encoders (VAEs) provide an attractive solution to image generation problem. However, they tend to produce blurred and over-smoothed images due to their dependence on pixel-wise reconstruction loss. This paper introduces a…

计算机视觉与模式识别 · 计算机科学 2018-04-30 Salman H. Khan , Munawar Hayat , Nick Barnes

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

机器学习 · 统计学 2023-05-12 Daniel G. Edelberg , Roy R. Lederman

State-of-the-art Variational Auto-Encoders (VAEs) for learning disentangled latent representations give impressive results in discovering features like pitch, pause duration, and accent in speech data, leading to highly controllable…

声音 · 计算机科学 2021-05-11 Shakti Kumar , Jithin Pradeep , Hussain Zaidi

The Variational Autoencoder (VAE) is a powerful deep generative model that is now extensively used to represent high-dimensional complex data via a low-dimensional latent space learned in an unsupervised manner. In the original VAE model,…

声音 · 计算机科学 2021-06-15 Xiaoyu Bie , Laurent Girin , Simon Leglaive , Thomas Hueber , Xavier Alameda-Pineda

Fine-tuning a visual pre-trained model can leverage the semantic information from large-scale pre-training data and mitigate the over-fitting problem on downstream vision tasks with limited training examples. While the problem of…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Junyang Wang , Yuanhong Xu , Juhua Hu , Ming Yan , Jitao Sang , Qi Qian

Variational Autoencoders (VAEs) are a popular framework for unsupervised learning and data generation. A plethora of methods have been proposed focusing on improving VAEs, with the incorporation of adversarial objectives and the integration…

机器学习 · 计算机科学 2025-06-05 Ioannis Athanasiadis , Fredrik Lindsten , Michael Felsberg

Variational Autoencoders (VAEs) are powerful generative models that have been widely used in various fields, including image and text generation. However, one of the known challenges in using VAEs is the model's sensitivity to its…

机器学习 · 计算机科学 2024-12-31 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

A key advance in learning generative models is the use of amortized inference distributions that are jointly trained with the models. We find that existing training objectives for variational autoencoders can lead to inaccurate amortized…

机器学习 · 计算机科学 2018-05-31 Shengjia Zhao , Jiaming Song , Stefano Ermon

Variational autoencoders (VAEs) rely on amortized variational inference to enable efficient posterior approximation, but this efficiency comes at the cost of a shared parametrization, giving rise to the amortization gap. We propose the…

机器学习 · 计算机科学 2026-04-21 Andrea Pollastro , Andrea Apicella , Francesco Isgrò , Roberto Prevete

Syntactic information contains structures and rules about how text sentences are arranged. Incorporating syntax into text modeling methods can potentially benefit both representation learning and generation. Variational autoencoders (VAEs)…

计算与语言 · 计算机科学 2019-08-28 Yijun Xiao , William Yang Wang

Understanding the structure of complex, nonstationary, high-dimensional time-evolving signals is a central challenge in scientific data analysis. In many domains, such as speech and biomedical signal processing, the ability to learn…

机器学习 · 计算机科学 2026-01-13 Ioannis Ziogas , Aamna Al Shehhi , Ahsan H. Khandoker , Leontios J. Hadjileontiadis

This paper introduces the Descriptive Variational Autoencoder (DVAE), an unsupervised and end-to-end trainable neural network for predicting vehicle trajectories that provides partial interpretability. The novel approach is based on the…

机器学习 · 计算机科学 2021-06-25 Marion Neumeier , Andreas Tollkühn , Thomas Berberich , Michael Botsch

Variational auto-encoders (VAE) are popular deep latent variable models which are trained by maximizing an Evidence Lower Bound (ELBO). To obtain tighter ELBO and hence better variational approximations, it has been proposed to use…

机器学习 · 统计学 2021-07-22 Achille Thin , Nikita Kotelevskii , Arnaud Doucet , Alain Durmus , Eric Moulines , Maxim Panov

Variational Autoencoders (VAEs) are powerful generative models widely used for learning interpretable latent spaces, quantifying uncertainty, and compressing data for downstream generative tasks. VAEs typically rely on diagonal Gaussian…

机器学习 · 计算机科学 2025-06-03 Peter Sorrenson , Lukas Lührs , Hans Olischläger , Ullrich Köthe

Masked auto-encoder pre-training has emerged as a prevalent technique for initializing and enhancing dense retrieval systems. It generally utilizes additional Transformer decoder blocks to provide sustainable supervision signals and…

信息检索 · 计算机科学 2024-04-23 Guangyuan Ma , Xing Wu , Zijia Lin , Songlin Hu

Recent research showed that an autoencoder trained with speech of a single speaker, called exemplar autoencoder (eAE), can be used for any-to-one voice conversion (VC). Compared to large-scale many-to-many models such as AutoVC, the eAE…

声音 · 计算机科学 2022-04-13 Weida Liang , Lantian Li , Wenqiang Du , Dong Wang

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

计算机视觉与模式识别 · 计算机科学 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

Conditional Variational Auto Encoders (VAE) are gathering significant attention as an Explainable Artificial Intelligence (XAI) tool. The codes in the latent space provide a theoretically sound way to produce counterfactuals, i.e.…

机器学习 · 计算机科学 2021-02-02 Nicolas Vercheval , Aleksandra Pizurica