English
Related papers

Related papers: LangVAE and LangSpace: Building and Probing for La…

200 papers

The need for interpretable models has fostered the development of self-explainable classifiers. Prior approaches are either based on multi-stage optimization schemes, impacting the predictive performance of the model, or produce…

Most of the prevalent approaches in speech prosody modeling rely on learning global style representations in a continuous latent space which encode and transfer the attributes of reference speech. However, recent work on neural codecs which…

In recent years, great strides have been made in the field of affective computing. Several models have been developed to represent and quantify emotions. Two popular ones include (i) categorical models which represent emotions as discrete…

Artificial Intelligence · Computer Science 2020-12-01 Surabhi S. Nath , Vishaal Udandarao , Jainendra Shukla

While mel-spectrograms have been widely utilized as intermediate representations in zero-shot text-to-speech (TTS), their inherent redundancy leads to inefficiency in learning text-speech alignment. Compact VAE-based latent representations…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-02 Zhikang Niu , Shujie Hu , Jeongsoo Choi , Yushen Chen , Peining Chen , Pengcheng Zhu , Yunting Yang , Bowen Zhang , Jian Zhao , Chunhui Wang , Xie Chen

We present a new method to visualize data ensembles by constructing structured probabilistic representations in latent spaces, i.e., lower-dimensional representations of spatial data features. Our approach transforms the spatial features of…

Machine Learning · Computer Science 2025-09-17 Cenyang Wu , Qinhan Yu , Liang Zhou

Most visual generative models compress images into a latent space before applying diffusion or autoregressive modelling. Yet, existing approaches such as VAEs and foundation model aligned encoders implicitly constrain the latent space…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Sen Ye , Jianning Pei , Mengde Xu , Shuyang Gu , Chunyu Wang , Liwei Wang , Han Hu

We introduce a Deep Kernel Learning Variational Autoencoder (VAE-DKL) framework that integrates the generative power of a Variational Autoencoder (VAE) with the predictive nature of Deep Kernel Learning (DKL). The VAE learns a latent…

Machine Learning · Computer Science 2025-03-06 Boris N. Slautin , Utkarsh Pratiush , Doru C. Lupascu , Maxim A. Ziatdinov , Sergei V. Kalinin

Design of experiments (DOE) is playing an essential role in learning and improving a variety of objects and processes. The article discusses the application of unsupervised machine learning to support the pragmatic designs of complex…

Machine Learning · Computer Science 2021-10-07 Alex Glushkovsky

In this report we present a new model of concepts, based on the framework of variational autoencoders, which is designed to have attractive properties such as factored conceptual domains, and at the same time be learnable from data. The…

Machine Learning · Computer Science 2022-03-23 Razin A. Shaikh , Sara Sabrina Zemljic , Sean Tull , Stephen Clark

Representation Autoencoders (RAEs) have shown distinct advantages in diffusion modeling on ImageNet by training in high-dimensional semantic latent spaces. In this work, we investigate whether this framework can scale to large-scale,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shengbang Tong , Boyang Zheng , Ziteng Wang , Bingda Tang , Nanye Ma , Ellis Brown , Jihan Yang , Rob Fergus , Yann LeCun , Saining Xie

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

Machine Learning · Statistics 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

Disentangled representation learning aims to represent the underlying generative factors of a dataset in a latent representation independently of one another. In our work, we propose a discrete variational autoencoder (VAE) based model…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Gulcin Baykal , Melih Kandemir , Gozde Unal

We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE). This model makes use of latent variables and is capable of learning…

Machine Learning · Statistics 2016-11-23 Thomas N. Kipf , Max Welling

We present a comparative evaluation of latent space organization in three Variational Autoencoders (VAEs) for musical timbre generation: an unsupervised VAE, a descriptor-conditioned VAE, and a VAE conditioned on continuous perceptual…

Sound · Computer Science 2026-03-18 Joseph Cameron , Alan Blackwell

Current state-of-the-art generative approaches frequently rely on a two-stage training procedure, where an autoencoder (often a VAE) first performs dimensionality reduction, followed by training a generative model on the learned latent…

Machine Learning · Statistics 2025-07-15 Gianluigi Silvestri , Luca Ambrogioni

The manifold hypothesis states that high-dimensional data can be modeled as lying on or near a low-dimensional, nonlinear manifold. Variational Autoencoders (VAEs) approximate this manifold by learning mappings from low-dimensional latent…

Machine Learning · Statistics 2021-03-03 Marissa C. Connor , Gregory H. Canal , Christopher J. Rozell

Large climate-model ensembles are computationally expensive; yet many downstream analyses would benefit from additional, statistically consistent realizations of spatiotemporal climate variables. We study a generative modeling approach for…

Machine Learning · Computer Science 2026-01-06 Jacquelyn Shelton , Przemyslaw Polewski , Alexander Robel , Matthew Hoffman , Stephen Price

Variational auto-encoders (VAEs) are a popular and powerful deep generative model. Previous works on VAEs have assumed a factorized likelihood model, whereby the output uncertainty of each pixel is assumed to be independent. This…

Machine Learning · Statistics 2026-05-14 Gara Dorta , Sara Vicente , Lourdes Agapito , Neill D. F. Campbell , Ivor Simpson

Variational Auto-Encoders (VAEs) have been widely applied for learning compact, low-dimensional latent representations of high-dimensional data. When the correlation structure among data points is available, previous work proposed…

Machine Learning · Computer Science 2019-12-20 Da Tang , Dawen Liang , Nicholas Ruozzi , Tony Jebara

In this tutorial, we explore Variational Autoencoders (VAEs), an essential framework for unsupervised learning, particularly suited for high-dimensional datasets such as neuroimaging. By integrating deep learning with Bayesian inference,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-15 C. Vázquez-García , F. J. Martínez-Murcia , F. Segovia Román , Juan M. Górriz Sáez