English
Related papers

Related papers: Disentanglement of Sources in a Multi-Stream Varia…

200 papers

We introduce MGP-VAE (Multi-disentangled-features Gaussian Processes Variational AutoEncoder), a variational autoencoder which uses Gaussian processes (GP) to model the latent space for the unsupervised learning of disentangled…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Sarthak Bhagat , Shagun Uppal , Zhuyun Yin , Nengli Lim

Learning disentanglement aims at finding a low dimensional representation which consists of multiple explanatory and generative factors of the observational data. The framework of variational autoencoder (VAE) is commonly used to…

Machine Learning · Computer Science 2023-12-20 Mengyue Yang , Furui Liu , Zhitang Chen , Xinwei Shen , Jianye Hao , Jun Wang

We present a new approach to disentangle speaker voice and phone content by introducing new components to the VQ-VAE architecture for speech synthesis. The original VQ-VAE does not generalize well to unseen speakers or content. To alleviate…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Jennifer Williams , Yi Zhao , Erica Cooper , Junichi Yamagishi

We decompose the evidence lower bound to show the existence of a term measuring the total correlation between latent variables. We use this to motivate our $\beta$-TCVAE (Total Correlation Variational Autoencoder), a refinement of the…

Machine Learning · Computer Science 2019-04-24 Ricky T. Q. Chen , Xuechen Li , Roger Grosse , David Duvenaud

Learning interpretable and disentangled representations is a crucial yet challenging task in representation learning. In this work, we focus on semi-supervised disentanglement learning and extend work by Locatello et al. (2019) by…

Machine Learning · Computer Science 2020-06-24 Weili Nie , Zichao Wang , Ankit B. Patel , Richard G. Baraniuk

Learning interpretable and disentangled representations of data is a key topic in machine learning research. Variational Autoencoder (VAE) is a scalable method for learning directed latent variable models of complex data. It employs a clear…

Machine Learning · Computer Science 2020-06-04 Andriy Serdega , Dae-Shik Kim

The Variational Autoencoder (VAE) has proven to be an effective model for producing semantically meaningful latent representations for natural data. However, it has thus far seen limited application to sequential data, and, as we…

Machine Learning · Computer Science 2019-11-12 Adam Roberts , Jesse Engel , Colin Raffel , Curtis Hawthorne , Douglas Eck

Disentanglement learning is central to understanding and reusing learned representations in variational autoencoders (VAEs). Although equivariance has been explored in this context, effectively exploiting it for disentanglement remains…

Machine Learning · Computer Science 2026-02-06 Hee-Jun Jung , Jaehyoung Jeong , Kangil Kim

Automatic speaker verification (ASV) systems are highly vulnerable to presentation attacks, also called spoofing attacks. Replay is among the simplest attacks to mount - yet difficult to detect reliably. The generalization failure of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-24 Bhusan Chettri , Tomi Kinnunen , Emmanouil Benetos

The goal of a classification model is to assign the correct labels to data. In most cases, this data is not fully described by the given set of labels. Often a rich set of meaningful concepts exist in the domain that can much more precisely…

Machine Learning · Computer Science 2021-08-23 Yoeri Poels , Vlado Menkovski

Variational autoencoders (VAEs) are essential tools in end-to-end representation learning. However, the sequential text generation common pitfall with VAEs is that the model tends to ignore latent variables with a strong auto-regressive…

Machine Learning · Computer Science 2021-02-26 Yang Zhao , Ping Yu , Suchismit Mahapatra , Qinliang Su , Changyou Chen

In many data analysis tasks, it is beneficial to learn representations where each dimension is statistically independent and thus disentangled from the others. If data generating factors are also statistically independent, disentangled…

Machine Learning · Statistics 2019-12-12 Harshvardhan Sikka , Weishun Zhong , Jun Yin , Cengiz Pehlevan

Unlearnable examples (UEs) seek to maximize testing error by making subtle modifications to training examples that are correctly labeled. Defenses against these poisoning attacks can be categorized based on whether specific interventions…

Cryptography and Security · Computer Science 2024-05-07 Yi Yu , Yufei Wang , Song Xia , Wenhan Yang , Shijian Lu , Yap-Peng Tan , Alex C. Kot

Variational autoencoders (VAEs) are a popular class of deep generative models with many variants and a wide range of applications. Improvements upon the standard VAE mostly focus on the modelling of the posterior distribution over the…

Machine Learning · Computer Science 2022-11-02 James Langley , Miguel Monteiro , Charles Jones , Nick Pawlowski , Ben Glocker

Disentangled representations enable models to separate factors of variation that are shared across experimental conditions from those that are condition-specific. This separation is essential in domains such as biomedical data analysis,…

Machine Learning · Computer Science 2025-12-16 Yuli Slavutsky , Ozgur Beker , David Blei , Bianca Dumitrascu

Variational autoencoders (VAEs) are powerful tools for learning latent representations of data used in a wide range of applications. In practice, VAEs usually require multiple training rounds to choose the amount of information the latent…

Machine Learning · Computer Science 2023-08-21 Juhan Bae , Michael R. Zhang , Michael Ruan , Eric Wang , So Hasegawa , Jimmy Ba , Roger Grosse

Tools to generate high quality synthetic speech signal that is perceptually indistinguishable from speech recorded from human speakers are easily available. Several approaches have been proposed for detecting synthetic speech. Many of these…

This paper proposes a new source model and training scheme to improve the accuracy and speed of the multichannel variational autoencoder (MVAE) method. The MVAE method is a recently proposed powerful multichannel source separation method.…

Sound · Computer Science 2022-09-08 Li Li , Hirokazu Kameoka , Shoji Makino

With the ever-increasing amount of data, the central challenge in multimodal learning involves limitations of labelled samples. For the task of classification, techniques such as meta-learning, zero-shot learning, and few-shot learning…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Nihar Bendre , Kevin Desai , Peyman Najafirad

Generative models for multimodal data permit the identification of latent factors that may be associated with important determinants of observed data heterogeneity. Common or shared factors could be important for explaining variation across…

Machine Learning · Statistics 2024-03-12 Kaspar Märtens , Christopher Yau