English
Related papers

Related papers: An Identifiable Double VAE For Disentangled Repres…

200 papers

Learning useful representations without supervision remains a key challenge in machine learning. In this paper, we propose a simple yet powerful generative model that learns such discrete representations. Our model, the Vector…

Machine Learning · Computer Science 2018-05-31 Aaron van den Oord , Oriol Vinyals , Koray Kavukcuoglu

Approximating distributions over complicated manifolds, such as natural images, are conceptually attractive. The deep latent variable model, trained using variational autoencoders and generative adversarial networks, is now a key technique…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Wenju Xu , Shawn Keshmiri , Guanghui Wang

Unsupervised representation learning holds the promise of exploiting large amounts of unlabeled data to learn general representations. A promising technique for unsupervised learning is the framework of Variational Auto-encoders (VAEs).…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Kamal Gupta , Saurabh Singh , Abhinav Shrivastava

Disentangled representation learning aims to extract explanatory features or factors and retain salient information. Factorized hierarchical variational autoencoder (FHVAE) presents a way to disentangle a speech signal into sequential-level…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-06 Yuying Xie , Thomas Arildsen , Zheng-Hua Tan

Disentangling the encodings of neural models is a fundamental aspect for improving interpretability, semantic control and downstream task performance in Natural Language Processing. Currently, most disentanglement methods are unsupervised…

Computation and Language · Computer Science 2023-02-17 Danilo S. Carvalho , Giangiacomo Mercatali , Yingji Zhang , Andre Freitas

We develop the sparse VAE for unsupervised representation learning on high-dimensional data. The sparse VAE learns a set of latent factors (representations) which summarize the associations in the observed data features. The underlying…

Machine Learning · Statistics 2025-04-16 Gemma E. Moran , Dhanya Sridhar , Yixin Wang , David M. Blei

In this paper, we explore the use of a factorized hierarchical variational autoencoder (FHVAE) model to learn an unsupervised latent representation for dialect identification (DID). An FHVAE can learn a latent space that separates the more…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-13 Suwon Shon , Wei-Ning Hsu , James Glass

Learning disentangled representations is considered a cornerstone problem in representation learning. Recently, Locatello et al. (2019) demonstrated that unsupervised disentanglement learning without inductive biases is theoretically…

Machine Learning · Computer Science 2020-02-17 Francesco Locatello , Michael Tschannen , Stefan Bauer , Gunnar Rätsch , Bernhard Schölkopf , Olivier Bachem

Variational autoencoders (VAEs) are among leading approaches to address the problem of learning disentangled representations. Typically a single VAE is used and disentangled representations are sought within its single continuous latent…

Machine Learning · Statistics 2026-04-02 Veranika Boukun , Jörg Lücke

Conditional variational autoencoders (CVAEs) are versatile deep generative models that extend the standard VAE framework by conditioning the generative model with auxiliary covariates. The original CVAE model assumes that the data samples…

Machine Learning · Statistics 2022-03-03 Siddharth Ramchandran , Gleb Tikhonov , Otto Lönnroth , Pekka Tiikkainen , Harri Lähdesmäki

Given a dataset of images containing different objects with different features such as shape, size, rotation, and x-y position; and a Variational Autoencoder (VAE); creating a disentangled encoding of these features in the hidden space…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Mohammad Haghir Ebrahimabadi

The process of generating data such as images is controlled by independent and unknown factors of variation. The retrieval of these variables has been studied extensively in the disentanglement, causal representation learning, and…

Machine Learning · Computer Science 2023-09-26 Gaël Gendron , Michael Witbrock , Gillian Dobbie

Causal disentanglement aims to uncover a representation of data using latent variables that are interrelated through a causal model. Such a representation is identifiable if the latent model that explains the data is unique. In this paper,…

Representation learners that disentangle factors of variation have already proven to be important in addressing various real world concerns such as fairness and interpretability. Initially consisting of unsupervised models with independence…

Machine Learning · Computer Science 2021-12-13 Abbavaram Gowtham Reddy , Benin Godfrey L , Vineeth N Balasubramanian

Despite extensive standardization, diagnostic interviews for mental health disorders encompass substantial subjective judgment. Previous studies have demonstrated that EEG-based neural measures can function as reliable objective correlates…

Machine Learning · Computer Science 2020-11-19 Garrett Honke , Irina Higgins , Nina Thigpen , Vladimir Miskovic , Katie Link , Sunny Duan , Pramod Gupta , Julia Klawohn , Greg Hajcak

Variational Autoencoders (VAEs) provide a theoretically-backed and popular framework for deep generative models. However, learning a VAE from data poses still unanswered theoretical questions and considerable practical challenges. In this…

Machine Learning · Computer Science 2020-06-01 Partha Ghosh , Mehdi S. M. Sajjadi , Antonio Vergari , Michael Black , Bernhard Schölkopf

The article addresses the application of unsupervised machine learning to represent variables on the 2D latent space by applying a variational autoencoder (beta-VAE). Representation of variables on low dimensional spaces allows for data…

Machine Learning · Computer Science 2024-10-29 Alex Glushkovsky

Recently, researches related to unsupervised disentanglement learning with deep generative models have gained substantial popularity. However, without introducing supervision, there is no guarantee that the factors of interest can be…

Machine Learning · Computer Science 2020-03-13 Junxiang Chen , Kayhan Batmanghelich

Finding a low dimensional parametric representation of measured BRDF remains challenging. Currently available solutions are either not interpretable, or rely on limited analytical solutions, or require expensive test subject based…

Graphics · Computer Science 2022-08-09 Alexis Benamira , Sachin Shah , Sumanta Pattanaik

Variational autoencoders are prominent generative models for modeling discrete data. However, with flexible decoders, they tend to ignore the latent codes. In this paper, we study a VAE model with a deterministic decoder (DD-VAE) for…

Machine Learning · Computer Science 2020-03-05 Daniil Polykovskiy , Dmitry Vetrov