English
Related papers

Related papers: Disentanglement Challenge: From Regularization to …

200 papers

The ability of Variational Autoencoders (VAEs) to learn disentangled representations has made them popular for practical applications. However, their behaviour is not yet fully understood. For example, the questions of when they can provide…

Machine Learning · Computer Science 2022-09-27 Lisa Bonheme , Marek Grzes

Disentangled and invariant representations are two critical goals of representation learning and many approaches have been proposed to achieve either one of them. However, those two goals are actually complementary to each other so that we…

Machine Learning · Computer Science 2022-09-16 Jiageng Zhu , Hanchen Xie , Wael Abd-Almageed

Learning interpretable representations with variational autoencoders (VAEs) is a major goal of representation learning. The main challenge lies in obtaining disentangled representations, where each latent dimension corresponds to a distinct…

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

Machine Learning · Computer Science 2022-11-16 Rafael Pastrana

Deep generative models come with the promise to learn an explainable representation for visual objects that allows image sampling, synthesis, and selective modification. The main challenge is to learn to properly model the independent…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Patrick Esser , Johannes Haux , Björn Ommer

The advancements in disentangled representation learning significantly enhance the accuracy of counterfactual predictions by granting precise control over instrumental variables, confounders, and adjustable variables. An appealing method…

Machine Learning · Computer Science 2024-06-17 Xinshu Li , Mingming Gong , Lina Yao

We introduce a conditional generative model for learning to disentangle the hidden factors of variation within a set of labeled observations, and separate them into complementary codes. One code summarizes the specified factors of variation…

Machine Learning · Computer Science 2016-11-11 Michael Mathieu , Junbo Zhao , Pablo Sprechmann , Aditya Ramesh , Yann LeCun

Modeling trajectories generated by robot joints is complex and required for high level activities like trajectory generation, clustering, and classification. Disentagled representation learning promises advances in unsupervised learning,…

Robotics · Computer Science 2021-12-07 Matias Valdenegro-Toro , Daniel Harnack , Hendrik Wöhrle

Many real-world datasets can be divided into groups according to certain salient features (e.g. grouping images by subject, grouping text by font, etc.). Often, machine learning tasks require that these features be represented separately…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-16 Dan Andrei Iliescu , Aliaksei Mikhailiuk , Damon Wischik , Rafal Mantiuk

Learning disentangled representations of data is a fundamental problem in artificial intelligence. Specifically, disentangled latent representations allow generative models to control and compose the disentangled factors in the synthesis…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Yotam Nitzan , Amit Bermano , Yangyan Li , Daniel Cohen-Or

Disentangled representation learning plays a pivotal role in making representations controllable, interpretable and transferable. Despite its significance in the domain, the quest for reliable and consistent quantitative disentanglement…

Machine Learning · Computer Science 2024-10-07 Sahib Julka , Yashu Wang , Michael Granitzer

Learning to disentangle the hidden factors of variations within a set of observations is a key task for artificial intelligence. We present a unified formulation for class and content disentanglement and use it to illustrate the limitations…

Machine Learning · Computer Science 2020-02-19 Aviv Gabbay , Yedid Hoshen

We present a self-supervised method to disentangle factors of variation in high-dimensional data that does not rely on prior knowledge of the underlying variation profile (e.g., no assumptions on the number or distribution of the individual…

Machine Learning · Computer Science 2022-09-23 Eric Yeats , Frank Liu , David Womble , Hai Li

Disentanglement is the task of learning representations that identify and separate factors that explain the variation observed in data. Disentangled representations are useful to increase the generalizability, explainability, and fairness…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-09 Michael Kuhlmann , Adrian Meise , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

Recent disentangled representation learning (DRL) methods heavily rely on factor specific strategies-either learning objectives for attributes or model architectures for objects-to embed inductive biases. Such divergent approaches result in…

Machine Learning · Computer Science 2025-11-12 Whie Jung , Dong Hoon Lee , Seunghoon Hong

The idea behind the \emph{unsupervised} learning of \emph{disentangled} representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this…

Machine Learning · Computer Science 2020-10-29 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

Learning discriminative powerful representations is a crucial step for machine learning systems. Introducing invariance against arbitrary nuisance or sensitive attributes while performing well on specific tasks is an important problem in…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Mhd Hasan Sarhan , Nassir Navab , Abouzar Eslami , Shadi Albarqouni

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

Representation learners that disentangle factors of variation have already proven to be important in addressing various real world concerns such as fairness and interpretability. Initially consisting of unsupervised models with independence…

Machine Learning · Computer Science 2021-12-13 Abbavaram Gowtham Reddy , Benin Godfrey L , Vineeth N Balasubramanian

Goal-conditioned reinforcement learning is a crucial yet challenging algorithm which enables agents to achieve multiple user-specified goals when learning a set of skills in a dynamic environment. However, it typically requires millions of…

Robotics · Computer Science 2022-03-01 Zhifeng Qian , Mingyu You , Hongjun Zhou , Bin He