English
Related papers

Related papers: Disentanglement Challenge: From Regularization to …

200 papers

Given an image dataset, we are often interested in finding data generative factors that encode semantic content independently from pose variables such as rotation and translation. However, current disentanglement approaches do not impose…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Tristan Bepler , Ellen D. Zhong , Kotaro Kelley , Edward Brignole , Bonnie Berger

In recent years, extending variational autoencoder's framework to learn disentangled representations has received much attention. We address this problem by proposing a framework capable of disentangling class-related and class-independent…

Machine Learning · Computer Science 2021-02-02 Sina Hajimiri , Aryo Lotfi , Mahdieh Soleymani Baghshah

Representation learning is the foundation for the recent success of neural network models. However, the distributed representations generated by neural networks are far from ideal. Due to their highly entangled nature, they are di cult to…

Machine Learning · Computer Science 2016-02-09 William Whitney

Learning disentangled causal representations is a challenging problem that has gained significant attention recently due to its implications for extracting meaningful information for downstream tasks. In this work, we define a new notion of…

Machine Learning · Computer Science 2024-08-27 Aneesh Komanduri , Yongkai Wu , Feng Chen , Xintao Wu

Improving controllability or the ability to manipulate one or more attributes of the generated data has become a topic of interest in the context of deep generative models of music. Recent attempts in this direction have relied on learning…

Sound · Computer Science 2021-08-04 Ashis Pati , Alexander Lerch

We address the problem of unsupervised disentanglement of discrete and continuous explanatory factors of data. We first show a simple procedure for minimizing the total correlation of the continuous latent variables without having to use a…

Machine Learning · Computer Science 2019-05-24 Yeonwoo Jeong , Hyun Oh Song

Learning disentanglement aims at finding a low dimensional representation which consists of multiple explanatory and generative factors of the observational data. The framework of variational autoencoder (VAE) is commonly used to…

Machine Learning · Computer Science 2023-12-20 Mengyue Yang , Furui Liu , Zhitang Chen , Xinwei Shen , Jianye Hao , Jun Wang

A core challenge in Machine Learning is to learn to disentangle natural factors of variation in data (e.g. object shape vs. pose). A popular approach to disentanglement consists in learning to map each of these factors to distinct subspaces…

Machine Learning · Computer Science 2021-02-11 Diane Bouchacourt , Mark Ibrahim , Stéphane Deny

Disentangled representations have recently been shown to improve fairness, data efficiency and generalisation in simple supervised and reinforcement learning tasks. To extend the benefits of disentangled representations to more complex…

Learning precise representations of users and items to fit observed interaction data is the fundamental task of collaborative filtering. Existing studies usually infer entangled representations to fit such interaction data, neglecting to…

Information Retrieval · Computer Science 2024-01-11 Zhiqiang Guo , Guohui Li , Jianjun Li , Chaoyang Wang , Si Shi

Disentanglement is a useful property in representation learning which increases the interpretability of generative models such as Variational autoencoders (VAE), Generative Adversarial Models, and their many variants. Typically in such…

Machine Learning · Computer Science 2022-05-31 Arun Pandey , Michael Fanuel , Joachim Schreurs , Johan A. K. Suykens

Representation learning is an approach that allows to discover and extract the factors of variation from the data. Intuitively, a representation is said to be disentangled if it separates the different factors of variation in a way that is…

Machine Learning · Computer Science 2026-02-25 Antonio Almudévar , Alfonso Ortega

Disentanglement is a highly desirable property of representation due to its similarity with human's understanding and reasoning. This improves interpretability, enables the performance of down-stream tasks, and enables controllable…

Machine Learning · Computer Science 2020-10-24 Jiantao Wu , Lin Wang

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

Disentangled representation learning has undoubtedly benefited from objective function surgery. However, a delicate balancing act of tuning is still required in order to trade off reconstruction fidelity versus disentanglement. Building on…

Machine Learning · Statistics 2020-10-09 Benoit Gaujac , Ilya Feige , David Barber

Disentangled representation learning aims to learn low-dimensional representations where each dimension corresponds to an underlying generative factor. While the Variational Auto-Encoder (VAE) is widely used for this purpose, most existing…

Machine Learning · Computer Science 2024-12-31 Di Fan , Yannian Kou , Chuanhou Gao

Much research has been devoted to the problem of learning fair representations; however, they do not explicitly the relationship between latent representations. In many real-world applications, there may be causal relationships between…

Machine Learning · Computer Science 2023-12-19 Ziqi Xu , Jixue Liu , Debo Cheng , Jiuyong Li , Lin Liu , Ke Wang

Learning disentangled representations that correspond to factors of variation in real-world data is critical to interpretable and human-controllable machine learning. Recently, concerns about the viability of learning disentangled…

Machine Learning · Computer Science 2020-04-14 Rui Shu , Yining Chen , Abhishek Kumar , Stefano Ermon , Ben Poole

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

Learning disentangled representations is considered a cornerstone problem in representation learning. Recently, Locatello et al. (2019) demonstrated that unsupervised disentanglement learning without inductive biases is theoretically…

Machine Learning · Computer Science 2020-02-17 Francesco Locatello , Michael Tschannen , Stefan Bauer , Gunnar Rätsch , Bernhard Schölkopf , Olivier Bachem