English
Related papers

Related papers: Theory and Evaluation Metrics for Learning Disenta…

200 papers

Disentanglement is at the forefront of unsupervised learning, as disentangled representations of data improve generalization, interpretability, and performance in downstream tasks. Current unsupervised approaches remain inapplicable for…

Machine Learning · Computer Science 2020-10-27 Benjamin Estermann , Markus Marks , Mehmet Fatih Yanik

We present a framework for learning disentangled and interpretable jointly continuous and discrete representations in an unsupervised manner. By augmenting the continuous latent distribution of variational autoencoders with a relaxed…

Machine Learning · Statistics 2018-10-23 Emilien Dupont

Disentangled latent spaces usually have better semantic separability and geometrical properties, which leads to better interpretability and more controllable data generation. While this has been well investigated in Computer Vision, in…

Computation and Language · Computer Science 2024-06-12 Yingji Zhang , Danilo S. Carvalho , André Freitas

The goal of a classification model is to assign the correct labels to data. In most cases, this data is not fully described by the given set of labels. Often a rich set of meaningful concepts exist in the domain that can much more precisely…

Machine Learning · Computer Science 2021-08-23 Yoeri Poels , Vlado Menkovski

Fair representation learning aims to encode invariant representation with respect to the protected attribute, such as gender or age. In this paper, we design Fairness-aware Disentangling Variational AutoEncoder (FD-VAE) for fair…

Machine Learning · Computer Science 2020-07-09 Sungho Park , Dohyung Kim , Sunhee Hwang , Hyeran Byun

User behavior data in recommender systems are driven by the complex interactions of many latent factors behind the users' decision making processes. The factors are highly entangled, and may range from high-level ones that govern user…

Machine Learning · Computer Science 2019-11-01 Jianxin Ma , Chang Zhou , Peng Cui , Hongxia Yang , Wenwu Zhu

Learning disentangled representations is a key step towards effectively discovering and modelling the underlying structure of environments. In the natural sciences, physics has found great success by describing the universe in terms of…

Machine Learning · Computer Science 2020-10-27 Robin Quessard , Thomas D. Barrett , William R. Clements

Contrastive learning has recently emerged as a promising approach for learning data representations that discover and disentangle the explanatory factors of the data. Previous analyses of such approaches have largely focused on individual…

Machine Learning · Computer Science 2023-11-09 Stefan Matthes , Zhiwei Han , Hao Shen

We propose a novel approach to disentangle the generative factors of variation underlying a given set of observations. Our method builds upon the idea that the (unknown) low-dimensional manifold underlying the data space can be explicitly…

Machine Learning · Computer Science 2021-10-05 Marco Fumero , Luca Cosmo , Simone Melzi , Emanuele Rodolà

Disentangled and invariant representations are two critical goals of representation learning and many approaches have been proposed to achieve either one of them. However, those two goals are actually complementary to each other so that we…

Machine Learning · Computer Science 2022-09-16 Jiageng Zhu , Hanchen Xie , Wael Abd-Almageed

Learning disentangled representations without supervision or inductive biases, often leads to non-interpretable or undesirable representations. On the other hand, strict supervision requires detailed knowledge of the true generative…

Machine Learning · Computer Science 2020-08-25 Vasilis Margonis , Athanasios Davvetas , Iraklis A. Klampanos

Disentangled representation learning finds compact, independent and easy-to-interpret factors of the data. Learning such has been shown to require an inductive bias, which we explicitly encode in a generative model of images. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Nicki Skafte Detlefsen , Søren Hauberg

Speech signals encode emotional, linguistic, and pathological information within a shared acoustic channel; however, disentanglement is typically assessed indirectly through downstream task performance. We introduce an information-theoretic…

Sound · Computer Science 2026-02-25 Bipasha Kashyap , Björn W. Schuller , Pubudu N. Pathirana

Disentangled representations have recently been shown to improve fairness, data efficiency and generalisation in simple supervised and reinforcement learning tasks. To extend the benefits of disentangled representations to more complex…

Existing deep learning approaches for learning visual features tend to overlearn and extract more information than what is required for the task at hand. From a privacy preservation perspective, the input visual information is not protected…

Computer Vision and Pattern Recognition · Computer Science 2020-05-21 Naveen Panwar , Tarun Tater , Anush Sankaran , Senthil Mani

Learning disentanglement aims at finding a low dimensional representation which consists of multiple explanatory and generative factors of the observational data. The framework of variational autoencoder (VAE) is commonly used to…

Machine Learning · Computer Science 2023-12-20 Mengyue Yang , Furui Liu , Zhitang Chen , Xinwei Shen , Jianye Hao , Jun Wang

Given a dataset of images containing different objects with different features such as shape, size, rotation, and x-y position; and a Variational Autoencoder (VAE); creating a disentangled encoding of these features in the hidden space…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Mohammad Haghir Ebrahimabadi

Disentangled representation learning has recently attracted a significant amount of attention, particularly in the field of image representation learning. However, learning the disentangled representations behind a graph remains largely…

Machine Learning · Computer Science 2020-06-11 Xiaojie Guo , Liang Zhao , Zhao Qin , Lingfei Wu , Amarda Shehu , Yanfang Ye

We study the problem of learning disentangled representations for data across multiple domains and its applications in human retargeting. Our goal is to map an input image to an identity-invariant latent representation that captures…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Chao Yang , Xiaofeng Liu , Qingming Tang , C. -C. Jay Kuo

We develop a generalisation of disentanglement in VAEs---decomposition of the latent representation---characterising it as the fulfilment of two factors: a) the latent encodings of the data having an appropriate level of overlap, and b) the…

Machine Learning · Statistics 2019-06-13 Emile Mathieu , Tom Rainforth , N. Siddharth , Yee Whye Teh