English
Related papers

Related papers: Revisiting Disentanglement in Downstream Tasks: A …

200 papers

The effective application of representation learning to real-world problems requires both techniques for learning useful representations, and also robust ways to evaluate properties of representations. Recent work in disentangled…

Machine Learning · Computer Science 2020-12-16 Salman Mohammadi , Anders Kirk Uhrenholt , Bjørn Sand Jensen

Multi-view (or -modality) representation learning aims to understand the relationships between different view representations. Existing methods disentangle multi-view representations into consistent and view-specific representations by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Guanzhou Ke , Yang Yu , Guoqing Chao , Xiaoli Wang , Chenyang Xu , Shengfeng He

Recent approaches in music generation rely on disentangled representations, often labeled as structure and timbre or local and global, to enable controllable synthesis. Yet the underlying properties of these embeddings remain underexplored.…

A recent spate of state-of-the-art semi- and un-supervised solutions disentangle and encode image "content" into a spatial tensor and image appearance or "style" into a vector, to achieve good performance in spatially equivariant tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Xiao Liu , Spyridon Thermos , Gabriele Valvano , Agisilaos Chartsias , Alison O'Neil , Sotirios A. Tsaftaris

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Humans have a remarkable ability to disentangle complex sensory inputs (e.g., image, text) into simple factors of variation (e.g., shape, color) without much supervision. This ability has inspired many works that attempt to solve the…

Machine Learning · Computer Science 2024-12-25 Kartik Ahuja , Divyat Mahajan , Vasilis Syrgkanis , Ioannis Mitliagkas

Disentangled representation has been widely explored in many fields due to its maximal compactness, interpretability and versatility. Recommendation system also needs disentanglement to make representation more explainable and general for…

Social and Information Networks · Computer Science 2020-10-27 Weiguang Chen , Wenjun Jiang , Xueqi Li , Kenli Li , Albert Zomaya , Guojun Wang

To highlight the challenges of achieving representation disentanglement for text domain in an unsupervised setting, in this paper we select a representative set of successfully applied models from the image domain. We evaluate these models…

Computation and Language · Computer Science 2021-06-08 Lan Zhang , Victor Prokhorov , Ehsan Shareghi

Generative models that learn disentangled representations for different factors of variation in an image can be very useful for targeted data augmentation. By sampling from the disentangled latent subspace of interest, we can efficiently…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Ananya Harsh Jha , Saket Anand , Maneesh Singh , V. S. R. Veeravasarapu

Prior works have demonstrated that implicit representations trained only for reconstruction tasks typically generate encodings that are not useful for semantic tasks. In this work, we propose a method that contextualises the encodings of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Theo W. Costain , Kejie Li , Victor A. Prisacariu

Unsupervised representation learning for dynamic graphs has attracted a lot of research attention in recent years. Compared with static graph, the dynamic graph is a comprehensive embodiment of both the intrinsic stable characteristics of…

Social and Information Networks · Computer Science 2023-08-17 Kaike Zhang , Qi Cao , Gaolin Fang , Bingbing Xu , Hongjian Zou , Huawei Shen , Xueqi Cheng

The idea behind the \emph{unsupervised} learning of \emph{disentangled} representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this…

Machine Learning · Computer Science 2020-10-29 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

Disentangled representation learning strives to extract the intrinsic factors within observed data. Factorizing these representations in an unsupervised manner is notably challenging and usually requires tailored loss functions or specific…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Tao Yang , Cuiling Lan , Yan Lu , Nanning zheng

Learning disentangled representations of high-dimensional data is currently an active research area. However, compared to the field of computer vision, less work has been done for speech processing. In this paper, we provide a review of two…

Sound · Computer Science 2018-08-10 Yuan Gong , Christian Poellabauer

Unsupervised learning enables modeling complex images without the need for annotations. The representation learned by such models can facilitate any subsequent analysis of large image datasets. However, some generative factors that cause…

Image and Video Processing · Electrical Eng. & Systems 2020-08-27 Maxime W. Lafarge , Josien P. W. Pluim , Mitko Veta

Learning interpretable and disentangled representations is a crucial yet challenging task in representation learning. In this work, we focus on semi-supervised disentanglement learning and extend work by Locatello et al. (2019) by…

Machine Learning · Computer Science 2020-06-24 Weili Nie , Zichao Wang , Ankit B. Patel , Richard G. Baraniuk

Disentangled representations support a range of downstream tasks including causal reasoning, generative modeling, and fair machine learning. Unfortunately, disentanglement has been shown to be impossible without the incorporation of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

The process of generating data such as images is controlled by independent and unknown factors of variation. The retrieval of these variables has been studied extensively in the disentanglement, causal representation learning, and…

Machine Learning · Computer Science 2023-09-26 Gaël Gendron , Michael Witbrock , Gillian Dobbie

The advancements in disentangled representation learning significantly enhance the accuracy of counterfactual predictions by granting precise control over instrumental variables, confounders, and adjustable variables. An appealing method…

Machine Learning · Computer Science 2024-06-17 Xinshu Li , Mingming Gong , Lina Yao

Auxiliary tasks facilitate learning in situations where data is scarce or the principal task of interest is extremely complex. This idea is primarily inspired by the improved generalization capability induced by solving multiple tasks…

Machine Learning · Computer Science 2025-07-28 Geri Skenderi , Luigi Capogrosso , Andrea Toaiari , Matteo Denitto , Franco Fummi , Simone Melzi