English
Related papers

Related papers: How to Not Measure Disentanglement

200 papers

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

How can intelligent agents solve a diverse set of tasks in a data-efficient manner? The disentangled representation learning approach posits that such an agent would benefit from separating out (disentangling) the underlying structure of…

Machine Learning · Computer Science 2018-12-07 Irina Higgins , David Amos , David Pfau , Sebastien Racaniere , Loic Matthey , Danilo Rezende , Alexander Lerchner

Learning disentangled representations that correspond to factors of variation in real-world data is critical to interpretable and human-controllable machine learning. Recently, concerns about the viability of learning disentangled…

Machine Learning · Computer Science 2020-04-14 Rui Shu , Yining Chen , Abhishek Kumar , Stefano Ermon , Ben Poole

Disentangling anatomical and contrast information from medical images has gained attention recently, demonstrating benefits for various image analysis tasks. Current methods learn disentangled representations using either paired multi-modal…

Image and Video Processing · Electrical Eng. & Systems 2022-05-11 Lianrui Zuo , Yihao Liu , Yuan Xue , Shuo Han , Murat Bilgel , Susan M. Resnick , Jerry L. Prince , Aaron Carass

Developing meaningful and efficient representations that separate the fundamental structure of the data generation mechanism is crucial in representation learning. However, Disentangled Representation Learning has not fully shown its…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Jacopo Dapueto , Nicoletta Noceti , Francesca Odone

In representation learning, a disentangled representation is highly desirable as it encodes generative factors of data in a separable and compact pattern. Researchers have advocated leveraging disentangled representations to complete…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Ruiqian Nai , Zixin Wen , Ji Li , Yuanzhi Li , Yang Gao

A recent spate of state-of-the-art semi- and un-supervised solutions disentangle and encode image "content" into a spatial tensor and image appearance or "style" into a vector, to achieve good performance in spatially equivariant tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Xiao Liu , Spyridon Thermos , Gabriele Valvano , Agisilaos Chartsias , Alison O'Neil , Sotirios A. Tsaftaris

Latent traversal is a popular approach to visualize the disentangled latent representations. Given a bunch of variations in a single unit of the latent representation, it is expected that there is a change in a single factor of variation of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Xinqi Zhu , Chang Xu , Dacheng Tao

Disentanglement is the task of learning representations that identify and separate factors that explain the variation observed in data. Disentangled representations are useful to increase the generalizability, explainability, and fairness…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-09 Michael Kuhlmann , Adrian Meise , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

The recently introduced weakly disentangled representations proposed to relax some constraints of the previous definitions of disentanglement, in exchange for more flexibility. However, at the moment, weak disentanglement can only be…

Machine Learning · Computer Science 2022-09-13 Andrea Valenti , Davide Bacciu

Disentangled representations seek to recover latent factors of variation underlying observed data, yet their identifiability is still not fully understood. We introduce a unified framework in which disentanglement is achieved through…

Machine Learning · Computer Science 2026-05-12 Stefan Matthes , Zhiwei Han , Hao Shen

Concept-based explanations have emerged as a popular way of extracting human-interpretable representations from deep discriminative models. At the same time, the disentanglement learning literature has focused on extracting similar…

Machine Learning · Computer Science 2021-04-15 Dmitry Kazhdan , Botty Dimanov , Helena Andres Terre , Mateja Jamnik , Pietro Liò , Adrian Weller

Disentanglement via mechanism sparsity was introduced recently as a principled approach to extract latent factors without supervision when the causal graph relating them in time is sparse, and/or when actions are observed and affect them…

Machine Learning · Statistics 2022-07-19 Sébastien Lachapelle , Simon Lacoste-Julien

A large literature has grown up around the proposed use of 'weak measurements' (i.e., unsharp measurements followed by post-selection) to allegedly provide information about hidden ontological features of quantum systems. This paper…

Quantum Physics · Physics 2017-05-16 R. E. Kastner

Aleatoric (data) and epistemic (knowledge) uncertainty are textbook components of Uncertainty Quantification. Jointly estimating these components has been shown to be problematic and non-trivial. As a result, there are multiple ways to…

Machine Learning · Computer Science 2026-02-12 Ivo Pascal de Jong , Andreea Ioana Sburlea , Matthia Sabatelli , Matias Valdenegro-Toro

Uncertainty quantification, once a singular task, has evolved into a spectrum of tasks, including abstained prediction, out-of-distribution detection, and aleatoric uncertainty quantification. The latest goal is disentanglement: the…

Machine Learning · Computer Science 2024-12-02 Bálint Mucsányi , Michael Kirchhof , Seong Joon Oh

Several measures of non-convexity (departures from convexity) have been introduced in the literature, both for sets and functions. Some of them are of geometric nature, while others are more of topological nature. We address the statistical…

Statistics Theory · Mathematics 2022-11-23 Alejandro Cholaquidis , Ricardo Fraiman , Leonardo Moreno , Beatriz Pateiro-López

Started from local universal isotropic disentanglement, a threshold inequality on reduction factors is proposed, which is necessary and sufficient for this type of disentanglement processes. Furthermore, we give the conditions realizing…

Quantum Physics · Physics 2009-10-31 Zheng-Wei Zhou , Guang-Can Guo

Learning disentangled representations is regarded as a fundamental task for improving the generalization, robustness, and interpretability of generative models. However, measuring disentanglement has been challenging and inconsistent, often…

Machine Learning · Statistics 2021-03-19 Sharon Zhou , Eric Zelikman , Fred Lu , Andrew Y. Ng , Gunnar Carlsson , Stefano Ermon

Unsupervised learning of disentangled representations has been closely tied to enhancing the representation intepretability of Recommender Systems (RSs). This has been achieved by making the representation of individual features more…

Information Retrieval · Computer Science 2025-02-03 Ervin Dervishaj , Tuukka Ruotsalo , Maria Maistro , Christina Lioma